-- Logs begin at Tue 2022-07-12 12:33:35 UTC, end at Tue 2022-07-12 13:34:31 UTC. -- Jul 12 13:02:56.983109 dv-cinder-797608-55-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 12 13:02:56.994161 dv-cinder-797608-55-smb devstack@keystone.service[80622]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 12 13:02:56.994161 dv-cinder-797608-55-smb devstack@keystone.service[80622]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 13:02:56 2022] *** Jul 12 13:02:56.994161 dv-cinder-797608-55-smb devstack@keystone.service[80622]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 13:02:56.994161 dv-cinder-797608-55-smb devstack@keystone.service[80622]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 13:02:56.994161 dv-cinder-797608-55-smb devstack@keystone.service[80622]: nodename: dv-cinder-797608-55-smb Jul 12 13:02:56.994161 dv-cinder-797608-55-smb devstack@keystone.service[80622]: machine: x86_64 Jul 12 13:02:56.994161 dv-cinder-797608-55-smb devstack@keystone.service[80622]: clock source: unix Jul 12 13:02:56.994161 dv-cinder-797608-55-smb devstack@keystone.service[80622]: pcre jit disabled Jul 12 13:02:56.994161 dv-cinder-797608-55-smb devstack@keystone.service[80622]: detected number of CPU cores: 4 Jul 12 13:02:56.994161 dv-cinder-797608-55-smb devstack@keystone.service[80622]: current working directory: / Jul 12 13:02:56.994161 dv-cinder-797608-55-smb devstack@keystone.service[80622]: detected binary path: /usr/bin/uwsgi-core Jul 12 13:02:56.994161 dv-cinder-797608-55-smb devstack@keystone.service[80622]: your processes number limit is 47680 Jul 12 13:02:56.994161 dv-cinder-797608-55-smb devstack@keystone.service[80622]: your memory page size is 4096 bytes Jul 12 13:02:56.994161 dv-cinder-797608-55-smb devstack@keystone.service[80622]: detected max file descriptor number: 2048 Jul 12 13:02:56.994161 dv-cinder-797608-55-smb devstack@keystone.service[80622]: lock engine: pthread robust mutexes Jul 12 13:02:56.994161 dv-cinder-797608-55-smb devstack@keystone.service[80622]: thunder lock: enabled Jul 12 13:02:56.994161 dv-cinder-797608-55-smb devstack@keystone.service[80622]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 12 13:02:56.994161 dv-cinder-797608-55-smb devstack@keystone.service[80622]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 13:02:57.039292 dv-cinder-797608-55-smb devstack@keystone.service[80622]: Python main interpreter initialized at 0x55dd998139c0 Jul 12 13:02:57.039292 dv-cinder-797608-55-smb devstack@keystone.service[80622]: python threads support enabled Jul 12 13:02:57.039292 dv-cinder-797608-55-smb devstack@keystone.service[80622]: your server socket listen backlog is limited to 100 connections Jul 12 13:02:57.039292 dv-cinder-797608-55-smb devstack@keystone.service[80622]: your mercy for graceful operations on workers is 90 seconds Jul 12 13:02:57.039688 dv-cinder-797608-55-smb devstack@keystone.service[80622]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 13:02:57.039764 dv-cinder-797608-55-smb devstack@keystone.service[80622]: *** Operational MODE: preforking *** Jul 12 13:02:57.040017 dv-cinder-797608-55-smb devstack@keystone.service[80622]: *** uWSGI is running in multiple interpreter mode *** Jul 12 13:02:57.040017 dv-cinder-797608-55-smb devstack@keystone.service[80622]: spawned uWSGI master process (pid: 80622) Jul 12 13:02:57.040229 dv-cinder-797608-55-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 12 13:02:57.041202 dv-cinder-797608-55-smb devstack@keystone.service[80622]: spawned uWSGI worker 1 (pid: 80627, cores: 1) Jul 12 13:02:57.041202 dv-cinder-797608-55-smb devstack@keystone.service[80622]: spawned uWSGI worker 2 (pid: 80628, cores: 1) Jul 12 13:02:57.041346 dv-cinder-797608-55-smb devstack@keystone.service[80622]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 13:03:02.461612 dv-cinder-797608-55-smb devstack@keystone.service[80628]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:03:02.461612 dv-cinder-797608-55-smb devstack@keystone.service[80628]: from cryptography.utils import int_from_bytes Jul 12 13:03:02.462546 dv-cinder-797608-55-smb devstack@keystone.service[80627]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:03:02.462546 dv-cinder-797608-55-smb devstack@keystone.service[80627]: from cryptography.utils import int_from_bytes Jul 12 13:03:02.462967 dv-cinder-797608-55-smb devstack@keystone.service[80628]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:03:02.462967 dv-cinder-797608-55-smb devstack@keystone.service[80628]: from cryptography.utils import int_from_bytes Jul 12 13:03:02.463070 dv-cinder-797608-55-smb devstack@keystone.service[80627]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:03:02.463070 dv-cinder-797608-55-smb devstack@keystone.service[80627]: from cryptography.utils import int_from_bytes Jul 12 13:03:02.511259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 13:03:02.511723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 13:03:02.511918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] command line args: [] {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 13:03:02.512016 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 13:03:02.512132 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 13:03:02.512214 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 13:03:02.512330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] command line args: [] {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 13:03:02.512419 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ================================================================================ {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 13:03:02.512588 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] admin_token = **** {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.512668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 13:03:02.512772 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ================================================================================ {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 13:03:02.512853 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] config_dir = [] {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.513007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.513092 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] admin_token = **** {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.513172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] config_source = [] {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.513266 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] config_dir = [] {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.513352 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] debug = True {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.513458 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.513539 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.513788 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] config_source = [] {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.513871 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] debug = True {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.513949 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.514029 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.514153 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.514526 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.514658 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.514765 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.514876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.514982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.515080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] list_limit = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.515176 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.515278 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] log_config_append = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.515278 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.515468 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] list_limit = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.515582 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] log_dir = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.515693 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] log_config_append = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.515799 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] log_file = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.515902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.516004 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.516177 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] log_dir = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.516177 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] log_file = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.516389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.516499 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.516603 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.516704 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.516816 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.516816 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.517014 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.517119 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.517224 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.517334 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.517440 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.517440 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.517644 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.517763 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.517886 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.518021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.518168 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.518168 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.518366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.518450 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.518523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.518523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.518711 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.518842 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.518930 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.519003 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.519120 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.519209 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.519209 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.519341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.519419 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] publish_errors = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.519588 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.519692 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.519816 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.519904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] publish_errors = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.519985 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.520059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.520222 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.520343 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.520459 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.520595 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.520721 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] standard_threads = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.520838 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.520954 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.521068 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.521184 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.521430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] standard_threads = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.521553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.521668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.521790 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] use_journal = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.521907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.522030 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] use_json = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.522176 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.522297 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] use_stderr = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.522419 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] use_journal = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.522542 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] use_syslog = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.522658 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] use_json = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.522791 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.522910 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] use_stderr = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.523032 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.523154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] use_syslog = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.523270 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.523386 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:03:02.523509 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.523626 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.523741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.523862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.523977 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.524092 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.524215 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.524332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.524448 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.524563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.524684 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.524800 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.524927 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.525044 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.525159 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.525274 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.525388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.525504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.525627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.525749 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.525865 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.526018 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.526156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.526275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.526415 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.526545 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.526663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.526786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.526908 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.527024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.527223 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.527342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.527448 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.527564 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.527680 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.527801 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.527935 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.528059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.528176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.528291 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.528412 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.528528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.528656 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.528774 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.528895 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.529012 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.529133 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.529249 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.529373 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.529490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.529613 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.529730 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.529882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.530010 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.530210 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.530340 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.530464 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.530586 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.530710 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.530710 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.530940 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.531056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.531172 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.531172 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.531387 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.531510 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.531627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.531742 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.531857 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.531972 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.532087 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.532214 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.532337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.532337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.532553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.532668 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.532783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.532979 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.533103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.533219 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.533335 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.533457 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.533572 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.533696 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.533813 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.533929 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.534045 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.534173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.534299 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.534430 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.534561 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.534741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.534861 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.534977 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.535099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.535224 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.535342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.535457 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.535556 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.535652 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.535754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.535859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.535966 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.536062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.536170 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.536274 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.536413 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.536525 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.536643 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.536761 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.536877 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.536994 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.537110 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.537234 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.537341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.537461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.537578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.537696 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.537822 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.537930 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.538064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.538198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.538328 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.538442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.538558 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.538674 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.538801 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.538919 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.539035 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.539159 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.539283 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.539400 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.539516 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.539630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.539746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.539863 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.539968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.540083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.540208 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.540326 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.540442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.540558 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.540673 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.540789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.540913 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.541517 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.541639 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.541755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.541871 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.541987 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.542153 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.542277 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.542394 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.542511 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.542627 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.542754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.542885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.543002 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.543125 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.543241 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.543359 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.543476 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.543600 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.543725 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.543842 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.543958 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.544074 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.544190 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.544318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.544437 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.544553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.544669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.544784 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.545161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.545356 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.545478 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.545595 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.545711 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.545827 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.545943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.546072 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.546217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.546348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.546468 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.546584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.546707 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.546824 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.546940 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.547068 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.547186 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.547354 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.547535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.547676 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.547795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.547921 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.548039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.548156 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.548272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.548388 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.548504 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.548629 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.548746 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.548862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.548978 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] auth.external = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.548978 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.549203 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.549203 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.549421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.549546 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.549674 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.549674 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] auth.password = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.549930 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] auth.external = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.550057 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] auth.token = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.550261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.550388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.550513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.550640 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.550766 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.550886 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.551011 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] auth.password = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.551130 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.551247 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] auth.token = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.551364 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.551480 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.551597 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.551723 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.551842 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.551960 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.552077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] credential.caching = True {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.552193 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.552310 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.552435 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.552554 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.552672 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.552672 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.552926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.552926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.553157 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] credential.caching = True {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.553276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.553393 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.553517 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.553635 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.553753 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.553879 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.553879 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.554191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.554191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.554415 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.554415 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.554642 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.554770 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.554897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.555049 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.555166 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.555290 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.555416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.555535 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.555660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.555660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.555882 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.555999 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] federation.caching = True {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.556129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.556248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.556365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.556482 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.556599 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.557329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.557463 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.557583 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.557700 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] federation.caching = True {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.557818 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.557935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.558054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.558233 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.558355 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.558473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.558598 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.558717 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.558835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.558961 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.559083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.559201 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.559327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.559445 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.559563 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] identity.caching = True {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.559689 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.559809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.559927 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.560045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.560163 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.560364 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.560486 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.560603 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.560720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] identity.caching = True {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.560838 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.560955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.561080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.561201 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.561318 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.561436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.561554 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.561671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.561797 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.561916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.562034 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.562168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.562288 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.562404 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.562534 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.562654 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.562824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.562966 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.563086 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.563204 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.563331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.563450 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.563566 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.563692 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.563818 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.563943 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.564070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.564188 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.564313 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.564431 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.564549 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.564666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.564791 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.564909 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.565027 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.565143 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.565259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.565376 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.565501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.565620 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.565736 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.565853 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.565971 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.565971 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.566321 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.566444 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.566561 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.566678 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.566795 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.566912 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.567037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.567156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.567273 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.567390 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.567507 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.567624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.567752 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.567871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.567989 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.567989 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.568207 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.568324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.568450 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.568569 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.568686 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.568802 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.568919 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.569036 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.569161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.569161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.569381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.569498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.569615 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.569615 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.569842 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.569961 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.570078 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.570215 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.570334 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.570334 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.570566 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.570566 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.570787 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.570904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.571022 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.571022 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.571250 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.571369 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.571486 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.571604 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.571721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.571837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.user = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.571963 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.572082 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.572198 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.572341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.572460 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.572586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.572706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.572823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.572940 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.573057 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.573174 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.user = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.573300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.573418 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.573536 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.573653 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.573759 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.573874 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.574005 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.574164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.574285 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.574403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.574521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.574638 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.574768 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.574889 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.575006 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.575122 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.575239 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.575355 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.575480 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.575599 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.575716 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.575835 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.575952 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.576069 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.576199 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.576318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.576436 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.576553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.576677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.576795 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.576921 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.577041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.577158 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.577276 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.577393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.577510 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.577635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.577753 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.577870 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.577988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.578105 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.578239 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.578369 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.578495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.578614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.578731 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.578849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.578967 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.579092 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.579211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.579329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.579445 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.579563 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.579680 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.579805 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.579924 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.580043 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.580160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.580277 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.580394 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.580519 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.580638 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.580755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] resource.caching = True {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.580872 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.580989 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.581107 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.581232 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.581352 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.581469 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.581585 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.581702 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.581819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.581944 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.582063 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] resource.caching = True {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.582225 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.582344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.582462 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.582578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.582709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.582828 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.582946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.583063 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.583181 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] role.caching = True {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.583299 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.583489 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] role.driver = sql {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.583616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.583735 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.583852 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.583970 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.584087 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.584214 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.584334 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.584451 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.584568 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] role.caching = True {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.584686 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.584802 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] role.driver = sql {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.584928 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.585047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.585164 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.585282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.585399 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.585524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.585644 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.585761 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.585879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.585996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.586135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.586268 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.586390 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.586508 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.586625 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.586742 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.586860 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.586986 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.587106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.587225 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.587343 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.587461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.587579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.587705 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.587824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.587965 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.588084 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.588202 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.588320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.588320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.588552 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.588552 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.588781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.588899 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.589018 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.589018 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.589249 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.589367 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.589486 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.589603 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.589721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.589847 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.589966 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.590084 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.590247 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.590366 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.590498 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.590618 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.590736 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.590854 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.590972 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.591089 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.591215 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.591334 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.591451 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.591570 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] token.caching = True {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.591687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.591805 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.591931 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.592050 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.592167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.592285 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.592402 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.592520 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.592647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.592767 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.592884 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.593001 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.593119 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] token.caching = True {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.593236 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.593361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.593481 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.593598 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.593716 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.593833 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.593951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.594076 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.594216 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.594334 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.594452 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.594570 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.594688 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.594818 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.594939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.595057 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.595174 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.595292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.595409 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.595535 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.595655 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.595773 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.595890 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] database.connection = **** {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.596017 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.596150 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.596269 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.596387 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.596513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.596632 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.596750 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.596868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.596986 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.597104 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.597230 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.597349 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.597467 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] database.connection = **** {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.597593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.597721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.597841 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.597959 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.598085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.598221 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.598339 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.598457 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.598574 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.598574 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.598806 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.598928 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.599046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.599164 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.599282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.599400 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.599530 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.599650 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.599766 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.599884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.600002 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.600119 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.600245 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.600364 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 13:03:02.600482 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.600482 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.600482 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.600482 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.600482 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.600482 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.600482 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:03:02.600482 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 13:03:02.627160 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.627466 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.627578 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.628072 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.628388 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.628532 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.636846 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.637817 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.664791 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.665018 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.666101 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.666338 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.808838 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.812511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.857991 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.858360 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.858657 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.858901 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.923416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.923646 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.923739 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.923871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.923960 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.924090 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.924175 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.924306 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.924391 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.924521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.924609 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.924759 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.949376 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.949610 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.949838 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.949925 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.950064 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.950174 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.950316 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.950414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.950533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.950619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.950747 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.950831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.950961 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.951180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.961857 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.961961 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.975096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.975331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.975558 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.975719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.975806 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.975960 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.976044 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.976187 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.976274 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.976398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.976483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.976613 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.976828 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.977043 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:03:02.994673 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:02.994673 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 13:03:02.995300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:02.995300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 13:03:02.995459 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:02.995538 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:02.995615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:02.995691 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 13:03:02.995813 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:02.995986 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:02.996081 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:02.996186 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 13:03:02.996453 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:02.996711 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:02.996966 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:02.997221 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.006802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.007080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.007342 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.007616 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.008048 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.008326 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.008596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.008877 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.016145 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.017479 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.019478 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.019766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.020047 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.020326 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.020604 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.020839 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.020926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.021114 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.021197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.021401 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.021540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.021662 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.021822 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.021926 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.022090 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.022239 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.022379 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.022751 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.023028 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.023302 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.023576 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.023932 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.049752 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.051384 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.051556 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.051665 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.053171 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.053456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.056934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.057211 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.057608 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.058779 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.059113 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.059469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.064857 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.065139 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.066775 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.067061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.069599 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.069885 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.070183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.070461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.070731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.071257 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.071257 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.071505 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.071588 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.071825 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.072107 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.072416 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.072692 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.072963 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.073228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.073494 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.090502 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.090775 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.092560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.092839 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.095341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.097370 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.098960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.099252 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.101147 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.101443 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.104909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.107273 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.108526 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.110915 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.112151 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.112444 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.112735 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.113021 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.113292 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.113571 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.114593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.114891 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.115185 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.115480 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.115779 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.116060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.132499 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.132781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.133046 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.133303 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.135684 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.135970 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.136242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.136768 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.141978 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.143690 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.143964 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.144687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.146424 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.146703 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.147136 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.147415 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.147696 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.147970 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.148296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.149883 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.150189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.151285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.151573 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.151860 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.162009 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.162308 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.162583 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.162868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.163145 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.164812 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.165088 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.165174 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.165372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.165651 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.165929 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.166256 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.167959 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.168260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.182871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.186142 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.186241 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.189423 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.189508 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.191164 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.192785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.192879 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.193061 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.193353 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.194564 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.196209 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.196488 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.196773 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.201172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.202793 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.204549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.205994 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.206188 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.206308 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.206696 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.206980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.209415 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.209714 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.210125 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.210414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.216593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.216880 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.217160 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.220094 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.220384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.220667 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.224992 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.225272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.225547 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.225820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.226088 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.226494 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.226769 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.227042 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.227317 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.227582 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.227849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.228124 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.228384 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.228562 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:03:03.228672 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.228849 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.229132 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.229409 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.229685 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.230064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.230366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.230637 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.230916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.231189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.231467 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.231738 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.232004 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.232270 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:03:03.267044 dv-cinder-797608-55-smb devstack@keystone.service[80628]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dd998139c0 pid: 80628 (default app) Jul 12 13:03:03.270441 dv-cinder-797608-55-smb devstack@keystone.service[80627]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dd998139c0 pid: 80627 (default app) Jul 12 13:03:03.270529 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174eb8b-05ac-4b9d-a541-0650e569eb76 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:03.270747 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174eb8b-05ac-4b9d-a541-0650e569eb76 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:03.271027 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174eb8b-05ac-4b9d-a541-0650e569eb76 None None] PATH_INFO: `/v3` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:03.275215 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 791 bytes} [Tue Jul 12 13:03:03 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:10.886449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec4e22-9d04-4580-aba0-ab2bb6398bd4 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:10.887014 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec4e22-9d04-4580-aba0-ab2bb6398bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:10.887014 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec4e22-9d04-4580-aba0-ab2bb6398bd4 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:10.891361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:10.896453 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95075ce-7143-49d1-ad48-d93e44accc18 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:10.896867 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95075ce-7143-49d1-ad48-d93e44accc18 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:10.897026 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95075ce-7143-49d1-ad48-d93e44accc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:10.966774 dv-cinder-797608-55-smb devstack@keystone.service[80628]: INFO dbcounter [None req-f95075ce-7143-49d1-ad48-d93e44accc18 None None] Registered counter for database keystone Jul 12 13:03:10.988128 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG oslo_db.sqlalchemy.engines [None req-f95075ce-7143-49d1-ad48-d93e44accc18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80628) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:03:10.994827 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writer thread running {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:03:11.177997 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG passlib.handlers.bcrypt [None req-f95075ce-7143-49d1-ad48-d93e44accc18 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80628) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 12 13:03:11.178445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG passlib.handlers.bcrypt [None req-f95075ce-7143-49d1-ad48-d93e44accc18 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80628) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 12 13:03:11.232624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-f95075ce-7143-49d1-ad48-d93e44accc18 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:11.234232 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-f95075ce-7143-49d1-ad48-d93e44accc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:11.355530 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 12 13:03:11.576149 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec4e22-9d04-4580-aba0-ab2bb6398bd4 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:11.645794 dv-cinder-797608-55-smb devstack@keystone.service[80627]: INFO dbcounter [None req-bcec4e22-9d04-4580-aba0-ab2bb6398bd4 None None] Registered counter for database keystone Jul 12 13:03:11.665599 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG oslo_db.sqlalchemy.engines [None req-bcec4e22-9d04-4580-aba0-ab2bb6398bd4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:03:11.672004 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writer thread running {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:03:11.797025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec4e22-9d04-4580-aba0-ab2bb6398bd4 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:11.801327 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd12ea-39cf-46d2-b828-df60aad16a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:11.801998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd12ea-39cf-46d2-b828-df60aad16a5e admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:11.802317 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd12ea-39cf-46d2-b828-df60aad16a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:11.802605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd12ea-39cf-46d2-b828-df60aad16a5e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:11.811294 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd12ea-39cf-46d2-b828-df60aad16a5e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:11.861945 dv-cinder-797608-55-smb devstack@keystone.service[80627]: WARNING keystone.common.rbac_enforcer.enforcer [None req-71cd12ea-39cf-46d2-b828-df60aad16a5e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 12 13:03:11.862273 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd12ea-39cf-46d2-b828-df60aad16a5e admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:11.872473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1324 bytes} [Tue Jul 12 13:03:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 13:03:11.878421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95075ce-7143-49d1-ad48-d93e44accc18 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:11.893708 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95075ce-7143-49d1-ad48-d93e44accc18 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:11.898173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edef300-7bc3-4ce5-bee0-8dc4b124170e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:11.899307 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edef300-7bc3-4ce5-bee0-8dc4b124170e admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:11.899597 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edef300-7bc3-4ce5-bee0-8dc4b124170e admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:11.899877 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edef300-7bc3-4ce5-bee0-8dc4b124170e admin admin] PATH_INFO: `/v3/projects/b00723f48e18481b8e6c727fe321edb1` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:11.901410 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edef300-7bc3-4ce5-bee0-8dc4b124170e admin admin] RBAC: Authorizing `identity:get_project(project_id=b00723f48e18481b8e6c727fe321edb1)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:11.953794 dv-cinder-797608-55-smb devstack@keystone.service[80628]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7edef300-7bc3-4ce5-bee0-8dc4b124170e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 12 13:03:11.954172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edef300-7bc3-4ce5-bee0-8dc4b124170e admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:11.958769 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 3/5] 10.222.0.17 () {56 vars in 1207 bytes} [Tue Jul 12 13:03:11 2022] GET /identity/v3/projects/b00723f48e18481b8e6c727fe321edb1 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:13.958060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23503d0f-6249-474a-ab03-434ab1687acf None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:13.958616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23503d0f-6249-474a-ab03-434ab1687acf None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:13.958711 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23503d0f-6249-474a-ab03-434ab1687acf None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:13.962724 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 3/6] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:13.967990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc9591-1874-4863-8824-6c360238c893 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:13.968373 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc9591-1874-4863-8824-6c360238c893 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:13.968544 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc9591-1874-4863-8824-6c360238c893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:13.987441 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-73cc9591-1874-4863-8824-6c360238c893 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:13.988956 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-73cc9591-1874-4863-8824-6c360238c893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:13.997342 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 12 13:03:14.019246 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23503d0f-6249-474a-ab03-434ab1687acf None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:14.031934 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23503d0f-6249-474a-ab03-434ab1687acf None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:14.036266 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5eb14-9803-4629-9ce0-b3f938d2a6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:14.036940 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5eb14-9803-4629-9ce0-b3f938d2a6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:14.037231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5eb14-9803-4629-9ce0-b3f938d2a6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:14.037513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5eb14-9803-4629-9ce0-b3f938d2a6b6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:14.046709 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e5eb14-9803-4629-9ce0-b3f938d2a6b6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:14.048523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e5eb14-9803-4629-9ce0-b3f938d2a6b6 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:14.057496 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1324 bytes} [Tue Jul 12 13:03:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:03:14.063270 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc9591-1874-4863-8824-6c360238c893 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:14.072424 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc9591-1874-4863-8824-6c360238c893 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:14.076820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeca70f-766c-437f-aac7-011825b3f5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:14.077698 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeca70f-766c-437f-aac7-011825b3f5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:14.077988 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeca70f-766c-437f-aac7-011825b3f5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:14.078317 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeca70f-766c-437f-aac7-011825b3f5c5 admin admin] PATH_INFO: `/v3/users/25d818b178534416a984336411a31d45` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:14.079704 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeca70f-766c-437f-aac7-011825b3f5c5 admin admin] RBAC: Authorizing `identity:get_user(user_id=25d818b178534416a984336411a31d45)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:14.081543 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeca70f-766c-437f-aac7-011825b3f5c5 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:14.083156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 5/9] 10.222.0.17 () {56 vars in 1198 bytes} [Tue Jul 12 13:03:14 2022] GET /identity/v3/users/25d818b178534416a984336411a31d45 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:16.167579 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dce790-3dbc-4341-bc79-891e56f61e6c None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:16.168103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dce790-3dbc-4341-bc79-891e56f61e6c None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:16.168204 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dce790-3dbc-4341-bc79-891e56f61e6c None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:16.169501 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:16.174784 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fd244-e4d8-40a9-bfef-58a398ebc8b3 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:16.175204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fd244-e4d8-40a9-bfef-58a398ebc8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:16.175357 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fd244-e4d8-40a9-bfef-58a398ebc8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:16.192028 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-9a1fd244-e4d8-40a9-bfef-58a398ebc8b3 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:16.193236 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-9a1fd244-e4d8-40a9-bfef-58a398ebc8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:16.265702 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519faea-7759-44ed-8cdf-9bd87020790c None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:16.266000 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519faea-7759-44ed-8cdf-9bd87020790c None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:16.266324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519faea-7759-44ed-8cdf-9bd87020790c None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:16.267683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 6/11] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:03:16.272931 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed4dcc-8bc7-4301-99fd-a2e14db94ef0 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:16.273315 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed4dcc-8bc7-4301-99fd-a2e14db94ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:16.273686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed4dcc-8bc7-4301-99fd-a2e14db94ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:16.277139 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:16.299368 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1fd244-e4d8-40a9-bfef-58a398ebc8b3 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:16.315629 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG passlib.handlers.bcrypt [None req-08ed4dcc-8bc7-4301-99fd-a2e14db94ef0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80627) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 12 13:03:16.316057 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG passlib.handlers.bcrypt [None req-08ed4dcc-8bc7-4301-99fd-a2e14db94ef0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80627) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 12 13:03:16.324702 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:16.361904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-08ed4dcc-8bc7-4301-99fd-a2e14db94ef0 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:16.363565 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-08ed4dcc-8bc7-4301-99fd-a2e14db94ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:16.404533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1fd244-e4d8-40a9-bfef-58a398ebc8b3 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:16.438757 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95234c4d-9682-4c22-9059-950f7a2676bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:16.439486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95234c4d-9682-4c22-9059-950f7a2676bb None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:16.439772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95234c4d-9682-4c22-9059-950f7a2676bb None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:16.440060 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95234c4d-9682-4c22-9059-950f7a2676bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:16.452691 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95234c4d-9682-4c22-9059-950f7a2676bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:16.463998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-95234c4d-9682-4c22-9059-950f7a2676bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:03:16.463998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:16.463998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:16.463998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:16.463998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:16.463998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:16.463998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:16.463998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:16.463998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:16.463998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:16.463998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:16.463998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:16.463998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:16.463998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:16.463998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:16.463998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:16.465045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:16.465045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:16.465045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:16.465045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:16.465045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:16.465045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:16.465045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:16.465045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:16.465045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:16.465045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:16.465045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:16.465045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:16.465045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:16.465045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:16.465045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:16.465045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:16.466205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:16.466205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:16.466205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:16.466205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:16.466205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:16.466205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:16.466205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:16.466205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:16.466205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:16.466205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:16.466205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:03:16.466205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:03:16.466205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 7/13] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:03:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:03:16.471020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95234c4d-9682-4c22-9059-950f7a2676bb None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:16.473038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 7/14] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:03:16.495150 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed4dcc-8bc7-4301-99fd-a2e14db94ef0 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:16.552577 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:16.571047 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95234c4d-9682-4c22-9059-950f7a2676bb None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:16.596955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed4dcc-8bc7-4301-99fd-a2e14db94ef0 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:16.599307 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:16.605468 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27177267-5f57-4f27-92b7-870995019c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:16.606185 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27177267-5f57-4f27-92b7-870995019c85 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:16.606481 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27177267-5f57-4f27-92b7-870995019c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:16.606766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27177267-5f57-4f27-92b7-870995019c85 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:16.607562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27177267-5f57-4f27-92b7-870995019c85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:16.607851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27177267-5f57-4f27-92b7-870995019c85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:16.609335 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27177267-5f57-4f27-92b7-870995019c85 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:16.622968 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 8/15] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:03:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:16.628456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27177267-5f57-4f27-92b7-870995019c85 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:16.637294 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52257fc5-159d-428c-a6e0-866a654e2a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:16.638241 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52257fc5-159d-428c-a6e0-866a654e2a24 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:16.638535 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52257fc5-159d-428c-a6e0-866a654e2a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:16.638815 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52257fc5-159d-428c-a6e0-866a654e2a24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:16.715780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52257fc5-159d-428c-a6e0-866a654e2a24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:16.717328 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52257fc5-159d-428c-a6e0-866a654e2a24 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:16.733393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27177267-5f57-4f27-92b7-870995019c85 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:16.767520 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8b29f-2605-448f-8d39-deb0338ddfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:16.768473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8b29f-2605-448f-8d39-deb0338ddfb8 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:16.768776 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8b29f-2605-448f-8d39-deb0338ddfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:16.769082 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8b29f-2605-448f-8d39-deb0338ddfb8 None admin] PATH_INFO: `/v3/users/25d818b178534416a984336411a31d45` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:16.770315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8b29f-2605-448f-8d39-deb0338ddfb8 None admin] RBAC: Authorizing `identity:get_user(user_id=25d818b178534416a984336411a31d45)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:16.771782 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8b29f-2605-448f-8d39-deb0338ddfb8 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:16.773567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 9/16] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:16 2022] GET /identity/v3/users/25d818b178534416a984336411a31d45 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:16.778734 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8b29f-2605-448f-8d39-deb0338ddfb8 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:16.797681 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:16.829382 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 8/17] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:03:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 13:03:16.835136 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52257fc5-159d-428c-a6e0-866a654e2a24 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:16.837948 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:16.888800 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8b29f-2605-448f-8d39-deb0338ddfb8 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:16.922033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a679ff-f4d9-47f3-869e-c3a73bdc23d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:16.922881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a679ff-f4d9-47f3-869e-c3a73bdc23d9 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:16.923167 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a679ff-f4d9-47f3-869e-c3a73bdc23d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:16.923444 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a679ff-f4d9-47f3-869e-c3a73bdc23d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:16.924648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a679ff-f4d9-47f3-869e-c3a73bdc23d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:16.926149 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a679ff-f4d9-47f3-869e-c3a73bdc23d9 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:16.927768 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 10/18] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:03:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:16.933960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a679ff-f4d9-47f3-869e-c3a73bdc23d9 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:16.935228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52257fc5-159d-428c-a6e0-866a654e2a24 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:16.970540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e75982-d73b-44f0-9722-d733a9d7e29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:16.971260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e75982-d73b-44f0-9722-d733a9d7e29d None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:16.971543 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e75982-d73b-44f0-9722-d733a9d7e29d None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:16.971823 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e75982-d73b-44f0-9722-d733a9d7e29d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:16.991148 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e75982-d73b-44f0-9722-d733a9d7e29d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:16.992637 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e75982-d73b-44f0-9722-d733a9d7e29d None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:17.014133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-62e75982-d73b-44f0-9722-d733a9d7e29d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:03:17.014133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:17.014133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:17.014133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:17.014133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:17.014133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:17.014133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:17.014133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:17.014133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:17.014133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:17.014133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:17.014133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:17.014133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:03:17.014133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:03:17.014133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:03:17.015059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:03:17.015059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:17.015059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:17.015059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:17.015059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:17.015059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:17.015059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:17.015059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:17.015059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:17.015059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:17.015059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:17.015059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:17.015059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:17.015059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:17.015059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:17.015059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:17.015059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:17.016173 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:03:17.016173 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:03:17.016173 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:03:17.016173 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:03:17.016502 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:17.016640 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 9/19] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:03:17.021116 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e75982-d73b-44f0-9722-d733a9d7e29d None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:17.036643 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a679ff-f4d9-47f3-869e-c3a73bdc23d9 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:17.073215 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0932607-7d51-401c-87b9-31d86ccc1da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:17.073882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0932607-7d51-401c-87b9-31d86ccc1da9 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:17.074213 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0932607-7d51-401c-87b9-31d86ccc1da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:17.074496 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0932607-7d51-401c-87b9-31d86ccc1da9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:17.075338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0932607-7d51-401c-87b9-31d86ccc1da9 None admin] RBAC: Adding query filter params (role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0, scope.domain.id=default, user.id=25d818b178534416a984336411a31d45) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:17.075650 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0932607-7d51-401c-87b9-31d86ccc1da9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:17.077106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0932607-7d51-401c-87b9-31d86ccc1da9 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:17.081656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:17.084638 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 11/20] 10.222.0.17 () {56 vars in 1322 bytes} [Tue Jul 12 13:03:16 2022] GET /identity/v3/role_assignments?user.id=25d818b178534416a984336411a31d45&scope.domain.id=default&role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:17.131229 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e75982-d73b-44f0-9722-d733a9d7e29d None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:17.168933 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e5721-afcf-4b1f-b346-023b370a43fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:17.169613 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e5721-afcf-4b1f-b346-023b370a43fb None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:17.169897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e5721-afcf-4b1f-b346-023b370a43fb None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:17.170210 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e5721-afcf-4b1f-b346-023b370a43fb None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:17.170958 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e5721-afcf-4b1f-b346-023b370a43fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:17.171270 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e5721-afcf-4b1f-b346-023b370a43fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:17.172713 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e5721-afcf-4b1f-b346-023b370a43fb None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:17.192161 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 10/21] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:19.398965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae9d05-d915-4959-8942-eec06ef20e48 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:19.400053 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae9d05-d915-4959-8942-eec06ef20e48 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:19.400547 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae9d05-d915-4959-8942-eec06ef20e48 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:19.402182 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 12/22] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:19.407949 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc23f7d-14ab-462a-908a-c51ad46caa5e None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:19.408860 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc23f7d-14ab-462a-908a-c51ad46caa5e None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:19.409357 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc23f7d-14ab-462a-908a-c51ad46caa5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:19.439235 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-4fc23f7d-14ab-462a-908a-c51ad46caa5e None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:19.440819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-4fc23f7d-14ab-462a-908a-c51ad46caa5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:19.531202 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 11/23] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:19.566471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae9d05-d915-4959-8942-eec06ef20e48 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:19.711053 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae9d05-d915-4959-8942-eec06ef20e48 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:19.763764 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b53644-2106-4a6b-b9a0-d10513edbd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:19.764951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b53644-2106-4a6b-b9a0-d10513edbd94 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:19.765460 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b53644-2106-4a6b-b9a0-d10513edbd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:19.765931 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b53644-2106-4a6b-b9a0-d10513edbd94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:19.781340 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b53644-2106-4a6b-b9a0-d10513edbd94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:19.789553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-34b53644-2106-4a6b-b9a0-d10513edbd94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:03:19.789553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:19.789553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:19.789553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:19.789553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:19.789553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:19.789553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:19.789553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:19.789553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:19.789553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:19.789553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:19.789553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:19.789553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:19.789553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:19.789553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:19.789553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:19.790960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:19.790960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:19.790960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:19.790960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:19.790960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:19.790960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:19.790960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:19.790960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:19.790960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:19.790960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:19.790960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:19.790960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:19.790960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:19.790960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:19.790960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:19.790960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:19.791783 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:19.791783 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:19.791783 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:19.791783 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:19.791783 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:19.791783 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:19.791783 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:19.791783 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:19.791783 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:19.791783 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:19.791783 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:03:19.791783 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:03:19.794159 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 13/24] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:03:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:03:19.800234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc23f7d-14ab-462a-908a-c51ad46caa5e None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:19.862876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e09cc-fd11-4cc7-8307-827183e2d64c None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:19.863518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e09cc-fd11-4cc7-8307-827183e2d64c None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:19.863773 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:19.864237 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e09cc-fd11-4cc7-8307-827183e2d64c None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:19.871522 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 14/25] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:19 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:19.877285 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc167ee-9b5e-47fb-9801-39322699eb7a None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:19.877881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc167ee-9b5e-47fb-9801-39322699eb7a None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:19.878384 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc167ee-9b5e-47fb-9801-39322699eb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:19.902487 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:19.930173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-9dc167ee-9b5e-47fb-9801-39322699eb7a None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:19.932275 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-9dc167ee-9b5e-47fb-9801-39322699eb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:19.956068 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc23f7d-14ab-462a-908a-c51ad46caa5e None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:20.006906 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a78cf0-88c9-4228-a4b8-fafac7645c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:20.008022 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a78cf0-88c9-4228-a4b8-fafac7645c33 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:20.008514 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a78cf0-88c9-4228-a4b8-fafac7645c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:20.008997 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a78cf0-88c9-4228-a4b8-fafac7645c33 None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:20.010056 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a78cf0-88c9-4228-a4b8-fafac7645c33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:20.010600 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a78cf0-88c9-4228-a4b8-fafac7645c33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:20.012475 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a78cf0-88c9-4228-a4b8-fafac7645c33 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:20.028879 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 12/26] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:03:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:20.030599 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93473950-5e00-4c84-8a73-e988cd6f40c9 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:20.031130 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93473950-5e00-4c84-8a73-e988cd6f40c9 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:20.031609 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93473950-5e00-4c84-8a73-e988cd6f40c9 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:20.033512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 13/27] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:20.034877 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a60fff-0d50-43a2-9baa-6b9f5dae3558 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:20.035375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a60fff-0d50-43a2-9baa-6b9f5dae3558 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:20.035909 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a60fff-0d50-43a2-9baa-6b9f5dae3558 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:20.037763 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 14/28] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:20.038714 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a60fff-0d50-43a2-9baa-6b9f5dae3558 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:20.065657 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 15/29] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:03:20.067711 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac5866-dacd-40ca-ad43-bfcf3f64f794 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:20.068020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac5866-dacd-40ca-ad43-bfcf3f64f794 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:20.068312 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac5866-dacd-40ca-ad43-bfcf3f64f794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:20.086965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-52ac5866-dacd-40ca-ad43-bfcf3f64f794 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:20.094212 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-52ac5866-dacd-40ca-ad43-bfcf3f64f794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:20.179340 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 16/30] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:20.180506 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3f97c-8fdd-415c-8672-f5d480082194 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:20.180748 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3f97c-8fdd-415c-8672-f5d480082194 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:20.181568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3f97c-8fdd-415c-8672-f5d480082194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:20.190831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a60fff-0d50-43a2-9baa-6b9f5dae3558 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:20.211202 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:20.215533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-94e3f97c-8fdd-415c-8672-f5d480082194 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:20.216791 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-94e3f97c-8fdd-415c-8672-f5d480082194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:20.244536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397ee8c-859e-4a2e-9cf3-573776d6813e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:20.245789 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397ee8c-859e-4a2e-9cf3-573776d6813e None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:20.246172 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397ee8c-859e-4a2e-9cf3-573776d6813e None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:20.246874 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397ee8c-859e-4a2e-9cf3-573776d6813e None admin] PATH_INFO: `/v3/users/25d818b178534416a984336411a31d45` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:20.248984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397ee8c-859e-4a2e-9cf3-573776d6813e None admin] RBAC: Authorizing `identity:get_user(user_id=25d818b178534416a984336411a31d45)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:20.251169 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397ee8c-859e-4a2e-9cf3-573776d6813e None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:20.252836 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 15/31] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:20 2022] GET /identity/v3/users/25d818b178534416a984336411a31d45 => generated 247 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:20.253610 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397ee8c-859e-4a2e-9cf3-573776d6813e None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:20.283998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:20.294788 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 17/32] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:20.295810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3f97c-8fdd-415c-8672-f5d480082194 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:20.379361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397ee8c-859e-4a2e-9cf3-573776d6813e None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:20.416970 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1acde-ffb1-4628-b8d4-cf84f64d7f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:20.417988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1acde-ffb1-4628-b8d4-cf84f64d7f40 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:20.418457 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1acde-ffb1-4628-b8d4-cf84f64d7f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:20.418809 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1acde-ffb1-4628-b8d4-cf84f64d7f40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:20.423949 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3f97c-8fdd-415c-8672-f5d480082194 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:20.434169 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1acde-ffb1-4628-b8d4-cf84f64d7f40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:20.435662 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1acde-ffb1-4628-b8d4-cf84f64d7f40 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:20.454549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-99a1acde-ffb1-4628-b8d4-cf84f64d7f40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:03:20.454549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:20.454549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:20.454549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:20.454549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:20.454549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:20.454549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:20.454549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:20.454549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:20.454549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:20.454549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:20.454549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:20.454549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:03:20.454549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:03:20.454549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:03:20.456392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:03:20.456392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:20.456392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:20.456392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:20.456392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:20.456392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:20.456392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:20.456392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:20.456392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:20.456392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:20.456392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:20.456392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:20.456392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:20.456392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:20.456392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:20.456392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:20.456392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:20.457653 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:03:20.457653 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:03:20.457653 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:03:20.457653 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:03:20.457653 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 16/33] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:03:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:03:20.457653 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1acde-ffb1-4628-b8d4-cf84f64d7f40 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:20.469203 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fee3ef-f9b1-4709-ae77-a02efb2475f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:20.470265 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fee3ef-f9b1-4709-ae77-a02efb2475f1 None admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:20.470752 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fee3ef-f9b1-4709-ae77-a02efb2475f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:20.471208 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fee3ef-f9b1-4709-ae77-a02efb2475f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:20.472153 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fee3ef-f9b1-4709-ae77-a02efb2475f1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:20.473768 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fee3ef-f9b1-4709-ae77-a02efb2475f1 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:20.490394 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:20.573444 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1acde-ffb1-4628-b8d4-cf84f64d7f40 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:20.610448 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974aa11f-7b7d-48d0-b30c-436c12af50ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:20.611320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974aa11f-7b7d-48d0-b30c-436c12af50ba None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:20.611612 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974aa11f-7b7d-48d0-b30c-436c12af50ba None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:20.611892 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974aa11f-7b7d-48d0-b30c-436c12af50ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:20.612487 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 18/34] 10.222.0.17 () {60 vars in 1131 bytes} [Tue Jul 12 13:03:20 2022] POST /identity/v3/roles => generated 225 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:03:20.613369 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974aa11f-7b7d-48d0-b30c-436c12af50ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:20.614012 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fee3ef-f9b1-4709-ae77-a02efb2475f1 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:20.614900 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974aa11f-7b7d-48d0-b30c-436c12af50ba None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:20.621448 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 17/35] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:03:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:20.621448 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974aa11f-7b7d-48d0-b30c-436c12af50ba None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:20.689494 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:20.750160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974aa11f-7b7d-48d0-b30c-436c12af50ba None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:20.750160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:20.790100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e703672-1d1c-4334-b511-657734555816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:20.791431 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e703672-1d1c-4334-b511-657734555816 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:20.792342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e703672-1d1c-4334-b511-657734555816 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:20.792635 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e703672-1d1c-4334-b511-657734555816 None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:20.793404 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e703672-1d1c-4334-b511-657734555816 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:20.793753 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e703672-1d1c-4334-b511-657734555816 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:20.795502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e703672-1d1c-4334-b511-657734555816 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:20.809728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 18/36] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:20.810371 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e703672-1d1c-4334-b511-657734555816 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:20.819510 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fee3ef-f9b1-4709-ae77-a02efb2475f1 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:20.872421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5397a-d941-4828-adb0-437231c15b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:20.873120 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5397a-d941-4828-adb0-437231c15b18 None admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:20.873417 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5397a-d941-4828-adb0-437231c15b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:20.873705 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5397a-d941-4828-adb0-437231c15b18 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:20.874520 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5397a-d941-4828-adb0-437231c15b18 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:20.876667 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5397a-d941-4828-adb0-437231c15b18 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:20.905772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 19/37] 10.222.0.17 () {60 vars in 1131 bytes} [Tue Jul 12 13:03:20 2022] POST /identity/v3/roles => generated 219 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:03:20.907962 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5397a-d941-4828-adb0-437231c15b18 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:20.942870 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e703672-1d1c-4334-b511-657734555816 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:20.985010 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8469d2d-bbdc-4b53-b19e-2852d4a9744c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:20.985931 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8469d2d-bbdc-4b53-b19e-2852d4a9744c None admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:20.986260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8469d2d-bbdc-4b53-b19e-2852d4a9744c None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:20.986546 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8469d2d-bbdc-4b53-b19e-2852d4a9744c None admin] PATH_INFO: `/v3/domains/default/users/25d818b178534416a984336411a31d45/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:20.988672 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8469d2d-bbdc-4b53-b19e-2852d4a9744c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=25d818b178534416a984336411a31d45, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:20.990200 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8469d2d-bbdc-4b53-b19e-2852d4a9744c None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:21.048870 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5397a-d941-4828-adb0-437231c15b18 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:21.071226 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:21.099543 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5e612-e355-455f-b12e-309d6a622e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:21.100303 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5e612-e355-455f-b12e-309d6a622e93 None admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:21.100603 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5e612-e355-455f-b12e-309d6a622e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:21.100893 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5e612-e355-455f-b12e-309d6a622e93 None admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:21.101634 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5e612-e355-455f-b12e-309d6a622e93 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:21.103511 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5e612-e355-455f-b12e-309d6a622e93 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:21.138058 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 19/38] 10.222.0.17 () {58 vars in 1361 bytes} [Tue Jul 12 13:03:20 2022] PUT /identity/v3/domains/default/users/25d818b178534416a984336411a31d45/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:03:21.256813 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 20/39] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Jul 12 13:03:20 2022] POST /identity/v3/projects => generated 301 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:03:21.279743 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89696fac-1adb-4bf4-a762-41b38d7559f0 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:21.280080 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89696fac-1adb-4bf4-a762-41b38d7559f0 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:21.280328 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89696fac-1adb-4bf4-a762-41b38d7559f0 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:21.285257 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 20/40] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:21.291566 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749eed8-3389-4021-ac1d-76d17b5e9c6a None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:21.291852 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749eed8-3389-4021-ac1d-76d17b5e9c6a None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:21.292147 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749eed8-3389-4021-ac1d-76d17b5e9c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:21.302088 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe95c3b-9bff-47a4-9a0c-e7b1db3d30e3 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:21.302438 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe95c3b-9bff-47a4-9a0c-e7b1db3d30e3 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:21.302781 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe95c3b-9bff-47a4-9a0c-e7b1db3d30e3 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:21.304511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 21/41] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:21.310689 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17435c05-bc7d-48fc-a06f-9eb2da4d015c None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:21.310984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17435c05-bc7d-48fc-a06f-9eb2da4d015c None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:21.311367 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17435c05-bc7d-48fc-a06f-9eb2da4d015c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:21.317958 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-e749eed8-3389-4021-ac1d-76d17b5e9c6a None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:21.319877 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-e749eed8-3389-4021-ac1d-76d17b5e9c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:21.334376 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-17435c05-bc7d-48fc-a06f-9eb2da4d015c None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:21.336047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-17435c05-bc7d-48fc-a06f-9eb2da4d015c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:21.352545 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:21.439666 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 21/42] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:21.452592 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 22/43] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:03:21.463670 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749eed8-3389-4021-ac1d-76d17b5e9c6a None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:21.476828 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17435c05-bc7d-48fc-a06f-9eb2da4d015c None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:21.574705 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:21.584177 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749eed8-3389-4021-ac1d-76d17b5e9c6a None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:21.601113 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17435c05-bc7d-48fc-a06f-9eb2da4d015c None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:21.625850 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cea63e-4014-439c-86a0-78025ae2bd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:21.626676 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cea63e-4014-439c-86a0-78025ae2bd17 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:21.626967 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cea63e-4014-439c-86a0-78025ae2bd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:21.627248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cea63e-4014-439c-86a0-78025ae2bd17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:21.628534 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cea63e-4014-439c-86a0-78025ae2bd17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:21.630139 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cea63e-4014-439c-86a0-78025ae2bd17 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:21.637183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 22/44] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:03:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:21.638778 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cea63e-4014-439c-86a0-78025ae2bd17 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:21.641613 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab3d7a-37a7-412e-a6fd-61756d9709dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:21.642357 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab3d7a-37a7-412e-a6fd-61756d9709dd None admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:21.642651 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab3d7a-37a7-412e-a6fd-61756d9709dd None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:21.642935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab3d7a-37a7-412e-a6fd-61756d9709dd None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:21.643718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab3d7a-37a7-412e-a6fd-61756d9709dd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:21.645261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab3d7a-37a7-412e-a6fd-61756d9709dd None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:21.662149 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 23/45] 10.222.0.17 () {60 vars in 1131 bytes} [Tue Jul 12 13:03:21 2022] POST /identity/v3/roles => generated 223 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:03:21.768296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cea63e-4014-439c-86a0-78025ae2bd17 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:21.806503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ee7f7-78d4-4b75-96e5-6d23dc9b099b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:21.807206 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ee7f7-78d4-4b75-96e5-6d23dc9b099b None admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:21.807502 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ee7f7-78d4-4b75-96e5-6d23dc9b099b None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:21.807790 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ee7f7-78d4-4b75-96e5-6d23dc9b099b None admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:21.808537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ee7f7-78d4-4b75-96e5-6d23dc9b099b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:21.810058 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ee7f7-78d4-4b75-96e5-6d23dc9b099b None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:21.840031 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 23/46] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Jul 12 13:03:21 2022] POST /identity/v3/projects => generated 312 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:03:23.345556 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c066a10-051d-445b-b8e9-3f72a2060022 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:23.346077 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c066a10-051d-445b-b8e9-3f72a2060022 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:23.346189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c066a10-051d-445b-b8e9-3f72a2060022 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:23.347522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 24/47] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:23.353699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2589da5-ac2b-4be3-88a5-64ef2dfd89a5 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:23.354210 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2589da5-ac2b-4be3-88a5-64ef2dfd89a5 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:23.354668 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2589da5-ac2b-4be3-88a5-64ef2dfd89a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:23.374349 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-b2589da5-ac2b-4be3-88a5-64ef2dfd89a5 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:23.375582 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-b2589da5-ac2b-4be3-88a5-64ef2dfd89a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:23.387440 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:23.445637 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 24/48] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:23.469001 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c066a10-051d-445b-b8e9-3f72a2060022 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:23.479827 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:23.581198 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c066a10-051d-445b-b8e9-3f72a2060022 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:23.722047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55620181-26ec-4768-b2ee-a2ebbfd826b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:23.722885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55620181-26ec-4768-b2ee-a2ebbfd826b9 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:23.723175 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55620181-26ec-4768-b2ee-a2ebbfd826b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:23.723453 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55620181-26ec-4768-b2ee-a2ebbfd826b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:23.735498 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55620181-26ec-4768-b2ee-a2ebbfd826b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:23.745060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-55620181-26ec-4768-b2ee-a2ebbfd826b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:03:23.745060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:23.745060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:23.745060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:23.745060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:23.745060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:23.745060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:23.745060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:23.745060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:23.745060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:23.745060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:23.745060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:23.745060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:23.745060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:23.745060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:23.745060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:23.745996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:23.745996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:23.745996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:23.745996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:23.745996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:23.745996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:23.745996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:23.745996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:23.745996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:23.745996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:23.745996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:23.745996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:23.745996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:23.745996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:23.745996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:23.745996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:23.747097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:23.747097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:23.747097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:23.747097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:23.747097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:23.747097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:23.747097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:23.747097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:23.747097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:23.747097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:23.747097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:03:23.747097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:03:23.747097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 25/49] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:03:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:03:23.752348 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2589da5-ac2b-4be3-88a5-64ef2dfd89a5 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:23.852160 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2589da5-ac2b-4be3-88a5-64ef2dfd89a5 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:23.886564 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38162c4a-e201-4be1-b027-7726e9236291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:23.887258 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38162c4a-e201-4be1-b027-7726e9236291 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:23.887547 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38162c4a-e201-4be1-b027-7726e9236291 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:23.887828 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38162c4a-e201-4be1-b027-7726e9236291 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:23.888599 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38162c4a-e201-4be1-b027-7726e9236291 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:23.888911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38162c4a-e201-4be1-b027-7726e9236291 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:23.890362 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38162c4a-e201-4be1-b027-7726e9236291 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:23.892236 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092d41f-049c-4b1e-b749-8c510c2fc3e5 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:23.892623 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092d41f-049c-4b1e-b749-8c510c2fc3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:23.892982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092d41f-049c-4b1e-b749-8c510c2fc3e5 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:23.894552 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 26/50] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:03:23.900232 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 25/51] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:03:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:23.900489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7aff9-9dc8-4d5d-8ed4-3b93177a3a31 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:23.900786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7aff9-9dc8-4d5d-8ed4-3b93177a3a31 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:23.901069 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7aff9-9dc8-4d5d-8ed4-3b93177a3a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:23.905708 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38162c4a-e201-4be1-b027-7726e9236291 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:23.919358 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:23.919599 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-5ab7aff9-9dc8-4d5d-8ed4-3b93177a3a31 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:23.920856 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-5ab7aff9-9dc8-4d5d-8ed4-3b93177a3a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:23.981959 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:23.990222 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 27/52] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:03:24.010076 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38162c4a-e201-4be1-b027-7726e9236291 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:24.012838 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7aff9-9dc8-4d5d-8ed4-3b93177a3a31 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:24.046139 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809b83b-8bdc-4d2a-aeae-aca81edc438f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:24.047047 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809b83b-8bdc-4d2a-aeae-aca81edc438f None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:24.047337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809b83b-8bdc-4d2a-aeae-aca81edc438f None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:24.047619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809b83b-8bdc-4d2a-aeae-aca81edc438f None admin] PATH_INFO: `/v3/users/25d818b178534416a984336411a31d45` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:24.048848 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809b83b-8bdc-4d2a-aeae-aca81edc438f None admin] RBAC: Authorizing `identity:get_user(user_id=25d818b178534416a984336411a31d45)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:24.050349 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809b83b-8bdc-4d2a-aeae-aca81edc438f None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:24.051990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:23 2022] GET /identity/v3/users/25d818b178534416a984336411a31d45 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:24.057873 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809b83b-8bdc-4d2a-aeae-aca81edc438f None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:24.113527 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7aff9-9dc8-4d5d-8ed4-3b93177a3a31 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:24.137547 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:24.150505 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df756234-ba50-4980-965c-bcab3a32bf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:24.151327 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df756234-ba50-4980-965c-bcab3a32bf7e None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:24.151615 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df756234-ba50-4980-965c-bcab3a32bf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:24.151907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df756234-ba50-4980-965c-bcab3a32bf7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:24.153117 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df756234-ba50-4980-965c-bcab3a32bf7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:24.154651 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df756234-ba50-4980-965c-bcab3a32bf7e None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:24.156314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 28/54] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:03:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:24.161743 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809b83b-8bdc-4d2a-aeae-aca81edc438f None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:24.161898 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df756234-ba50-4980-965c-bcab3a32bf7e None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:24.195814 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bf28b-81bc-47b7-8384-770abb883be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:24.197130 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bf28b-81bc-47b7-8384-770abb883be0 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:24.197420 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bf28b-81bc-47b7-8384-770abb883be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:24.197703 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bf28b-81bc-47b7-8384-770abb883be0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:24.198913 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bf28b-81bc-47b7-8384-770abb883be0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:24.200365 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bf28b-81bc-47b7-8384-770abb883be0 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:24.201988 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:03:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:24.207659 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bf28b-81bc-47b7-8384-770abb883be0 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:24.225219 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:24.264049 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df756234-ba50-4980-965c-bcab3a32bf7e None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:24.298751 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01279bd-0c8f-4495-95b4-1510ecb01002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:24.299432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01279bd-0c8f-4495-95b4-1510ecb01002 None admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:24.299727 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01279bd-0c8f-4495-95b4-1510ecb01002 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:24.300012 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01279bd-0c8f-4495-95b4-1510ecb01002 None admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:24.300743 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01279bd-0c8f-4495-95b4-1510ecb01002 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:24.302238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01279bd-0c8f-4495-95b4-1510ecb01002 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:24.307812 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bf28b-81bc-47b7-8384-770abb883be0 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:24.330094 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 29/56] 10.222.0.17 () {60 vars in 1140 bytes} [Tue Jul 12 13:03:24 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:03:24.343162 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbd5b4-c7c8-4c35-9f80-7dffb272d773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:24.343855 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbd5b4-c7c8-4c35-9f80-7dffb272d773 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:24.344142 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbd5b4-c7c8-4c35-9f80-7dffb272d773 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:24.344422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbd5b4-c7c8-4c35-9f80-7dffb272d773 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:24.345288 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbd5b4-c7c8-4c35-9f80-7dffb272d773 None admin] RBAC: Adding query filter params (role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0, scope.domain.id=default, user.id=25d818b178534416a984336411a31d45) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:24.345608 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbd5b4-c7c8-4c35-9f80-7dffb272d773 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:24.347179 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbd5b4-c7c8-4c35-9f80-7dffb272d773 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:24.354342 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1322 bytes} [Tue Jul 12 13:03:24 2022] GET /identity/v3/role_assignments?user.id=25d818b178534416a984336411a31d45&scope.domain.id=default&role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:26.475089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5e515-7d90-4aa7-be3d-780d889cea01 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:26.475613 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5e515-7d90-4aa7-be3d-780d889cea01 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:26.475721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5e515-7d90-4aa7-be3d-780d889cea01 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:26.477055 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 30/58] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:26.482751 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d12905-b356-417a-a6e8-cbec5ca69215 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:26.483159 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d12905-b356-417a-a6e8-cbec5ca69215 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:26.483326 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d12905-b356-417a-a6e8-cbec5ca69215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:26.500428 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-29d12905-b356-417a-a6e8-cbec5ca69215 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:26.501614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-29d12905-b356-417a-a6e8-cbec5ca69215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:26.503566 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:26.567142 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 29/59] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:26.590784 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5e515-7d90-4aa7-be3d-780d889cea01 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:26.693295 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5e515-7d90-4aa7-be3d-780d889cea01 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:26.718542 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:26.737236 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f39be-76c7-4444-b22e-d5d09fc08be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:26.737981 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f39be-76c7-4444-b22e-d5d09fc08be0 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:26.738347 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f39be-76c7-4444-b22e-d5d09fc08be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:26.738635 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f39be-76c7-4444-b22e-d5d09fc08be0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:26.739818 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f39be-76c7-4444-b22e-d5d09fc08be0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:26.741295 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f39be-76c7-4444-b22e-d5d09fc08be0 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:26.742947 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 31/60] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:03:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:26.748895 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d12905-b356-417a-a6e8-cbec5ca69215 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:26.847827 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d12905-b356-417a-a6e8-cbec5ca69215 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:26.881314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37160e6-d10a-41c0-9816-43416599b848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:26.882033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37160e6-d10a-41c0-9816-43416599b848 None admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:26.882351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37160e6-d10a-41c0-9816-43416599b848 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:26.882635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37160e6-d10a-41c0-9816-43416599b848 None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:26.883399 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37160e6-d10a-41c0-9816-43416599b848 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:26.884960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37160e6-d10a-41c0-9816-43416599b848 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:26.898241 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:26.912992 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 30/61] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Jul 12 13:03:26 2022] POST /identity/v3/users => generated 275 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:03:30.168157 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30786b50-fb58-4518-823f-796d2c293102 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:30.168674 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30786b50-fb58-4518-823f-796d2c293102 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:30.168751 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30786b50-fb58-4518-823f-796d2c293102 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:30.170082 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 32/62] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:30.187756 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef4c3a-0854-44d1-bf6f-1d0bd9bdcd8b None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:30.188249 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef4c3a-0854-44d1-bf6f-1d0bd9bdcd8b None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:30.188465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef4c3a-0854-44d1-bf6f-1d0bd9bdcd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:30.196079 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9d724-27e6-49e9-b1dd-98288ac34d67 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:30.196404 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9d724-27e6-49e9-b1dd-98288ac34d67 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:30.196736 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9d724-27e6-49e9-b1dd-98288ac34d67 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:30.198801 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 33/63] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:30.204097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da651b-d3f1-4e92-9090-493eeb89cf41 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:30.204416 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da651b-d3f1-4e92-9090-493eeb89cf41 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:30.204739 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da651b-d3f1-4e92-9090-493eeb89cf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:30.208927 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-a1ef4c3a-0854-44d1-bf6f-1d0bd9bdcd8b None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:30.210351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a1ef4c3a-0854-44d1-bf6f-1d0bd9bdcd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:30.230333 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-91da651b-d3f1-4e92-9090-493eeb89cf41 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:30.233303 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-91da651b-d3f1-4e92-9090-493eeb89cf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:30.330393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 31/64] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:30.359957 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 34/65] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:03:30.367835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef4c3a-0854-44d1-bf6f-1d0bd9bdcd8b None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:30.398981 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da651b-d3f1-4e92-9090-493eeb89cf41 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:30.538514 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef4c3a-0854-44d1-bf6f-1d0bd9bdcd8b None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:30.564882 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da651b-d3f1-4e92-9090-493eeb89cf41 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:30.568945 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:30.581054 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:30.583265 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d8d9b-2a26-4227-a20a-4c3b502a1135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:30.584086 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d8d9b-2a26-4227-a20a-4c3b502a1135 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:30.584369 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d8d9b-2a26-4227-a20a-4c3b502a1135 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:30.584809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d8d9b-2a26-4227-a20a-4c3b502a1135 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:30.595711 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d8d9b-2a26-4227-a20a-4c3b502a1135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:30.602244 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0f109-8b9f-4486-8271-fe8908f96292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:30.603207 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0f109-8b9f-4486-8271-fe8908f96292 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:30.603657 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0f109-8b9f-4486-8271-fe8908f96292 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:30.603909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-1a7d8d9b-2a26-4227-a20a-4c3b502a1135 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:03:30.603909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:30.603909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:30.603909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:30.603909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:30.603909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:30.603909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:30.603909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:30.603909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:30.603909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:30.603909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:30.603909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:30.603909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:30.603909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:30.603909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:30.603909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:30.604770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:30.604770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:30.604770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:30.604770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:30.604770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:30.604770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:30.604770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:30.604770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:30.604770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:30.604770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:30.604770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:30.604770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:30.604770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:30.604770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:30.604770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:30.604770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:30.605635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:30.605635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:30.605635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:30.605635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:30.605635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:30.605635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:30.605635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:30.605635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:30.605635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:30.605635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:30.605635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:03:30.605635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:03:30.605635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 32/66] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:03:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:03:30.606715 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d913e5e-cf53-4db1-a7ba-ca14ee34eedc None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:30.606715 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d913e5e-cf53-4db1-a7ba-ca14ee34eedc None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:30.606997 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d913e5e-cf53-4db1-a7ba-ca14ee34eedc None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:30.607348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0f109-8b9f-4486-8271-fe8908f96292 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:30.608456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 33/67] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:30.611603 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e863e43-cb48-43a3-b8fe-e9dc05d57ff7 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:30.611901 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e863e43-cb48-43a3-b8fe-e9dc05d57ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:30.612186 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e863e43-cb48-43a3-b8fe-e9dc05d57ff7 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:30.613838 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 34/68] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:30.617774 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e863e43-cb48-43a3-b8fe-e9dc05d57ff7 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:30.623873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a0f109-8b9f-4486-8271-fe8908f96292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:30.631711 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-18a0f109-8b9f-4486-8271-fe8908f96292 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:03:30.631711 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:30.631711 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:30.631711 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:30.631711 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:30.631711 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:30.631711 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:30.631711 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:30.631711 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:30.631711 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:30.631711 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:30.631711 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:30.631711 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:30.631711 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:30.631711 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:30.631711 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:30.632720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:30.632720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:30.632720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:30.632720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:30.632720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:30.632720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:30.632720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:30.632720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:30.632720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:30.632720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:30.632720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:30.632720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:30.632720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:30.632720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:30.632720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:30.632720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:30.633528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:30.633528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:30.633528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:30.633528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:30.633528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:30.633528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:30.633528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:30.633528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:30.633528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:30.633528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:30.633528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:03:30.633528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:03:30.633528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 35/69] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:03:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:03:30.634195 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db335432-c1f2-4472-80aa-de038744af80 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:30.634504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db335432-c1f2-4472-80aa-de038744af80 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:30.634716 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db335432-c1f2-4472-80aa-de038744af80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:30.651927 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-db335432-c1f2-4472-80aa-de038744af80 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:30.653128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-db335432-c1f2-4472-80aa-de038744af80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:30.727881 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 36/70] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:30.729231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac2e73-80ae-49f0-85d6-059fc962c7c7 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:30.729520 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac2e73-80ae-49f0-85d6-059fc962c7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:30.729804 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac2e73-80ae-49f0-85d6-059fc962c7c7 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:30.731125 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 37/71] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:30.732153 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736342f2-aaf5-48be-9b99-25caab3cea20 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:30.732437 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736342f2-aaf5-48be-9b99-25caab3cea20 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:30.732716 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736342f2-aaf5-48be-9b99-25caab3cea20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:30.739302 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e863e43-cb48-43a3-b8fe-e9dc05d57ff7 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:30.754976 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-736342f2-aaf5-48be-9b99-25caab3cea20 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:30.756249 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-736342f2-aaf5-48be-9b99-25caab3cea20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:30.776847 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf5cef-8fea-4b53-9716-e473f2ce6dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:30.777535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf5cef-8fea-4b53-9716-e473f2ce6dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:30.777828 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf5cef-8fea-4b53-9716-e473f2ce6dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:30.778140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf5cef-8fea-4b53-9716-e473f2ce6dd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:30.778896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf5cef-8fea-4b53-9716-e473f2ce6dd9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:30.779213 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf5cef-8fea-4b53-9716-e473f2ce6dd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:30.780627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf5cef-8fea-4b53-9716-e473f2ce6dd9 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:30.788622 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 35/72] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:03:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:30.789377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf5cef-8fea-4b53-9716-e473f2ce6dd9 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:30.826048 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 38/73] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:30.827350 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969878b-51c2-4410-b12b-58616801c357 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:30.827644 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969878b-51c2-4410-b12b-58616801c357 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:30.827927 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969878b-51c2-4410-b12b-58616801c357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:30.836341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:30.848206 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-8969878b-51c2-4410-b12b-58616801c357 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:30.849880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-8969878b-51c2-4410-b12b-58616801c357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:30.878913 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:30.891109 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf5cef-8fea-4b53-9716-e473f2ce6dd9 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:30.920729 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 39/74] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:30.921548 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969878b-51c2-4410-b12b-58616801c357 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:30.926061 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509a86e-aa1a-4716-a5e8-4545eabdb6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:30.926815 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509a86e-aa1a-4716-a5e8-4545eabdb6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:30.927108 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509a86e-aa1a-4716-a5e8-4545eabdb6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:30.927394 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509a86e-aa1a-4716-a5e8-4545eabdb6a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:30.928146 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509a86e-aa1a-4716-a5e8-4545eabdb6a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:30.928467 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509a86e-aa1a-4716-a5e8-4545eabdb6a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:30.929876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509a86e-aa1a-4716-a5e8-4545eabdb6a1 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:30.939133 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 36/75] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:03:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:30.939929 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509a86e-aa1a-4716-a5e8-4545eabdb6a1 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:31.042971 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969878b-51c2-4410-b12b-58616801c357 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:31.046247 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509a86e-aa1a-4716-a5e8-4545eabdb6a1 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:31.057855 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:31.077102 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfe777-336d-48fa-82c3-b47143fbcfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:31.077920 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfe777-336d-48fa-82c3-b47143fbcfe6 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:31.078232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfe777-336d-48fa-82c3-b47143fbcfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:31.078510 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfe777-336d-48fa-82c3-b47143fbcfe6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:31.084556 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04d776-fad2-4c87-afd8-ec3a0ed75cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:31.085520 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04d776-fad2-4c87-afd8-ec3a0ed75cbe None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:31.085850 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04d776-fad2-4c87-afd8-ec3a0ed75cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:31.086202 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04d776-fad2-4c87-afd8-ec3a0ed75cbe None admin] PATH_INFO: `/v3/users/83d847fc6deb46e7aec5aa75d815215c` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:31.088955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfe777-336d-48fa-82c3-b47143fbcfe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:31.096968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-ffbfe777-336d-48fa-82c3-b47143fbcfe6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:03:31.096968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:31.096968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:31.096968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:31.096968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:31.096968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:31.096968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:31.096968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:31.096968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:31.096968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:31.096968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:31.096968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:31.096968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:31.096968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:31.096968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:31.096968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:31.098075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:31.098075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:31.098075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:31.098075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:31.098075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:31.098075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:31.098075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:31.098075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:31.098075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:31.098075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:31.098075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:31.098075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:31.098075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:31.098075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:31.098075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:31.098075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:31.099038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:31.099038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:31.099038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:31.099038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:31.099038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:31.099038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:31.099038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:31.099038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:31.099038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:31.099038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:31.099038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:03:31.099038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:03:31.099038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 40/76] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Jul 12 13:03:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:03:31.099038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfe777-336d-48fa-82c3-b47143fbcfe6 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:31.105230 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04d776-fad2-4c87-afd8-ec3a0ed75cbe None admin] RBAC: Authorizing `identity:get_user(user_id=83d847fc6deb46e7aec5aa75d815215c)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:31.106905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04d776-fad2-4c87-afd8-ec3a0ed75cbe None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:31.108783 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 37/77] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:30 2022] GET /identity/v3/users/83d847fc6deb46e7aec5aa75d815215c => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:31.110479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04d776-fad2-4c87-afd8-ec3a0ed75cbe None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:31.125989 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:31.202843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfe777-336d-48fa-82c3-b47143fbcfe6 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:31.213805 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04d776-fad2-4c87-afd8-ec3a0ed75cbe None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:31.236359 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613c4a7-e6a7-48e7-abe1-2449bf180f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:31.237160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613c4a7-e6a7-48e7-abe1-2449bf180f0d None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:31.237449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613c4a7-e6a7-48e7-abe1-2449bf180f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:31.237728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613c4a7-e6a7-48e7-abe1-2449bf180f0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:31.238939 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613c4a7-e6a7-48e7-abe1-2449bf180f0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:31.240407 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613c4a7-e6a7-48e7-abe1-2449bf180f0d None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:31.242193 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 41/78] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:03:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:31.242789 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613c4a7-e6a7-48e7-abe1-2449bf180f0d None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:31.251012 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b8a28-4b53-478d-b7ac-7a607aae6630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:31.251951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b8a28-4b53-478d-b7ac-7a607aae6630 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:31.252283 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b8a28-4b53-478d-b7ac-7a607aae6630 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:31.252565 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b8a28-4b53-478d-b7ac-7a607aae6630 None admin] PATH_INFO: `/v3/users/25d818b178534416a984336411a31d45` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:31.253801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b8a28-4b53-478d-b7ac-7a607aae6630 None admin] RBAC: Authorizing `identity:get_user(user_id=25d818b178534416a984336411a31d45)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:31.255333 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b8a28-4b53-478d-b7ac-7a607aae6630 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:31.257003 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 38/79] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:31 2022] GET /identity/v3/users/25d818b178534416a984336411a31d45 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:31.257800 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b8a28-4b53-478d-b7ac-7a607aae6630 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:31.293965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:31.335219 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:31.346527 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613c4a7-e6a7-48e7-abe1-2449bf180f0d None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:31.361584 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b8a28-4b53-478d-b7ac-7a607aae6630 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:31.380872 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de329a1-48d7-4b94-9e4f-7aac800594ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:31.381773 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de329a1-48d7-4b94-9e4f-7aac800594ce None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:31.382063 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de329a1-48d7-4b94-9e4f-7aac800594ce None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:31.382372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de329a1-48d7-4b94-9e4f-7aac800594ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:31.394730 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de329a1-48d7-4b94-9e4f-7aac800594ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:31.402536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-1de329a1-48d7-4b94-9e4f-7aac800594ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:03:31.402536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:31.402536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:31.402536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:31.402536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:31.402536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:31.402536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:31.402536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:31.402536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:31.402536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:31.402536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:31.402536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:31.402536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:31.402536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:31.402536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:31.402536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:31.403430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:31.403430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:31.403430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:31.403430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:31.403430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:31.403430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:31.403430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:31.403430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:31.403430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:31.403430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:31.403430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:31.403430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:31.403430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:31.403430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:31.403430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:31.403430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:31.404189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:31.404189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:31.404189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:31.404189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:31.404189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:31.404189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:31.404189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:31.404189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:31.404189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:31.404189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:31.404189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:03:31.404189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:03:31.404789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b3581-9349-49ef-b532-d1512409d16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:31.404887 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 42/80] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:03:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:03:31.404955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b3581-9349-49ef-b532-d1512409d16a None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:31.404955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b3581-9349-49ef-b532-d1512409d16a None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:31.404955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b3581-9349-49ef-b532-d1512409d16a None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:31.405670 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b3581-9349-49ef-b532-d1512409d16a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:31.405915 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b3581-9349-49ef-b532-d1512409d16a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:31.407039 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de329a1-48d7-4b94-9e4f-7aac800594ce None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:31.407341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b3581-9349-49ef-b532-d1512409d16a None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:31.415886 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 39/81] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:03:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:31.416751 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b3581-9349-49ef-b532-d1512409d16a None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:31.508011 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:31.511531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de329a1-48d7-4b94-9e4f-7aac800594ce None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:31.515107 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b3581-9349-49ef-b532-d1512409d16a None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:31.545179 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc360b-daa5-419d-a5f8-d8a7e540d73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:31.545808 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc360b-daa5-419d-a5f8-d8a7e540d73e None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:31.546099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc360b-daa5-419d-a5f8-d8a7e540d73e None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:31.546444 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc360b-daa5-419d-a5f8-d8a7e540d73e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:31.548599 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9777e2-29ce-4557-bf00-610b441fb0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:31.549279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9777e2-29ce-4557-bf00-610b441fb0b4 None admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:31.549574 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9777e2-29ce-4557-bf00-610b441fb0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:31.549872 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9777e2-29ce-4557-bf00-610b441fb0b4 None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:31.550631 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9777e2-29ce-4557-bf00-610b441fb0b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:31.552088 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9777e2-29ce-4557-bf00-610b441fb0b4 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:31.569318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:31.578176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 40/82] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Jul 12 13:03:31 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:03:31.578176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9777e2-29ce-4557-bf00-610b441fb0b4 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:31.641448 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc360b-daa5-419d-a5f8-d8a7e540d73e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:31.643470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc360b-daa5-419d-a5f8-d8a7e540d73e None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:31.705636 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9777e2-29ce-4557-bf00-610b441fb0b4 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:31.746448 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be9c83-3bae-413f-a206-8d68500a474c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:31.747423 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be9c83-3bae-413f-a206-8d68500a474c None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:31.747726 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be9c83-3bae-413f-a206-8d68500a474c None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:31.748011 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be9c83-3bae-413f-a206-8d68500a474c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:31.773668 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:31.775702 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 43/83] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:03:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:03:31.776918 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc360b-daa5-419d-a5f8-d8a7e540d73e None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:31.842272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be9c83-3bae-413f-a206-8d68500a474c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:31.842832 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be9c83-3bae-413f-a206-8d68500a474c None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:31.862183 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:31.925563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc360b-daa5-419d-a5f8-d8a7e540d73e None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:31.956336 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 41/84] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:03:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:03:31.957267 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be9c83-3bae-413f-a206-8d68500a474c None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:31.968462 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1912df9-d112-4feb-b1fa-fe734c6eb89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:31.969255 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1912df9-d112-4feb-b1fa-fe734c6eb89f None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:31.969549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1912df9-d112-4feb-b1fa-fe734c6eb89f None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:31.969833 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1912df9-d112-4feb-b1fa-fe734c6eb89f None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:31.970780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1912df9-d112-4feb-b1fa-fe734c6eb89f None admin] RBAC: Adding query filter params (name=member) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:31.971100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1912df9-d112-4feb-b1fa-fe734c6eb89f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:31.972554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1912df9-d112-4feb-b1fa-fe734c6eb89f None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:31.982222 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 44/85] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:03:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:31.983152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1912df9-d112-4feb-b1fa-fe734c6eb89f None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:32.016745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:32.068105 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be9c83-3bae-413f-a206-8d68500a474c None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:32.103578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1912df9-d112-4feb-b1fa-fe734c6eb89f None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:32.105821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8676b-2395-42ed-9400-4d96556e28e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:32.107000 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8676b-2395-42ed-9400-4d96556e28e5 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:32.107467 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8676b-2395-42ed-9400-4d96556e28e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:32.107929 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8676b-2395-42ed-9400-4d96556e28e5 None admin] PATH_INFO: `/v3/users/83d847fc6deb46e7aec5aa75d815215c` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:32.109444 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8676b-2395-42ed-9400-4d96556e28e5 None admin] RBAC: Authorizing `identity:get_user(user_id=83d847fc6deb46e7aec5aa75d815215c)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:32.111198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8676b-2395-42ed-9400-4d96556e28e5 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:32.113116 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 42/86] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:31 2022] GET /identity/v3/users/83d847fc6deb46e7aec5aa75d815215c => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:32.118585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8676b-2395-42ed-9400-4d96556e28e5 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:32.121154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:32.145591 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109895ca-1e0b-4210-8e64-2a740150b9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:32.146623 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109895ca-1e0b-4210-8e64-2a740150b9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:32.146920 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109895ca-1e0b-4210-8e64-2a740150b9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:32.147207 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109895ca-1e0b-4210-8e64-2a740150b9e0 None admin] PATH_INFO: `/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:32.148741 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109895ca-1e0b-4210-8e64-2a740150b9e0 None admin] RBAC: Authorizing `identity:get_project(project_id=3afe0ad2d6234e83b0fd6f35ed37e7c9)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:32.150944 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109895ca-1e0b-4210-8e64-2a740150b9e0 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:32.153296 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 45/87] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:03:31 2022] GET /identity/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:32.154323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109895ca-1e0b-4210-8e64-2a740150b9e0 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:32.235732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8676b-2395-42ed-9400-4d96556e28e5 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:32.258897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:32.276903 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30026059-92ab-4ed7-8744-e51e21b13538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:32.277946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30026059-92ab-4ed7-8744-e51e21b13538 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:32.278300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30026059-92ab-4ed7-8744-e51e21b13538 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:32.278582 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30026059-92ab-4ed7-8744-e51e21b13538 None admin] PATH_INFO: `/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:32.279957 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30026059-92ab-4ed7-8744-e51e21b13538 None admin] RBAC: Authorizing `identity:get_project(project_id=3afe0ad2d6234e83b0fd6f35ed37e7c9)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:32.281479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30026059-92ab-4ed7-8744-e51e21b13538 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:32.283440 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 43/88] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:03:32 2022] GET /identity/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:32.284206 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30026059-92ab-4ed7-8744-e51e21b13538 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:32.286665 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109895ca-1e0b-4210-8e64-2a740150b9e0 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:32.336765 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e56c3-2775-4507-9d48-0a1aa0349dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:32.337971 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e56c3-2775-4507-9d48-0a1aa0349dbf None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:32.338850 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e56c3-2775-4507-9d48-0a1aa0349dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:32.339315 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e56c3-2775-4507-9d48-0a1aa0349dbf None admin] PATH_INFO: `/v3/users/83d847fc6deb46e7aec5aa75d815215c` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:32.341155 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e56c3-2775-4507-9d48-0a1aa0349dbf None admin] RBAC: Authorizing `identity:get_user(user_id=83d847fc6deb46e7aec5aa75d815215c)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:32.343516 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e56c3-2775-4507-9d48-0a1aa0349dbf None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:32.345627 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 46/89] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:32 2022] GET /identity/v3/users/83d847fc6deb46e7aec5aa75d815215c => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:32.347306 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e56c3-2775-4507-9d48-0a1aa0349dbf None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:32.405325 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:32.410727 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30026059-92ab-4ed7-8744-e51e21b13538 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:32.449162 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3e94a-3872-493e-a790-286a04f61f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:32.449947 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3e94a-3872-493e-a790-286a04f61f36 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:32.450338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3e94a-3872-493e-a790-286a04f61f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:32.450694 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3e94a-3872-493e-a790-286a04f61f36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:32.461663 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e56c3-2775-4507-9d48-0a1aa0349dbf None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:32.498446 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b2da2-e53f-4402-bf20-bfec26cc7d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:32.499122 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b2da2-e53f-4402-bf20-bfec26cc7d15 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:32.499417 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b2da2-e53f-4402-bf20-bfec26cc7d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:32.499699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b2da2-e53f-4402-bf20-bfec26cc7d15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:32.500535 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b2da2-e53f-4402-bf20-bfec26cc7d15 None admin] RBAC: Adding query filter params (role.id=1727bdbc17d94ff08782d404dce97d35, scope.project.id=3afe0ad2d6234e83b0fd6f35ed37e7c9, user.id=83d847fc6deb46e7aec5aa75d815215c) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:32.500853 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b2da2-e53f-4402-bf20-bfec26cc7d15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:32.502346 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b2da2-e53f-4402-bf20-bfec26cc7d15 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:32.510497 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 47/90] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:03:32 2022] GET /identity/v3/role_assignments?user.id=83d847fc6deb46e7aec5aa75d815215c&scope.project.id=3afe0ad2d6234e83b0fd6f35ed37e7c9&role.id=1727bdbc17d94ff08782d404dce97d35 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:32.511564 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b2da2-e53f-4402-bf20-bfec26cc7d15 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:32.516493 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:32.533104 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f3e94a-3872-493e-a790-286a04f61f36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:32.534703 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f3e94a-3872-493e-a790-286a04f61f36 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:32.650640 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 44/91] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:03:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:03:32.651555 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3e94a-3872-493e-a790-286a04f61f36 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:32.692122 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b2da2-e53f-4402-bf20-bfec26cc7d15 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:32.707694 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:32.731479 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116ed2b-2b18-4c76-8e8d-4a412beeda70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:32.732173 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116ed2b-2b18-4c76-8e8d-4a412beeda70 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:32.732465 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116ed2b-2b18-4c76-8e8d-4a412beeda70 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:32.732819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116ed2b-2b18-4c76-8e8d-4a412beeda70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:32.733672 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116ed2b-2b18-4c76-8e8d-4a412beeda70 None admin] RBAC: Adding query filter params (role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0, scope.project.id=3afe0ad2d6234e83b0fd6f35ed37e7c9, user.id=25d818b178534416a984336411a31d45) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:32.733994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116ed2b-2b18-4c76-8e8d-4a412beeda70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:32.735526 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116ed2b-2b18-4c76-8e8d-4a412beeda70 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:32.741720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 48/92] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:03:32 2022] GET /identity/v3/role_assignments?user.id=25d818b178534416a984336411a31d45&scope.project.id=3afe0ad2d6234e83b0fd6f35ed37e7c9&role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:32.742621 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116ed2b-2b18-4c76-8e8d-4a412beeda70 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:32.762678 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:32.784967 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3e94a-3872-493e-a790-286a04f61f36 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:32.855927 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116ed2b-2b18-4c76-8e8d-4a412beeda70 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:32.856789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6031337-7f5b-4129-84dc-b31acaded5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:32.857544 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6031337-7f5b-4129-84dc-b31acaded5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:32.857841 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6031337-7f5b-4129-84dc-b31acaded5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:32.858192 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6031337-7f5b-4129-84dc-b31acaded5a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:32.923940 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab586cc-7fb4-41a5-a20d-0244471a99a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:32.924841 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab586cc-7fb4-41a5-a20d-0244471a99a3 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:32.925132 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab586cc-7fb4-41a5-a20d-0244471a99a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:32.925420 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab586cc-7fb4-41a5-a20d-0244471a99a3 None admin] PATH_INFO: `/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:32.926901 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab586cc-7fb4-41a5-a20d-0244471a99a3 None admin] RBAC: Authorizing `identity:get_project(project_id=3afe0ad2d6234e83b0fd6f35ed37e7c9)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:32.928408 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab586cc-7fb4-41a5-a20d-0244471a99a3 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:32.930272 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 49/93] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:03:32 2022] GET /identity/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:32.939933 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab586cc-7fb4-41a5-a20d-0244471a99a3 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:33.017568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6031337-7f5b-4129-84dc-b31acaded5a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:33.019125 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6031337-7f5b-4129-84dc-b31acaded5a5 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:33.038500 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:33.132780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab586cc-7fb4-41a5-a20d-0244471a99a3 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:33.178290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:33.196972 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7d67c-dc9f-401a-8b94-e16480dd70c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:33.197681 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7d67c-dc9f-401a-8b94-e16480dd70c5 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:33.197971 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7d67c-dc9f-401a-8b94-e16480dd70c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:33.198279 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7d67c-dc9f-401a-8b94-e16480dd70c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:33.199122 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7d67c-dc9f-401a-8b94-e16480dd70c5 None admin] RBAC: Adding query filter params (role.id=4d86c48385634483af68ab63e48f9787, scope.project.id=3afe0ad2d6234e83b0fd6f35ed37e7c9, user.id=83d847fc6deb46e7aec5aa75d815215c) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:33.199444 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7d67c-dc9f-401a-8b94-e16480dd70c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:33.200919 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7d67c-dc9f-401a-8b94-e16480dd70c5 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:33.205169 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 45/94] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:03:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:03:33.210153 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 50/95] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:03:32 2022] GET /identity/v3/role_assignments?user.id=83d847fc6deb46e7aec5aa75d815215c&scope.project.id=3afe0ad2d6234e83b0fd6f35ed37e7c9&role.id=4d86c48385634483af68ab63e48f9787 => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:33.219293 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6031337-7f5b-4129-84dc-b31acaded5a5 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:33.371382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6031337-7f5b-4129-84dc-b31acaded5a5 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:33.419249 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87010f20-7961-4a9f-a5d7-f539ec660c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:33.420139 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87010f20-7961-4a9f-a5d7-f539ec660c2e None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:33.420425 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87010f20-7961-4a9f-a5d7-f539ec660c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:33.420708 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87010f20-7961-4a9f-a5d7-f539ec660c2e None admin] PATH_INFO: `/v3/projects/3e826561cfa74c6bb9108e9d961141e1` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:33.427159 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87010f20-7961-4a9f-a5d7-f539ec660c2e None admin] RBAC: Authorizing `identity:get_project(project_id=3e826561cfa74c6bb9108e9d961141e1)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:33.428689 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87010f20-7961-4a9f-a5d7-f539ec660c2e None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:33.430593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 46/96] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:03:33 2022] GET /identity/v3/projects/3e826561cfa74c6bb9108e9d961141e1 => generated 312 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:33.436557 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7d67c-dc9f-401a-8b94-e16480dd70c5 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:33.579982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7d67c-dc9f-401a-8b94-e16480dd70c5 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:33.594717 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:33.626231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349b088-d4c6-4c6f-a78c-325d05c9a105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:33.626911 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349b088-d4c6-4c6f-a78c-325d05c9a105 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:33.627203 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349b088-d4c6-4c6f-a78c-325d05c9a105 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:33.627488 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349b088-d4c6-4c6f-a78c-325d05c9a105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:33.628340 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349b088-d4c6-4c6f-a78c-325d05c9a105 None admin] RBAC: Adding query filter params (role.id=1727bdbc17d94ff08782d404dce97d35, scope.project.id=3e826561cfa74c6bb9108e9d961141e1, user.id=83d847fc6deb46e7aec5aa75d815215c) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:33.628667 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349b088-d4c6-4c6f-a78c-325d05c9a105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:33.630140 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349b088-d4c6-4c6f-a78c-325d05c9a105 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:33.639556 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 51/97] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:03:33 2022] GET /identity/v3/role_assignments?user.id=83d847fc6deb46e7aec5aa75d815215c&scope.project.id=3e826561cfa74c6bb9108e9d961141e1&role.id=1727bdbc17d94ff08782d404dce97d35 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:34.168342 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc955c-967f-4523-a764-b5a74fc36246 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:34.168878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc955c-967f-4523-a764-b5a74fc36246 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:34.169308 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc955c-967f-4523-a764-b5a74fc36246 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:34.170871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 47/98] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:34.176553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a289460-d7d2-450e-82ac-3285de14160c None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:34.177162 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a289460-d7d2-450e-82ac-3285de14160c None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:34.177671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a289460-d7d2-450e-82ac-3285de14160c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:34.203142 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-0a289460-d7d2-450e-82ac-3285de14160c None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:34.204686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-0a289460-d7d2-450e-82ac-3285de14160c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:34.291923 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 52/99] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:34.317958 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bc7fd-7572-4a3c-abd7-33646a33bcec None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:34.318369 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bc7fd-7572-4a3c-abd7-33646a33bcec None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:34.318731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bc7fd-7572-4a3c-abd7-33646a33bcec None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:34.320210 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 48/100] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:34.326140 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44273c7b-8e98-4744-a6d4-8621bcfbeeec None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:34.326445 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44273c7b-8e98-4744-a6d4-8621bcfbeeec None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:34.326793 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44273c7b-8e98-4744-a6d4-8621bcfbeeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:34.331396 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3bc7fd-7572-4a3c-abd7-33646a33bcec None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:34.345135 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-44273c7b-8e98-4744-a6d4-8621bcfbeeec None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:34.346371 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-44273c7b-8e98-4744-a6d4-8621bcfbeeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:34.416691 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 53/101] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:34.441592 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44273c7b-8e98-4744-a6d4-8621bcfbeeec None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:34.449236 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:34.481450 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:34.581578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44273c7b-8e98-4744-a6d4-8621bcfbeeec None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:34.586789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3bc7fd-7572-4a3c-abd7-33646a33bcec None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:34.634025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3102b59-b075-4ef5-9699-23e032d83429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:34.635440 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3102b59-b075-4ef5-9699-23e032d83429 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:34.635737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3102b59-b075-4ef5-9699-23e032d83429 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:34.636285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3102b59-b075-4ef5-9699-23e032d83429 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:34.660597 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3102b59-b075-4ef5-9699-23e032d83429 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:34.685180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-b3102b59-b075-4ef5-9699-23e032d83429 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:03:34.685180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:34.685180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:34.685180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:34.685180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:34.685180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:34.685180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:34.685180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:34.685180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:34.685180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:34.685180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:34.685180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:34.685180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:34.685180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:34.685180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:34.685180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:34.686025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:34.686025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:34.686025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:34.686025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:34.686025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:34.686025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:34.686025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:34.686025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:34.686025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:34.686025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:34.686025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:34.686025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:34.686025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:34.686025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:34.686025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:34.686025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:34.686830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:34.686830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:34.686830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:34.686830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:34.686830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:34.686830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:34.686830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:34.686830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:34.686830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:34.686830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:34.686830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:03:34.686830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:03:34.689162 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 54/102] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:03:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:03:34.692637 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3102b59-b075-4ef5-9699-23e032d83429 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:34.715385 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1290a0-9942-4a3b-99d4-b104551c3702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:34.716567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1290a0-9942-4a3b-99d4-b104551c3702 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:34.717066 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1290a0-9942-4a3b-99d4-b104551c3702 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:34.717547 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1290a0-9942-4a3b-99d4-b104551c3702 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:34.722851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1290a0-9942-4a3b-99d4-b104551c3702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:34.724563 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1290a0-9942-4a3b-99d4-b104551c3702 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:34.726487 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 49/103] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:03:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:34.743322 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1290a0-9942-4a3b-99d4-b104551c3702 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:34.892385 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:34.909144 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1290a0-9942-4a3b-99d4-b104551c3702 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:34.910078 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3102b59-b075-4ef5-9699-23e032d83429 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:34.952426 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:34.966589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2159c-fe82-4f3b-b651-cd1629fcf69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:34.967381 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2159c-fe82-4f3b-b651-cd1629fcf69b None admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:34.967677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2159c-fe82-4f3b-b651-cd1629fcf69b None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:34.967963 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2159c-fe82-4f3b-b651-cd1629fcf69b None admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:34.968689 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2159c-fe82-4f3b-b651-cd1629fcf69b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:34.970183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2159c-fe82-4f3b-b651-cd1629fcf69b None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:34.995197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029aefc-6611-48ab-8249-0b2b634d4bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:34.995973 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029aefc-6611-48ab-8249-0b2b634d4bbd None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:34.996296 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029aefc-6611-48ab-8249-0b2b634d4bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:34.996587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029aefc-6611-48ab-8249-0b2b634d4bbd None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:34.997474 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029aefc-6611-48ab-8249-0b2b634d4bbd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:34.997792 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029aefc-6611-48ab-8249-0b2b634d4bbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:35.007667 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029aefc-6611-48ab-8249-0b2b634d4bbd None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:35.017658 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 50/104] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Jul 12 13:03:34 2022] POST /identity/v3/projects => generated 302 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:03:35.021951 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 55/105] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:03:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:35.027907 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2159c-fe82-4f3b-b651-cd1629fcf69b None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:35.156932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2159c-fe82-4f3b-b651-cd1629fcf69b None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:35.206615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3742d0-f50b-4684-b03e-916d6121d5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:35.207457 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3742d0-f50b-4684-b03e-916d6121d5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:35.207748 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3742d0-f50b-4684-b03e-916d6121d5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:35.208035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3742d0-f50b-4684-b03e-916d6121d5f1 None admin] PATH_INFO: `/v3/users/a3b0ac6eef3b4063b28ad17e7d0da017` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:35.227097 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3742d0-f50b-4684-b03e-916d6121d5f1 None admin] RBAC: Authorizing `identity:get_user(user_id=a3b0ac6eef3b4063b28ad17e7d0da017)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:35.228672 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3742d0-f50b-4684-b03e-916d6121d5f1 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:35.230511 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 51/106] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:35 2022] GET /identity/v3/users/a3b0ac6eef3b4063b28ad17e7d0da017 => generated 289 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:35.236637 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029aefc-6611-48ab-8249-0b2b634d4bbd None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:35.383240 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029aefc-6611-48ab-8249-0b2b634d4bbd None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:35.426340 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477217b-0300-4c8a-ae8e-abd26112afd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:35.427082 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477217b-0300-4c8a-ae8e-abd26112afd5 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:35.427384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477217b-0300-4c8a-ae8e-abd26112afd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:35.427715 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477217b-0300-4c8a-ae8e-abd26112afd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:35.466367 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:35.527243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477217b-0300-4c8a-ae8e-abd26112afd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:35.528843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477217b-0300-4c8a-ae8e-abd26112afd5 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:35.650916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 56/107] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:03:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:03:35.656731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3742d0-f50b-4684-b03e-916d6121d5f1 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:35.696518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:35.784324 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3742d0-f50b-4684-b03e-916d6121d5f1 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:35.829422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5962d17-9f94-4a30-bc73-200a9b7d9375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:35.830405 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5962d17-9f94-4a30-bc73-200a9b7d9375 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:35.830700 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5962d17-9f94-4a30-bc73-200a9b7d9375 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:35.830982 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5962d17-9f94-4a30-bc73-200a9b7d9375 None admin] PATH_INFO: `/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:35.832282 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5962d17-9f94-4a30-bc73-200a9b7d9375 None admin] RBAC: Authorizing `identity:get_project(project_id=3afe0ad2d6234e83b0fd6f35ed37e7c9)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:35.833841 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5962d17-9f94-4a30-bc73-200a9b7d9375 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:35.836014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 52/108] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:03:35 2022] GET /identity/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:35.842303 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477217b-0300-4c8a-ae8e-abd26112afd5 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:35.851472 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e565a93-3025-46c0-a70c-bed682967451 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:35.851779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e565a93-3025-46c0-a70c-bed682967451 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:35.852061 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e565a93-3025-46c0-a70c-bed682967451 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:35.853623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 53/109] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:35.858823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7c5f7-7deb-4e1e-b014-113b69d32557 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:35.859120 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7c5f7-7deb-4e1e-b014-113b69d32557 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:35.859520 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7c5f7-7deb-4e1e-b014-113b69d32557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:35.889709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-77b7c5f7-7deb-4e1e-b014-113b69d32557 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:35.890971 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-77b7c5f7-7deb-4e1e-b014-113b69d32557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:35.915271 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:35.973209 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 54/110] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:03:36.012123 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7c5f7-7deb-4e1e-b014-113b69d32557 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:36.015152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477217b-0300-4c8a-ae8e-abd26112afd5 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:36.070605 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:36.079614 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293d007-a1ef-473f-869f-96e9d719f0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:36.080669 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293d007-a1ef-473f-869f-96e9d719f0a4 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:36.081165 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293d007-a1ef-473f-869f-96e9d719f0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:36.081644 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293d007-a1ef-473f-869f-96e9d719f0a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:36.086857 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293d007-a1ef-473f-869f-96e9d719f0a4 None admin] RBAC: Adding query filter params (role.id=ef9c44b998b048b0a8db160073bc0e6f, scope.project.id=3afe0ad2d6234e83b0fd6f35ed37e7c9, user.id=a3b0ac6eef3b4063b28ad17e7d0da017) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:36.087529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293d007-a1ef-473f-869f-96e9d719f0a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:36.089280 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293d007-a1ef-473f-869f-96e9d719f0a4 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:36.095478 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 57/111] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:03:35 2022] GET /identity/v3/role_assignments?user.id=a3b0ac6eef3b4063b28ad17e7d0da017&scope.project.id=3afe0ad2d6234e83b0fd6f35ed37e7c9&role.id=ef9c44b998b048b0a8db160073bc0e6f => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:36.133555 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2f924-15fd-480a-8f5f-a5d437b1b53a None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:36.134236 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2f924-15fd-480a-8f5f-a5d437b1b53a None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:36.134800 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2f924-15fd-480a-8f5f-a5d437b1b53a None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:36.136926 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 58/112] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:03:36.142567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f054c3c-f3d1-4fcb-8e36-5f408dd31a1d None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:36.143143 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f054c3c-f3d1-4fcb-8e36-5f408dd31a1d None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:36.143642 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f054c3c-f3d1-4fcb-8e36-5f408dd31a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:36.175270 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-1f054c3c-f3d1-4fcb-8e36-5f408dd31a1d None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:36.176943 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-1f054c3c-f3d1-4fcb-8e36-5f408dd31a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:36.210177 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7c5f7-7deb-4e1e-b014-113b69d32557 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:36.268406 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 59/113] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:36.291076 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f054c3c-f3d1-4fcb-8e36-5f408dd31a1d None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:36.297056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9230de-267f-46ee-8f8c-8480ae10c03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:36.297878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9230de-267f-46ee-8f8c-8480ae10c03c None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:36.298194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9230de-267f-46ee-8f8c-8480ae10c03c None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:36.298477 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9230de-267f-46ee-8f8c-8480ae10c03c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:36.327169 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9230de-267f-46ee-8f8c-8480ae10c03c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:36.343062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-1a9230de-267f-46ee-8f8c-8480ae10c03c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:03:36.343062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:36.343062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:36.343062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:36.343062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:36.343062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:36.343062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:36.343062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:36.343062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:36.343062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:36.343062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:36.343062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:36.343062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:36.343062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:36.343062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:36.343062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:36.344010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:36.344010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:36.344010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:36.344010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:36.344010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:36.344010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:36.344010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:36.344010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:36.344010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:36.344010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:36.344010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:36.344010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:36.344010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:36.344010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:36.344010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:36.344010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:36.344772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:36.344772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:36.344772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:36.344772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:36.344772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:36.344772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:36.344772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:36.344772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:36.344772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:36.344772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:36.344772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:03:36.344772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:03:36.344772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 55/114] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:03:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:03:36.350020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9230de-267f-46ee-8f8c-8480ae10c03c None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:36.382525 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:36.516430 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:36.530356 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9230de-267f-46ee-8f8c-8480ae10c03c None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:36.545138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f054c3c-f3d1-4fcb-8e36-5f408dd31a1d None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:36.577098 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae19a8-8d98-4e72-8f5a-a73f1a4bc496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:36.578468 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae19a8-8d98-4e72-8f5a-a73f1a4bc496 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:36.578957 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae19a8-8d98-4e72-8f5a-a73f1a4bc496 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:36.579711 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae19a8-8d98-4e72-8f5a-a73f1a4bc496 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:36.580664 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae19a8-8d98-4e72-8f5a-a73f1a4bc496 None admin] RBAC: Adding query filter params (name=member) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:36.581193 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae19a8-8d98-4e72-8f5a-a73f1a4bc496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:36.582857 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae19a8-8d98-4e72-8f5a-a73f1a4bc496 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:36.595645 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 56/115] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:03:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:36.600694 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae19a8-8d98-4e72-8f5a-a73f1a4bc496 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:36.617796 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cec90-b4f5-4107-b906-c66ed5e5ef0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:36.620342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cec90-b4f5-4107-b906-c66ed5e5ef0b None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:36.623221 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cec90-b4f5-4107-b906-c66ed5e5ef0b None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:36.623782 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cec90-b4f5-4107-b906-c66ed5e5ef0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:36.648837 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2cec90-b4f5-4107-b906-c66ed5e5ef0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:36.658706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-1d2cec90-b4f5-4107-b906-c66ed5e5ef0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:03:36.658706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:36.658706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:36.658706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:36.658706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:36.658706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:36.658706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:36.658706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:36.658706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:36.658706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:36.658706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:36.658706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:36.658706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:36.658706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:36.658706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:36.658706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:36.659587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:36.659587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:36.659587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:36.659587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:36.659587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:36.659587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:36.659587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:36.659587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:36.659587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:36.659587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:36.659587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:36.659587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:36.659587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:36.659587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:36.659587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:36.659587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:36.660432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:36.660432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:36.660432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:36.660432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:36.660432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:36.660432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:36.660432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:36.660432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:36.660432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:36.660432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:36.660432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:03:36.660432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:03:36.662953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 60/116] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:03:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:03:36.664682 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf390b70-be63-4160-85b6-a79bd6439bc1 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:36.665216 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf390b70-be63-4160-85b6-a79bd6439bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:36.665936 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf390b70-be63-4160-85b6-a79bd6439bc1 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:36.668219 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 61/117] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:36.674162 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf390b70-be63-4160-85b6-a79bd6439bc1 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:36.818808 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae19a8-8d98-4e72-8f5a-a73f1a4bc496 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:36.861737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259baf2-342e-439c-9977-465a16242755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:36.862699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259baf2-342e-439c-9977-465a16242755 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:36.862993 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259baf2-342e-439c-9977-465a16242755 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:36.863278 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259baf2-342e-439c-9977-465a16242755 None admin] PATH_INFO: `/v3/users/83d847fc6deb46e7aec5aa75d815215c` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:36.864507 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259baf2-342e-439c-9977-465a16242755 None admin] RBAC: Authorizing `identity:get_user(user_id=83d847fc6deb46e7aec5aa75d815215c)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:36.866091 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259baf2-342e-439c-9977-465a16242755 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:36.867827 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 57/118] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:36 2022] GET /identity/v3/users/83d847fc6deb46e7aec5aa75d815215c => generated 275 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:36.869752 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4a3f3-fb70-4c04-b7e4-45e5a552e106 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:36.870042 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4a3f3-fb70-4c04-b7e4-45e5a552e106 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:36.874742 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4a3f3-fb70-4c04-b7e4-45e5a552e106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:36.875181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf390b70-be63-4160-85b6-a79bd6439bc1 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:36.892680 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-00e4a3f3-fb70-4c04-b7e4-45e5a552e106 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:36.894027 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:36.894559 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-00e4a3f3-fb70-4c04-b7e4-45e5a552e106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:36.912634 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:36.947256 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b962171-a363-4238-a3b3-535e11074202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:36.948065 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b962171-a363-4238-a3b3-535e11074202 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:36.948353 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b962171-a363-4238-a3b3-535e11074202 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:36.948719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b962171-a363-4238-a3b3-535e11074202 None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:36.949482 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b962171-a363-4238-a3b3-535e11074202 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:36.949793 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b962171-a363-4238-a3b3-535e11074202 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:36.951235 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b962171-a363-4238-a3b3-535e11074202 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:36.963013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 62/119] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:03:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:36.963782 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b962171-a363-4238-a3b3-535e11074202 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:36.967673 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 58/120] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:36.974922 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d8496-d827-4a4a-a318-f272193e5f9e None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:36.975226 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d8496-d827-4a4a-a318-f272193e5f9e None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:36.975516 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d8496-d827-4a4a-a318-f272193e5f9e None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:36.977252 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 59/121] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:36.977805 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d8496-d827-4a4a-a318-f272193e5f9e None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:37.095446 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b962171-a363-4238-a3b3-535e11074202 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:37.108641 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d8496-d827-4a4a-a318-f272193e5f9e None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:37.140145 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e323b-4f03-4d86-8298-84faad9b7f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:37.140959 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e323b-4f03-4d86-8298-84faad9b7f29 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:37.141245 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e323b-4f03-4d86-8298-84faad9b7f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:37.141526 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e323b-4f03-4d86-8298-84faad9b7f29 None admin] PATH_INFO: `/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:37.142828 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e323b-4f03-4d86-8298-84faad9b7f29 None admin] RBAC: Authorizing `identity:get_project(project_id=3afe0ad2d6234e83b0fd6f35ed37e7c9)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:37.144411 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e323b-4f03-4d86-8298-84faad9b7f29 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:37.150995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 63/122] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:03:36 2022] GET /identity/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:37.150995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4468cb6-efb0-4caf-ab9a-51d5c35aefc9 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:37.150995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4468cb6-efb0-4caf-ab9a-51d5c35aefc9 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:37.150995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4468cb6-efb0-4caf-ab9a-51d5c35aefc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:37.162490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dec23b-d67b-48b7-bf61-be99fa026284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:37.163949 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dec23b-d67b-48b7-bf61-be99fa026284 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:37.164492 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dec23b-d67b-48b7-bf61-be99fa026284 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:37.164971 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dec23b-d67b-48b7-bf61-be99fa026284 None admin] PATH_INFO: `/v3/users/25d818b178534416a984336411a31d45` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:37.166985 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dec23b-d67b-48b7-bf61-be99fa026284 None admin] RBAC: Authorizing `identity:get_user(user_id=25d818b178534416a984336411a31d45)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:37.167469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-d4468cb6-efb0-4caf-ab9a-51d5c35aefc9 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:37.168710 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-d4468cb6-efb0-4caf-ab9a-51d5c35aefc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:37.169113 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dec23b-d67b-48b7-bf61-be99fa026284 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:37.171275 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 60/123] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:36 2022] GET /identity/v3/users/25d818b178534416a984336411a31d45 => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:37.173193 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dec23b-d67b-48b7-bf61-be99fa026284 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:37.202781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:37.210336 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:37.256425 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 64/124] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:37.262151 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4468cb6-efb0-4caf-ab9a-51d5c35aefc9 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:37.316595 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dec23b-d67b-48b7-bf61-be99fa026284 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:37.360008 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011c90c-c6a3-49fc-a293-12522da9e4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:37.361197 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011c90c-c6a3-49fc-a293-12522da9e4ac None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:37.361684 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011c90c-c6a3-49fc-a293-12522da9e4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:37.362199 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011c90c-c6a3-49fc-a293-12522da9e4ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:37.374983 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011c90c-c6a3-49fc-a293-12522da9e4ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:37.384220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-d011c90c-c6a3-49fc-a293-12522da9e4ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:03:37.384220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:37.384220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:37.384220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:37.384220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:37.384220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:37.384220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:37.384220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:37.384220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:37.384220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:37.384220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:37.384220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:37.384220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:37.384220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:37.384220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:37.384220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:37.385649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:37.385649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:37.385649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:37.385649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:37.385649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:37.385649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:37.385649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:37.385649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:37.385649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:37.385649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:37.385649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:37.385649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:37.385649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:37.385649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:37.385649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:37.385649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:37.386699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:37.386699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:37.386699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:37.386699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:37.386699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:37.386699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:37.386699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:37.386699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:37.386699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:37.386699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:37.386699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:03:37.386699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:03:37.389203 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 61/125] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Jul 12 13:03:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:03:37.390310 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011c90c-c6a3-49fc-a293-12522da9e4ac None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:37.400873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4468cb6-efb0-4caf-ab9a-51d5c35aefc9 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:37.449101 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd056e65-b9f5-4ebe-851f-142bf5455040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:37.450419 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd056e65-b9f5-4ebe-851f-142bf5455040 None admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:37.450910 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd056e65-b9f5-4ebe-851f-142bf5455040 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:37.451389 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd056e65-b9f5-4ebe-851f-142bf5455040 None admin] PATH_INFO: `/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9/users/83d847fc6deb46e7aec5aa75d815215c/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:37.454789 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd056e65-b9f5-4ebe-851f-142bf5455040 None admin] RBAC: Authorizing `identity:create_grant(project_id=3afe0ad2d6234e83b0fd6f35ed37e7c9, user_id=83d847fc6deb46e7aec5aa75d815215c, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:37.457035 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd056e65-b9f5-4ebe-851f-142bf5455040 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:37.479406 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 65/126] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Jul 12 13:03:37 2022] PUT /identity/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9/users/83d847fc6deb46e7aec5aa75d815215c/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:03:37.480613 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd056e65-b9f5-4ebe-851f-142bf5455040 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:37.513215 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:37.527881 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:37.543347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011c90c-c6a3-49fc-a293-12522da9e4ac None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:37.609660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16461c2-fc2e-4785-89d5-828a2b8a562c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:37.610737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16461c2-fc2e-4785-89d5-828a2b8a562c None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:37.611098 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16461c2-fc2e-4785-89d5-828a2b8a562c None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:37.611454 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16461c2-fc2e-4785-89d5-828a2b8a562c None admin] PATH_INFO: `/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:37.612761 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16461c2-fc2e-4785-89d5-828a2b8a562c None admin] RBAC: Authorizing `identity:get_project(project_id=3afe0ad2d6234e83b0fd6f35ed37e7c9)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:37.614389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16461c2-fc2e-4785-89d5-828a2b8a562c None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:37.616719 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 62/127] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:03:37 2022] GET /identity/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:37.617753 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16461c2-fc2e-4785-89d5-828a2b8a562c None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:37.631525 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd056e65-b9f5-4ebe-851f-142bf5455040 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:37.676016 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd149c78-4f06-44f2-a6dd-51e9e23abf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:37.677185 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd149c78-4f06-44f2-a6dd-51e9e23abf41 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:37.678455 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd149c78-4f06-44f2-a6dd-51e9e23abf41 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:37.678962 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd149c78-4f06-44f2-a6dd-51e9e23abf41 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:37.693567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd149c78-4f06-44f2-a6dd-51e9e23abf41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:37.704267 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-fd149c78-4f06-44f2-a6dd-51e9e23abf41 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:03:37.704267 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:37.704267 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:37.704267 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:37.704267 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:37.704267 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:37.704267 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:37.704267 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:37.704267 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:37.704267 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:37.704267 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:37.704267 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:37.704267 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:37.704267 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:37.704267 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:37.704267 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:37.705304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:37.705304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:37.705304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:37.705304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:37.705304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:37.705304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:37.705304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:37.705304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:37.705304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:37.705304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:37.705304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:37.705304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:37.705304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:37.705304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:37.705304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:37.705304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:37.706103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:37.706103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:37.706103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:37.706103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:37.706103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:37.706103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:37.706103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:37.706103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:37.706103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:37.706103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:37.706103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:03:37.706103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:03:37.710578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 66/128] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:03:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:03:37.712378 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd149c78-4f06-44f2-a6dd-51e9e23abf41 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:37.792218 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16461c2-fc2e-4785-89d5-828a2b8a562c None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:37.864072 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225cc02-5004-4d11-adc7-7f1e50f83b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:37.864796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225cc02-5004-4d11-adc7-7f1e50f83b18 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:37.865030 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225cc02-5004-4d11-adc7-7f1e50f83b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:37.865317 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225cc02-5004-4d11-adc7-7f1e50f83b18 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:37.866079 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225cc02-5004-4d11-adc7-7f1e50f83b18 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:37.866416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225cc02-5004-4d11-adc7-7f1e50f83b18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:37.867814 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225cc02-5004-4d11-adc7-7f1e50f83b18 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:37.872097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:37.883207 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 63/129] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:03:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:37.884074 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225cc02-5004-4d11-adc7-7f1e50f83b18 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:37.888229 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd149c78-4f06-44f2-a6dd-51e9e23abf41 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:37.899180 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:37.952474 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1d78a-37dd-4a92-8d21-6a53be080f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:37.953391 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1d78a-37dd-4a92-8d21-6a53be080f70 None admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:37.953678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1d78a-37dd-4a92-8d21-6a53be080f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:37.953956 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1d78a-37dd-4a92-8d21-6a53be080f70 None admin] PATH_INFO: `/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9/users/25d818b178534416a984336411a31d45/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:37.959588 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1d78a-37dd-4a92-8d21-6a53be080f70 None admin] RBAC: Authorizing `identity:create_grant(project_id=3afe0ad2d6234e83b0fd6f35ed37e7c9, user_id=25d818b178534416a984336411a31d45, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:37.961105 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1d78a-37dd-4a92-8d21-6a53be080f70 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:37.987203 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 67/130] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Jul 12 13:03:37 2022] PUT /identity/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9/users/25d818b178534416a984336411a31d45/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:03:37.988234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1d78a-37dd-4a92-8d21-6a53be080f70 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:38.000115 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225cc02-5004-4d11-adc7-7f1e50f83b18 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:38.040705 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82def537-00ee-420e-9212-72fea34b42a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:38.041439 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82def537-00ee-420e-9212-72fea34b42a7 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:38.041979 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82def537-00ee-420e-9212-72fea34b42a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:38.042297 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82def537-00ee-420e-9212-72fea34b42a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:38.043203 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82def537-00ee-420e-9212-72fea34b42a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:38.043530 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82def537-00ee-420e-9212-72fea34b42a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:38.045019 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82def537-00ee-420e-9212-72fea34b42a7 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:38.055296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 64/131] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:03:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:38.061570 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82def537-00ee-420e-9212-72fea34b42a7 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:38.175520 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1d78a-37dd-4a92-8d21-6a53be080f70 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:38.199307 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:38.235003 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd96cd-336e-4941-badf-b8da903b61b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:38.235837 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd96cd-336e-4941-badf-b8da903b61b5 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:38.236129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd96cd-336e-4941-badf-b8da903b61b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:38.236416 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd96cd-336e-4941-badf-b8da903b61b5 None admin] PATH_INFO: `/v3/users/83d847fc6deb46e7aec5aa75d815215c` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:38.242900 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd96cd-336e-4941-badf-b8da903b61b5 None admin] RBAC: Authorizing `identity:get_user(user_id=83d847fc6deb46e7aec5aa75d815215c)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:38.244974 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd96cd-336e-4941-badf-b8da903b61b5 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:38.247124 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 68/132] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:37 2022] GET /identity/v3/users/83d847fc6deb46e7aec5aa75d815215c => generated 275 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:38.252528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd96cd-336e-4941-badf-b8da903b61b5 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:38.258884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82def537-00ee-420e-9212-72fea34b42a7 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:38.290609 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:38.326315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ebec8-6f47-4408-9fff-47f9966a0712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:38.327248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ebec8-6f47-4408-9fff-47f9966a0712 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:38.327539 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ebec8-6f47-4408-9fff-47f9966a0712 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:38.327828 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ebec8-6f47-4408-9fff-47f9966a0712 None admin] PATH_INFO: `/v3/users/83d847fc6deb46e7aec5aa75d815215c` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:38.329211 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ebec8-6f47-4408-9fff-47f9966a0712 None admin] RBAC: Authorizing `identity:get_user(user_id=83d847fc6deb46e7aec5aa75d815215c)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:38.330751 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ebec8-6f47-4408-9fff-47f9966a0712 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:38.332714 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 65/133] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:38 2022] GET /identity/v3/users/83d847fc6deb46e7aec5aa75d815215c => generated 275 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:38.334016 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d45e63-073d-49d1-927f-4784a9bbed06 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:38.334340 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d45e63-073d-49d1-927f-4784a9bbed06 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:38.334731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d45e63-073d-49d1-927f-4784a9bbed06 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:38.336359 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 66/134] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:38.341860 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d45e63-073d-49d1-927f-4784a9bbed06 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:38.437368 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd96cd-336e-4941-badf-b8da903b61b5 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:38.481434 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3386e-bc6e-4a7c-91ee-e714b1b0db95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:38.482472 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3386e-bc6e-4a7c-91ee-e714b1b0db95 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:38.482764 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3386e-bc6e-4a7c-91ee-e714b1b0db95 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:38.483046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3386e-bc6e-4a7c-91ee-e714b1b0db95 None admin] PATH_INFO: `/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:38.484325 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3386e-bc6e-4a7c-91ee-e714b1b0db95 None admin] RBAC: Authorizing `identity:get_project(project_id=3afe0ad2d6234e83b0fd6f35ed37e7c9)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:38.486082 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3386e-bc6e-4a7c-91ee-e714b1b0db95 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:38.488125 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 69/135] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:03:38 2022] GET /identity/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:38.489545 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82995ded-8a39-4b5d-8c5a-d37a950665f2 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:38.489845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82995ded-8a39-4b5d-8c5a-d37a950665f2 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:38.490141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82995ded-8a39-4b5d-8c5a-d37a950665f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:38.504005 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d45e63-073d-49d1-927f-4784a9bbed06 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:38.507963 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-82995ded-8a39-4b5d-8c5a-d37a950665f2 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:38.509166 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-82995ded-8a39-4b5d-8c5a-d37a950665f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:38.552405 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82301be-e775-4033-a9f8-653e388e6ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:38.554212 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82301be-e775-4033-a9f8-653e388e6ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:38.554694 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82301be-e775-4033-a9f8-653e388e6ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:38.555129 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82301be-e775-4033-a9f8-653e388e6ad8 None admin] PATH_INFO: `/v3/projects/3e826561cfa74c6bb9108e9d961141e1` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:38.556588 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82301be-e775-4033-a9f8-653e388e6ad8 None admin] RBAC: Authorizing `identity:get_project(project_id=3e826561cfa74c6bb9108e9d961141e1)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:38.558263 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82301be-e775-4033-a9f8-653e388e6ad8 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:38.561147 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 67/136] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:03:38 2022] GET /identity/v3/projects/3e826561cfa74c6bb9108e9d961141e1 => generated 312 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:38.563052 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721892db-5f53-4f04-b93a-ad886f95fba4 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:38.563816 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721892db-5f53-4f04-b93a-ad886f95fba4 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:38.564304 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721892db-5f53-4f04-b93a-ad886f95fba4 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:38.566015 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 68/137] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:38.567565 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721892db-5f53-4f04-b93a-ad886f95fba4 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:38.583717 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:38.589248 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 70/138] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:38.598575 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82995ded-8a39-4b5d-8c5a-d37a950665f2 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:38.628787 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:38.710994 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721892db-5f53-4f04-b93a-ad886f95fba4 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:38.724075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82995ded-8a39-4b5d-8c5a-d37a950665f2 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:38.760432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7019a4-1056-4824-a1f0-2bdc88a94e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:38.760917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c607a4-bf4d-4c6e-a2f7-f297d1571c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:38.762147 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7019a4-1056-4824-a1f0-2bdc88a94e44 None admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:38.762253 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c607a4-bf4d-4c6e-a2f7-f297d1571c77 None admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:38.762628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c607a4-bf4d-4c6e-a2f7-f297d1571c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:38.762894 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7019a4-1056-4824-a1f0-2bdc88a94e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:38.763004 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c607a4-bf4d-4c6e-a2f7-f297d1571c77 None admin] PATH_INFO: `/v3/projects/3e826561cfa74c6bb9108e9d961141e1/users/83d847fc6deb46e7aec5aa75d815215c/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:38.763451 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7019a4-1056-4824-a1f0-2bdc88a94e44 None admin] PATH_INFO: `/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9/users/83d847fc6deb46e7aec5aa75d815215c/roles/4d86c48385634483af68ab63e48f9787` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:38.765191 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c607a4-bf4d-4c6e-a2f7-f297d1571c77 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e826561cfa74c6bb9108e9d961141e1, user_id=83d847fc6deb46e7aec5aa75d815215c, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:38.766072 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7019a4-1056-4824-a1f0-2bdc88a94e44 None admin] RBAC: Authorizing `identity:create_grant(project_id=3afe0ad2d6234e83b0fd6f35ed37e7c9, user_id=83d847fc6deb46e7aec5aa75d815215c, role_id=4d86c48385634483af68ab63e48f9787)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:38.766926 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c607a4-bf4d-4c6e-a2f7-f297d1571c77 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:38.767922 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7019a4-1056-4824-a1f0-2bdc88a94e44 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:38.781740 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 71/139] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Jul 12 13:03:38 2022] PUT /identity/v3/projects/3e826561cfa74c6bb9108e9d961141e1/users/83d847fc6deb46e7aec5aa75d815215c/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:03:38.783213 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53551f-9d46-4816-b567-787fe45c4f30 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:38.783547 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53551f-9d46-4816-b567-787fe45c4f30 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:38.783901 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53551f-9d46-4816-b567-787fe45c4f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:38.786187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 69/140] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Jul 12 13:03:38 2022] PUT /identity/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9/users/83d847fc6deb46e7aec5aa75d815215c/roles/4d86c48385634483af68ab63e48f9787 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:03:38.787311 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7019a4-1056-4824-a1f0-2bdc88a94e44 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:38.803986 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-be53551f-9d46-4816-b567-787fe45c4f30 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:38.805235 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-be53551f-9d46-4816-b567-787fe45c4f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:38.873512 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:38.901669 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 72/141] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:38.921888 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7019a4-1056-4824-a1f0-2bdc88a94e44 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:38.936100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53551f-9d46-4816-b567-787fe45c4f30 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:38.944861 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:38.966762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfab007-68ec-44a1-9730-afbc96bed770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:38.968004 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfab007-68ec-44a1-9730-afbc96bed770 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:38.968489 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfab007-68ec-44a1-9730-afbc96bed770 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:38.968919 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfab007-68ec-44a1-9730-afbc96bed770 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:38.970482 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfab007-68ec-44a1-9730-afbc96bed770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:38.972215 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfab007-68ec-44a1-9730-afbc96bed770 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:38.974285 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 70/142] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:03:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:38.983327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfab007-68ec-44a1-9730-afbc96bed770 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:39.090746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53551f-9d46-4816-b567-787fe45c4f30 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:39.130607 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d73115-cf9d-4fc1-add1-978e03858b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:39.131622 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d73115-cf9d-4fc1-add1-978e03858b7d None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:39.132011 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d73115-cf9d-4fc1-add1-978e03858b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:39.132391 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d73115-cf9d-4fc1-add1-978e03858b7d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:39.145361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfab007-68ec-44a1-9730-afbc96bed770 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:39.145994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d73115-cf9d-4fc1-add1-978e03858b7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:39.155584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-27d73115-cf9d-4fc1-add1-978e03858b7d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:03:39.155584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:39.155584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:39.155584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:39.155584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:39.155584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:39.155584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:39.155584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:39.155584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:39.155584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:39.155584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:39.155584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:39.155584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:39.155584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:39.155584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:39.155584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:39.156666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:39.156666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:39.156666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:39.156666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:39.156666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:39.156666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:39.156666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:39.156666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:39.156666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:39.156666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:39.156666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:39.156666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:39.156666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:39.156666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:39.156666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:39.156666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:39.157460 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:39.157460 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:39.157460 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:39.157460 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:39.157460 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:39.157460 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:39.157460 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:39.157460 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:39.157460 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:39.157460 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:39.157460 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:03:39.157460 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:03:39.158063 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 73/143] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:03:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:03:39.164312 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d73115-cf9d-4fc1-add1-978e03858b7d None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:39.194611 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2262e75-ab47-477f-a84a-ee9487294286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:39.195922 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2262e75-ab47-477f-a84a-ee9487294286 None admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:39.196432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2262e75-ab47-477f-a84a-ee9487294286 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:39.196958 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2262e75-ab47-477f-a84a-ee9487294286 None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:39.198032 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2262e75-ab47-477f-a84a-ee9487294286 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:39.199923 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2262e75-ab47-477f-a84a-ee9487294286 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:39.209440 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:39.227062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 71/144] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Jul 12 13:03:38 2022] POST /identity/v3/users => generated 283 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:03:39.250389 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:39.292227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d73115-cf9d-4fc1-add1-978e03858b7d None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:39.333983 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052181e-c240-449f-9790-0eba80364403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:39.334738 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052181e-c240-449f-9790-0eba80364403 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:39.335036 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052181e-c240-449f-9790-0eba80364403 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:39.335320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052181e-c240-449f-9790-0eba80364403 None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:39.336118 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052181e-c240-449f-9790-0eba80364403 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:39.336444 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052181e-c240-449f-9790-0eba80364403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:39.338490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052181e-c240-449f-9790-0eba80364403 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:39.352472 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 74/145] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:03:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:39.358087 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2262e75-ab47-477f-a84a-ee9487294286 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:39.495929 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2262e75-ab47-477f-a84a-ee9487294286 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:39.537905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98caa45-01d4-43ea-8ef8-25451289b659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:39.539266 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98caa45-01d4-43ea-8ef8-25451289b659 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:39.539752 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98caa45-01d4-43ea-8ef8-25451289b659 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:39.540250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98caa45-01d4-43ea-8ef8-25451289b659 None admin] PATH_INFO: `/v3/users/a3b0ac6eef3b4063b28ad17e7d0da017` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:39.541754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98caa45-01d4-43ea-8ef8-25451289b659 None admin] RBAC: Authorizing `identity:get_user(user_id=a3b0ac6eef3b4063b28ad17e7d0da017)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:39.543613 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98caa45-01d4-43ea-8ef8-25451289b659 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:39.545526 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 72/146] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:39 2022] GET /identity/v3/users/a3b0ac6eef3b4063b28ad17e7d0da017 => generated 289 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:39.551143 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052181e-c240-449f-9790-0eba80364403 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:39.673094 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052181e-c240-449f-9790-0eba80364403 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:39.702991 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:39.712349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e0b62-22f4-4484-a98e-2ef849399771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:39.713283 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e0b62-22f4-4484-a98e-2ef849399771 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:39.713567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e0b62-22f4-4484-a98e-2ef849399771 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:39.713845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e0b62-22f4-4484-a98e-2ef849399771 None admin] PATH_INFO: `/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:39.715266 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e0b62-22f4-4484-a98e-2ef849399771 None admin] RBAC: Authorizing `identity:get_project(project_id=3afe0ad2d6234e83b0fd6f35ed37e7c9)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:39.716735 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e0b62-22f4-4484-a98e-2ef849399771 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:39.718839 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 75/147] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:03:39 2022] GET /identity/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:39.724500 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98caa45-01d4-43ea-8ef8-25451289b659 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:39.793725 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:39.845538 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98caa45-01d4-43ea-8ef8-25451289b659 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:39.891135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef3b4f-82e4-45d8-99db-5955839d4c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:39.892117 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef3b4f-82e4-45d8-99db-5955839d4c09 None admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:39.892414 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef3b4f-82e4-45d8-99db-5955839d4c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:39.892697 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef3b4f-82e4-45d8-99db-5955839d4c09 None admin] PATH_INFO: `/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9/users/a3b0ac6eef3b4063b28ad17e7d0da017/roles/ef9c44b998b048b0a8db160073bc0e6f` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:39.899512 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef3b4f-82e4-45d8-99db-5955839d4c09 None admin] RBAC: Authorizing `identity:create_grant(project_id=3afe0ad2d6234e83b0fd6f35ed37e7c9, user_id=a3b0ac6eef3b4063b28ad17e7d0da017, role_id=ef9c44b998b048b0a8db160073bc0e6f)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:39.901054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef3b4f-82e4-45d8-99db-5955839d4c09 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:39.925671 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 73/148] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Jul 12 13:03:39 2022] PUT /identity/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9/users/a3b0ac6eef3b4063b28ad17e7d0da017/roles/ef9c44b998b048b0a8db160073bc0e6f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:03:40.348858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae58a1d-d4cd-488a-a79f-cc7ced473166 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:40.349394 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae58a1d-d4cd-488a-a79f-cc7ced473166 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:40.349394 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae58a1d-d4cd-488a-a79f-cc7ced473166 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:40.351033 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 76/149] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:40.356695 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcd8f2-0043-4117-ab5c-cb587dcbebee None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:40.357004 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcd8f2-0043-4117-ab5c-cb587dcbebee None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:40.357296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcd8f2-0043-4117-ab5c-cb587dcbebee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:40.380228 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-2dfcd8f2-0043-4117-ab5c-cb587dcbebee None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:40.381653 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-2dfcd8f2-0043-4117-ab5c-cb587dcbebee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:40.467754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 74/150] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:40.506605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae58a1d-d4cd-488a-a79f-cc7ced473166 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:40.644021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae58a1d-d4cd-488a-a79f-cc7ced473166 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:40.687065 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f0958-7c8e-48f3-8690-ef8ba61d9b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:40.687896 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f0958-7c8e-48f3-8690-ef8ba61d9b4f None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:40.688220 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f0958-7c8e-48f3-8690-ef8ba61d9b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:40.688464 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f0958-7c8e-48f3-8690-ef8ba61d9b4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:40.700768 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f0958-7c8e-48f3-8690-ef8ba61d9b4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:40.708912 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-770f0958-7c8e-48f3-8690-ef8ba61d9b4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:03:40.708912 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:40.708912 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:40.708912 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:40.708912 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:40.708912 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:40.708912 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:40.708912 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:40.708912 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:40.708912 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:40.708912 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:40.708912 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:40.708912 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:40.708912 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:40.708912 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:40.708912 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:40.709808 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:40.709808 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:40.709808 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:40.709808 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:40.709808 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:40.709808 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:40.709808 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:40.709808 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:40.709808 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:40.709808 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:40.709808 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:40.709808 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:40.709808 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:40.709808 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:40.709808 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:40.709808 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:40.710647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:40.710647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:40.710647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:40.710647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:40.710647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:40.710647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:40.710647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:40.710647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:40.710647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:40.710647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:40.710647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:03:40.710647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:03:40.710647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 77/151] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:03:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:03:40.716468 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfcd8f2-0043-4117-ab5c-cb587dcbebee None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:40.773027 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:40.830594 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfcd8f2-0043-4117-ab5c-cb587dcbebee None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:40.873691 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9f5df-f93d-4f0b-88d3-ec14e8ca8c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:40.874417 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9f5df-f93d-4f0b-88d3-ec14e8ca8c9b None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:40.874706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9f5df-f93d-4f0b-88d3-ec14e8ca8c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:40.874988 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9f5df-f93d-4f0b-88d3-ec14e8ca8c9b None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:40.875811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9f5df-f93d-4f0b-88d3-ec14e8ca8c9b None admin] RBAC: Adding query filter params (name=member) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:40.876127 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9f5df-f93d-4f0b-88d3-ec14e8ca8c9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:40.877539 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9f5df-f93d-4f0b-88d3-ec14e8ca8c9b None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:40.890623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 75/152] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:03:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:40.896338 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f0958-7c8e-48f3-8690-ef8ba61d9b4f None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:40.966975 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:41.019056 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f0958-7c8e-48f3-8690-ef8ba61d9b4f None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:41.065970 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f83d6-5bcd-493d-9b9f-a57eab0b3a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:41.066914 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f83d6-5bcd-493d-9b9f-a57eab0b3a5b None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:41.067201 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f83d6-5bcd-493d-9b9f-a57eab0b3a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:41.067481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f83d6-5bcd-493d-9b9f-a57eab0b3a5b None admin] PATH_INFO: `/v3/users/83d847fc6deb46e7aec5aa75d815215c` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:41.068745 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f83d6-5bcd-493d-9b9f-a57eab0b3a5b None admin] RBAC: Authorizing `identity:get_user(user_id=83d847fc6deb46e7aec5aa75d815215c)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:41.070272 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f83d6-5bcd-493d-9b9f-a57eab0b3a5b None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:41.072061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 78/153] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:40 2022] GET /identity/v3/users/83d847fc6deb46e7aec5aa75d815215c => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:41.077687 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9f5df-f93d-4f0b-88d3-ec14e8ca8c9b None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:41.186840 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9f5df-f93d-4f0b-88d3-ec14e8ca8c9b None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:41.201775 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:41.228172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4f488-1b60-4ac8-a3c4-a59ca9e29895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:41.228873 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4f488-1b60-4ac8-a3c4-a59ca9e29895 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:41.229158 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4f488-1b60-4ac8-a3c4-a59ca9e29895 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:41.229437 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4f488-1b60-4ac8-a3c4-a59ca9e29895 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:41.318749 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4f488-1b60-4ac8-a3c4-a59ca9e29895 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:41.320517 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4f488-1b60-4ac8-a3c4-a59ca9e29895 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:41.444722 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 76/154] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:03:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:03:41.450518 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f83d6-5bcd-493d-9b9f-a57eab0b3a5b None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:41.576466 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f83d6-5bcd-493d-9b9f-a57eab0b3a5b None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:41.612921 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:41.626235 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c518b1-dab4-4dc0-9e27-6c3438fc557b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:41.627487 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c518b1-dab4-4dc0-9e27-6c3438fc557b None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:41.627992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c518b1-dab4-4dc0-9e27-6c3438fc557b None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:41.628483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c518b1-dab4-4dc0-9e27-6c3438fc557b None admin] PATH_INFO: `/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:41.635496 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c518b1-dab4-4dc0-9e27-6c3438fc557b None admin] RBAC: Authorizing `identity:get_project(project_id=3afe0ad2d6234e83b0fd6f35ed37e7c9)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:41.637534 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c518b1-dab4-4dc0-9e27-6c3438fc557b None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:41.639891 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 79/155] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:03:41 2022] GET /identity/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:41.645470 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4f488-1b60-4ac8-a3c4-a59ca9e29895 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:41.676122 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:41.813079 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4f488-1b60-4ac8-a3c4-a59ca9e29895 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:41.824052 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11727d7-2b00-4ae2-bec4-a6dde027f1e5 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:41.824340 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11727d7-2b00-4ae2-bec4-a6dde027f1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:41.824615 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11727d7-2b00-4ae2-bec4-a6dde027f1e5 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:41.826006 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 80/156] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:41.831743 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73205573-0a09-478f-8826-0bfa799e3c2c None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:41.832040 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73205573-0a09-478f-8826-0bfa799e3c2c None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:41.832325 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73205573-0a09-478f-8826-0bfa799e3c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:41.871208 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-73205573-0a09-478f-8826-0bfa799e3c2c None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:41.872600 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-73205573-0a09-478f-8826-0bfa799e3c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:41.895936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e4993-c547-434f-80e3-ed1c1a601103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:41.896811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e4993-c547-434f-80e3-ed1c1a601103 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:41.897167 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e4993-c547-434f-80e3-ed1c1a601103 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:41.897553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e4993-c547-434f-80e3-ed1c1a601103 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:41.898615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e4993-c547-434f-80e3-ed1c1a601103 None admin] RBAC: Adding query filter params (role.id=1727bdbc17d94ff08782d404dce97d35, scope.project.id=3afe0ad2d6234e83b0fd6f35ed37e7c9, user.id=83d847fc6deb46e7aec5aa75d815215c) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:41.899013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e4993-c547-434f-80e3-ed1c1a601103 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:41.900964 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e4993-c547-434f-80e3-ed1c1a601103 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:41.913086 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 77/157] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:03:41 2022] GET /identity/v3/role_assignments?user.id=83d847fc6deb46e7aec5aa75d815215c&scope.project.id=3afe0ad2d6234e83b0fd6f35ed37e7c9&role.id=1727bdbc17d94ff08782d404dce97d35 => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:42.007628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 81/158] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:03:42.048565 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e4993-c547-434f-80e3-ed1c1a601103 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:42.162810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:42.190188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e4993-c547-434f-80e3-ed1c1a601103 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:42.235340 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b06daa-c911-48bf-9834-f6d5e846fc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:42.236231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b06daa-c911-48bf-9834-f6d5e846fc97 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:42.236519 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b06daa-c911-48bf-9834-f6d5e846fc97 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:42.236802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b06daa-c911-48bf-9834-f6d5e846fc97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:42.257421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b06daa-c911-48bf-9834-f6d5e846fc97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:42.266200 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-84b06daa-c911-48bf-9834-f6d5e846fc97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:03:42.266200 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:42.266200 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:42.266200 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:42.266200 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:42.266200 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:42.266200 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:42.266200 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:42.266200 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:42.266200 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:42.266200 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:42.266200 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:42.266200 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:42.266200 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:42.266200 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:42.266200 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:42.267204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:42.267204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:42.267204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:42.267204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:42.267204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:42.267204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:42.267204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:42.267204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:42.267204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:42.267204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:42.267204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:42.267204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:42.267204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:42.267204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:42.267204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:42.267204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:42.268289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:42.268289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:42.268289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:42.268289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:42.268289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:42.268289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:42.268289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:42.268289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:42.268289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:42.268289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:42.268289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:03:42.268289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:03:42.268289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 78/159] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:03:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:03:42.275915 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73205573-0a09-478f-8826-0bfa799e3c2c None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:42.417358 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73205573-0a09-478f-8826-0bfa799e3c2c None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:42.450498 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:42.466066 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca713a32-50a4-44c6-b03e-f26aee01c1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:42.466819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca713a32-50a4-44c6-b03e-f26aee01c1ad None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:42.467070 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca713a32-50a4-44c6-b03e-f26aee01c1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:42.467348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca713a32-50a4-44c6-b03e-f26aee01c1ad None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:42.468104 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca713a32-50a4-44c6-b03e-f26aee01c1ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:42.468411 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca713a32-50a4-44c6-b03e-f26aee01c1ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:42.469823 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca713a32-50a4-44c6-b03e-f26aee01c1ad None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:42.482986 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 82/160] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:03:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:42.488324 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b06daa-c911-48bf-9834-f6d5e846fc97 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:42.705134 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b06daa-c911-48bf-9834-f6d5e846fc97 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:42.757197 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a709cf-ca91-4fc9-bd48-69e508617a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:42.758134 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a709cf-ca91-4fc9-bd48-69e508617a08 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:42.758461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a709cf-ca91-4fc9-bd48-69e508617a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:42.758771 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a709cf-ca91-4fc9-bd48-69e508617a08 None admin] PATH_INFO: `/v3/users/25d818b178534416a984336411a31d45` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:42.762869 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a709cf-ca91-4fc9-bd48-69e508617a08 None admin] RBAC: Authorizing `identity:get_user(user_id=25d818b178534416a984336411a31d45)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:42.764370 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a709cf-ca91-4fc9-bd48-69e508617a08 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:42.766449 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 79/161] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:42 2022] GET /identity/v3/users/25d818b178534416a984336411a31d45 => generated 247 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:42.771654 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca713a32-50a4-44c6-b03e-f26aee01c1ad None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:42.786195 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f428c-bb8a-425b-9955-800df3d09b59 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:42.786469 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f428c-bb8a-425b-9955-800df3d09b59 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:42.786859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f428c-bb8a-425b-9955-800df3d09b59 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:42.788300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 80/162] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:03:42.796741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab030c-07b0-4c4f-b92b-d668025369c9 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:42.797041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab030c-07b0-4c4f-b92b-d668025369c9 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:42.797381 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab030c-07b0-4c4f-b92b-d668025369c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:42.807807 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:42.825457 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-9aab030c-07b0-4c4f-b92b-d668025369c9 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:42.826700 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-9aab030c-07b0-4c4f-b92b-d668025369c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:42.955341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca713a32-50a4-44c6-b03e-f26aee01c1ad None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:43.008338 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d53c95-0eb8-464c-86c4-06c87d273efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:43.009253 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d53c95-0eb8-464c-86c4-06c87d273efd None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:43.010305 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d53c95-0eb8-464c-86c4-06c87d273efd None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:43.010726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d53c95-0eb8-464c-86c4-06c87d273efd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:43.036602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 81/163] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:43.084627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab030c-07b0-4c4f-b92b-d668025369c9 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:43.092063 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:43.111205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d53c95-0eb8-464c-86c4-06c87d273efd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:43.112672 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d53c95-0eb8-464c-86c4-06c87d273efd None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:43.234232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 83/164] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:03:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:03:43.241485 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d53c95-0eb8-464c-86c4-06c87d273efd None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:43.296851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab030c-07b0-4c4f-b92b-d668025369c9 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:43.348769 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c469ae-b343-44a7-94da-727f8ffba7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:43.349858 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c469ae-b343-44a7-94da-727f8ffba7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:43.350311 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c469ae-b343-44a7-94da-727f8ffba7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:43.350727 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c469ae-b343-44a7-94da-727f8ffba7a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:43.359673 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:43.371873 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c469ae-b343-44a7-94da-727f8ffba7a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:43.383773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-65c469ae-b343-44a7-94da-727f8ffba7a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:03:43.383773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:43.383773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:43.383773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:43.383773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:43.383773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:43.383773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:43.383773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:43.383773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:43.383773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:43.383773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:43.383773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:43.383773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:43.383773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:43.383773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:43.383773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:43.385737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:43.385737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:43.385737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:43.385737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:43.385737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:43.385737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:43.385737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:43.385737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:43.385737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:43.385737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:43.385737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:43.385737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:43.385737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:43.385737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:43.385737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:43.385737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:43.386978 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:43.386978 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:43.386978 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:43.386978 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:43.386978 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:43.386978 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:43.386978 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:43.386978 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:43.386978 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:43.386978 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:43.386978 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:03:43.386978 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:03:43.386978 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 82/165] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:03:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:03:43.387880 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889e997-d7a8-4b1e-9885-bb8b2c2916b0 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:43.387880 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889e997-d7a8-4b1e-9885-bb8b2c2916b0 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:43.387880 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889e997-d7a8-4b1e-9885-bb8b2c2916b0 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:43.394434 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 83/166] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:43.395543 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889e997-d7a8-4b1e-9885-bb8b2c2916b0 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:43.478591 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:43.506323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d53c95-0eb8-464c-86c4-06c87d273efd None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:43.553957 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d24447-97f1-4e62-95a8-a79095d30480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:43.555020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d24447-97f1-4e62-95a8-a79095d30480 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:43.555387 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d24447-97f1-4e62-95a8-a79095d30480 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:43.555672 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d24447-97f1-4e62-95a8-a79095d30480 None admin] PATH_INFO: `/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:43.557445 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d24447-97f1-4e62-95a8-a79095d30480 None admin] RBAC: Authorizing `identity:get_project(project_id=3afe0ad2d6234e83b0fd6f35ed37e7c9)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:43.558950 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d24447-97f1-4e62-95a8-a79095d30480 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:43.561223 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 84/167] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:03:43 2022] GET /identity/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9 => generated 298 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:43.567146 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3df17-09c9-4a3a-8d13-4aa07014327a None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:43.567433 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3df17-09c9-4a3a-8d13-4aa07014327a None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:43.567713 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3df17-09c9-4a3a-8d13-4aa07014327a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:43.585397 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-bda3df17-09c9-4a3a-8d13-4aa07014327a None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:43.586630 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-bda3df17-09c9-4a3a-8d13-4aa07014327a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:43.602828 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889e997-d7a8-4b1e-9885-bb8b2c2916b0 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:43.661665 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 85/168] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:43.662397 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3df17-09c9-4a3a-8d13-4aa07014327a None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:43.671394 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b273570-8dcc-4fc0-af2c-9905e54c8d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:43.672089 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b273570-8dcc-4fc0-af2c-9905e54c8d1b None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:43.672372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b273570-8dcc-4fc0-af2c-9905e54c8d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:43.677705 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b273570-8dcc-4fc0-af2c-9905e54c8d1b None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:43.678705 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b273570-8dcc-4fc0-af2c-9905e54c8d1b None admin] RBAC: Adding query filter params (name=member) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:43.679165 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b273570-8dcc-4fc0-af2c-9905e54c8d1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:43.680711 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b273570-8dcc-4fc0-af2c-9905e54c8d1b None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:43.703384 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 84/169] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:03:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:43.705175 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0965131-ce23-4bb1-92aa-e624dc7880c2 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:43.706892 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0965131-ce23-4bb1-92aa-e624dc7880c2 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:43.708054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0965131-ce23-4bb1-92aa-e624dc7880c2 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:43.709554 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 85/170] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:43.710518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0965131-ce23-4bb1-92aa-e624dc7880c2 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:43.821605 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:43.830568 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:43.864443 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3df17-09c9-4a3a-8d13-4aa07014327a None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:43.909210 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0965131-ce23-4bb1-92aa-e624dc7880c2 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:43.938453 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b5197-3429-40c7-a0bf-f829f0da73ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:43.939130 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b5197-3429-40c7-a0bf-f829f0da73ea None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:43.939414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b5197-3429-40c7-a0bf-f829f0da73ea None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:43.939692 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b5197-3429-40c7-a0bf-f829f0da73ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:43.940533 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b5197-3429-40c7-a0bf-f829f0da73ea None admin] RBAC: Adding query filter params (role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0, scope.project.id=3afe0ad2d6234e83b0fd6f35ed37e7c9, user.id=25d818b178534416a984336411a31d45) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:43.940846 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b5197-3429-40c7-a0bf-f829f0da73ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:43.942347 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b5197-3429-40c7-a0bf-f829f0da73ea None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:43.955581 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 86/171] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:03:43 2022] GET /identity/v3/role_assignments?user.id=25d818b178534416a984336411a31d45&scope.project.id=3afe0ad2d6234e83b0fd6f35ed37e7c9&role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:43.956423 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b5197-3429-40c7-a0bf-f829f0da73ea None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:43.984939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45acfb20-32a6-4af1-9345-46b4a3723677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:43.985787 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acfb20-32a6-4af1-9345-46b4a3723677 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:43.986073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acfb20-32a6-4af1-9345-46b4a3723677 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:43.986373 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acfb20-32a6-4af1-9345-46b4a3723677 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:44.010746 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45acfb20-32a6-4af1-9345-46b4a3723677 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:44.023347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-45acfb20-32a6-4af1-9345-46b4a3723677 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:03:44.023347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:44.023347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:44.023347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:44.023347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:44.023347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:44.023347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:44.023347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:44.023347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:44.023347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:44.023347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:44.023347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:44.023347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:44.023347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:44.023347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:44.023347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:44.024497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:44.024497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:44.024497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:44.024497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:44.024497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:44.024497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:44.024497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:44.024497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:44.024497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:44.024497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:44.024497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:44.024497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:44.024497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:44.024497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:44.024497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:44.024497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:44.025949 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:44.025949 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:44.025949 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:44.025949 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:44.025949 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:44.025949 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:44.025949 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:44.025949 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:44.025949 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:44.025949 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:44.025949 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:03:44.025949 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:03:44.025949 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 86/172] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Jul 12 13:03:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:03:44.027081 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21a4b3-b7f1-4aa2-a00e-d14042f07181 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:44.027081 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21a4b3-b7f1-4aa2-a00e-d14042f07181 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:44.027081 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21a4b3-b7f1-4aa2-a00e-d14042f07181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:44.076300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-1e21a4b3-b7f1-4aa2-a00e-d14042f07181 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:44.077838 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-1e21a4b3-b7f1-4aa2-a00e-d14042f07181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:44.224440 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b5197-3429-40c7-a0bf-f829f0da73ea None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:44.266687 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 87/173] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:44.267201 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21a4b3-b7f1-4aa2-a00e-d14042f07181 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:44.293823 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e042bf7-b439-4e76-a0ff-5a6b991f8569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:44.294968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e042bf7-b439-4e76-a0ff-5a6b991f8569 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:44.295291 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e042bf7-b439-4e76-a0ff-5a6b991f8569 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:44.295573 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e042bf7-b439-4e76-a0ff-5a6b991f8569 None admin] PATH_INFO: `/v3/users/83d847fc6deb46e7aec5aa75d815215c` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:44.297130 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e042bf7-b439-4e76-a0ff-5a6b991f8569 None admin] RBAC: Authorizing `identity:get_user(user_id=83d847fc6deb46e7aec5aa75d815215c)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:44.298955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e042bf7-b439-4e76-a0ff-5a6b991f8569 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:44.301327 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 87/174] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:43 2022] GET /identity/v3/users/83d847fc6deb46e7aec5aa75d815215c => generated 275 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:44.302852 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bc627-762b-4aee-9847-aa381ba0cfbe None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:44.303380 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bc627-762b-4aee-9847-aa381ba0cfbe None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:44.303804 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bc627-762b-4aee-9847-aa381ba0cfbe None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:44.305346 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 88/175] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:44.307418 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bc627-762b-4aee-9847-aa381ba0cfbe None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:44.328838 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:44.332006 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:44.413214 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21a4b3-b7f1-4aa2-a00e-d14042f07181 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:44.447656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bc627-762b-4aee-9847-aa381ba0cfbe None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:44.459583 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2bd40-b9e9-415d-8cfd-1933b9d69a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:44.460244 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2bd40-b9e9-415d-8cfd-1933b9d69a8c None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:44.460552 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2bd40-b9e9-415d-8cfd-1933b9d69a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:44.460782 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2bd40-b9e9-415d-8cfd-1933b9d69a8c None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:44.461577 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2bd40-b9e9-415d-8cfd-1933b9d69a8c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:44.461879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2bd40-b9e9-415d-8cfd-1933b9d69a8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:44.463344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2bd40-b9e9-415d-8cfd-1933b9d69a8c None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:44.472268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 88/176] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:03:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:44.478589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2bd40-b9e9-415d-8cfd-1933b9d69a8c None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:44.487786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8beee4-fd64-46ef-9d2f-d314a579ed30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:44.488519 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8beee4-fd64-46ef-9d2f-d314a579ed30 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:44.488807 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8beee4-fd64-46ef-9d2f-d314a579ed30 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:44.489099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8beee4-fd64-46ef-9d2f-d314a579ed30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:44.582365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8beee4-fd64-46ef-9d2f-d314a579ed30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:44.584182 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8beee4-fd64-46ef-9d2f-d314a579ed30 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:44.599826 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:44.634216 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2bd40-b9e9-415d-8cfd-1933b9d69a8c None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:44.645594 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:44.675829 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae33b9-bb51-402e-93ce-d8f207c0ebae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:44.676049 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae33b9-bb51-402e-93ce-d8f207c0ebae None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:44.676265 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae33b9-bb51-402e-93ce-d8f207c0ebae None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:44.676555 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae33b9-bb51-402e-93ce-d8f207c0ebae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:44.689230 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae33b9-bb51-402e-93ce-d8f207c0ebae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:44.697416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-c9ae33b9-bb51-402e-93ce-d8f207c0ebae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:03:44.697416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:44.697416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:44.697416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:44.697416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:44.697416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:44.697416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:44.697416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:44.697416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:44.697416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:44.697416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:44.697416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:44.697416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:44.697416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:44.697416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:44.697416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:44.698623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:44.698623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:44.698623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:44.698623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:44.698623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:44.698623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:44.698623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:44.698623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:44.698623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:44.698623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:44.698623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:44.698623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:44.698623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:44.698623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:44.698623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:44.698623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:44.699533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:44.699533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:44.699533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:44.699533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:44.699533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:44.699533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:44.699533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:44.699533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:44.699533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:44.699533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:44.699533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:03:44.699533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:03:44.699533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 89/177] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:03:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:03:44.700634 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ffe58-6118-4e53-9af9-ffdeddad3764 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:44.700634 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ffe58-6118-4e53-9af9-ffdeddad3764 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:44.700932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ffe58-6118-4e53-9af9-ffdeddad3764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:44.711079 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 89/178] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:03:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 13:03:44.713080 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fdade-c379-403d-913e-1fe2a064c620 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:44.713372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fdade-c379-403d-913e-1fe2a064c620 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:44.713652 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fdade-c379-403d-913e-1fe2a064c620 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:44.718179 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 90/179] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:44.718179 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fdade-c379-403d-913e-1fe2a064c620 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:44.726360 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-fb5ffe58-6118-4e53-9af9-ffdeddad3764 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:44.727608 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-fb5ffe58-6118-4e53-9af9-ffdeddad3764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:44.807092 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 90/180] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:44.808201 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf75361-964b-45bd-87a0-d15b6aa00375 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:44.808544 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf75361-964b-45bd-87a0-d15b6aa00375 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:44.808769 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf75361-964b-45bd-87a0-d15b6aa00375 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:44.810050 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 91/181] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:44.810762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf75361-964b-45bd-87a0-d15b6aa00375 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:44.883962 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fdade-c379-403d-913e-1fe2a064c620 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:44.899994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:44.923505 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbf6dc-e744-4820-a2e4-acb541b143dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:44.924398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbf6dc-e744-4820-a2e4-acb541b143dc None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:44.924681 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbf6dc-e744-4820-a2e4-acb541b143dc None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:44.924962 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbf6dc-e744-4820-a2e4-acb541b143dc None admin] PATH_INFO: `/v3/users/83d847fc6deb46e7aec5aa75d815215c` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:44.926221 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cbf6dc-e744-4820-a2e4-acb541b143dc None admin] RBAC: Authorizing `identity:get_user(user_id=83d847fc6deb46e7aec5aa75d815215c)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:44.927696 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cbf6dc-e744-4820-a2e4-acb541b143dc None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:44.929568 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 91/182] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:44 2022] GET /identity/v3/users/83d847fc6deb46e7aec5aa75d815215c => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:44.931124 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbf6dc-e744-4820-a2e4-acb541b143dc None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:44.937013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:44.942232 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf75361-964b-45bd-87a0-d15b6aa00375 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:44.979143 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf89f1-39d9-416b-b4d4-dedc9d3d66d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:44.979827 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf89f1-39d9-416b-b4d4-dedc9d3d66d8 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:44.980111 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf89f1-39d9-416b-b4d4-dedc9d3d66d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:44.980388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf89f1-39d9-416b-b4d4-dedc9d3d66d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:44.981143 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf89f1-39d9-416b-b4d4-dedc9d3d66d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:44.981447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf89f1-39d9-416b-b4d4-dedc9d3d66d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:44.982879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf89f1-39d9-416b-b4d4-dedc9d3d66d8 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:44.991487 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 92/183] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:03:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:44.992887 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babc8d1-ff81-4451-90e4-e8451e8b1102 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:44.993178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babc8d1-ff81-4451-90e4-e8451e8b1102 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:44.993455 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babc8d1-ff81-4451-90e4-e8451e8b1102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:45.012766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-7babc8d1-ff81-4451-90e4-e8451e8b1102 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:45.013970 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-7babc8d1-ff81-4451-90e4-e8451e8b1102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:45.044038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbf6dc-e744-4820-a2e4-acb541b143dc None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:45.081988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e93b1-d664-4a83-baf5-6154b4919020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:45.083070 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e93b1-d664-4a83-baf5-6154b4919020 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:45.083226 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 93/184] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:45.083451 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e93b1-d664-4a83-baf5-6154b4919020 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:45.088527 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e93b1-d664-4a83-baf5-6154b4919020 None admin] PATH_INFO: `/v3/projects/3e826561cfa74c6bb9108e9d961141e1` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:45.088638 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03893582-f809-4339-a2df-4cc7671c5a74 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:45.088638 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03893582-f809-4339-a2df-4cc7671c5a74 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:45.088638 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03893582-f809-4339-a2df-4cc7671c5a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:45.089630 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e93b1-d664-4a83-baf5-6154b4919020 None admin] RBAC: Authorizing `identity:get_project(project_id=3e826561cfa74c6bb9108e9d961141e1)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:45.091258 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e93b1-d664-4a83-baf5-6154b4919020 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:45.093493 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 92/185] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:03:44 2022] GET /identity/v3/projects/3e826561cfa74c6bb9108e9d961141e1 => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:45.094309 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e93b1-d664-4a83-baf5-6154b4919020 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:45.114088 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-03893582-f809-4339-a2df-4cc7671c5a74 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:45.115325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-03893582-f809-4339-a2df-4cc7671c5a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:45.146841 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:45.182781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 94/186] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:45.194581 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03893582-f809-4339-a2df-4cc7671c5a74 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:45.210053 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:45.213109 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e93b1-d664-4a83-baf5-6154b4919020 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:45.248682 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9949c1-a6bf-42b9-bc2f-a3afa41009f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:45.249484 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9949c1-a6bf-42b9-bc2f-a3afa41009f5 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:45.249765 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9949c1-a6bf-42b9-bc2f-a3afa41009f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:45.250036 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9949c1-a6bf-42b9-bc2f-a3afa41009f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:45.260372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9949c1-a6bf-42b9-bc2f-a3afa41009f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:45.268473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-5d9949c1-a6bf-42b9-bc2f-a3afa41009f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:03:45.268473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:45.268473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:45.268473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:45.268473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:45.268473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:45.268473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:45.268473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:45.268473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:45.268473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:45.268473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:45.268473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:45.268473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:45.268473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:45.268473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:45.268473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:45.269389 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:45.269389 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:45.269389 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:45.269389 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:45.269389 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:45.269389 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:45.269389 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:45.269389 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:45.269389 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:45.269389 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:45.269389 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:45.269389 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:45.269389 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:45.269389 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:45.269389 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:45.269389 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:45.270218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:45.270218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:45.270218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:45.270218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:45.270218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:45.270218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:45.270218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:45.270218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:45.270218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:45.270218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:45.270218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:03:45.270218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:03:45.270218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 93/187] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:03:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:03:45.270865 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9949c1-a6bf-42b9-bc2f-a3afa41009f5 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:45.291329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03893582-f809-4339-a2df-4cc7671c5a74 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:45.325738 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229465bd-ad33-4cfc-96db-e926959b6890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:45.326436 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229465bd-ad33-4cfc-96db-e926959b6890 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:45.326721 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229465bd-ad33-4cfc-96db-e926959b6890 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:45.326999 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229465bd-ad33-4cfc-96db-e926959b6890 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:45.380497 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9949c1-a6bf-42b9-bc2f-a3afa41009f5 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:45.391052 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:45.397681 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229465bd-ad33-4cfc-96db-e926959b6890 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:45.399140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229465bd-ad33-4cfc-96db-e926959b6890 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:45.414937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73859bb7-7977-402e-a135-39e012ab00b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:45.416330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73859bb7-7977-402e-a135-39e012ab00b6 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:45.416610 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73859bb7-7977-402e-a135-39e012ab00b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:45.416883 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73859bb7-7977-402e-a135-39e012ab00b6 None admin] PATH_INFO: `/v3/users/6cd7f45a3461442b918c132a09ca1276` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:45.420291 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:45.433273 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73859bb7-7977-402e-a135-39e012ab00b6 None admin] RBAC: Authorizing `identity:get_user(user_id=6cd7f45a3461442b918c132a09ca1276)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:45.434839 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73859bb7-7977-402e-a135-39e012ab00b6 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:45.436630 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 94/188] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:45 2022] GET /identity/v3/users/6cd7f45a3461442b918c132a09ca1276 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:45.437426 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73859bb7-7977-402e-a135-39e012ab00b6 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:45.497943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 95/189] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:03:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:03:45.498830 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229465bd-ad33-4cfc-96db-e926959b6890 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:45.550368 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73859bb7-7977-402e-a135-39e012ab00b6 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:45.593812 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2973a8-23f6-43b4-8d53-936d829b32af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:45.594539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2973a8-23f6-43b4-8d53-936d829b32af None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:45.594825 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2973a8-23f6-43b4-8d53-936d829b32af None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:45.595101 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2973a8-23f6-43b4-8d53-936d829b32af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:45.595979 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2973a8-23f6-43b4-8d53-936d829b32af None admin] RBAC: Adding query filter params (role.id=1727bdbc17d94ff08782d404dce97d35, scope.project.id=3e826561cfa74c6bb9108e9d961141e1, user.id=83d847fc6deb46e7aec5aa75d815215c) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:45.596346 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2973a8-23f6-43b4-8d53-936d829b32af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:45.597941 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2973a8-23f6-43b4-8d53-936d829b32af None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:45.602363 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229465bd-ad33-4cfc-96db-e926959b6890 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:45.605572 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 95/190] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:03:45 2022] GET /identity/v3/role_assignments?user.id=83d847fc6deb46e7aec5aa75d815215c&scope.project.id=3e826561cfa74c6bb9108e9d961141e1&role.id=1727bdbc17d94ff08782d404dce97d35 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:45.606348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2973a8-23f6-43b4-8d53-936d829b32af None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:45.628002 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:45.650791 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affbc20-d96e-4eaf-b046-80a633218077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:45.652437 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affbc20-d96e-4eaf-b046-80a633218077 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:45.652906 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affbc20-d96e-4eaf-b046-80a633218077 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:45.653337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affbc20-d96e-4eaf-b046-80a633218077 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:45.655031 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affbc20-d96e-4eaf-b046-80a633218077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:45.656932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affbc20-d96e-4eaf-b046-80a633218077 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:45.665473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 96/191] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:03:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:45.665473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affbc20-d96e-4eaf-b046-80a633218077 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:45.668621 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:45.759580 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2973a8-23f6-43b4-8d53-936d829b32af None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:45.793594 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affbc20-d96e-4eaf-b046-80a633218077 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:45.809478 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fe26a-34a3-491b-a1b7-6c66fed02f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:45.810338 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fe26a-34a3-491b-a1b7-6c66fed02f77 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:45.810621 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fe26a-34a3-491b-a1b7-6c66fed02f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:45.810961 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fe26a-34a3-491b-a1b7-6c66fed02f77 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:45.823999 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59fe26a-34a3-491b-a1b7-6c66fed02f77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:45.835138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-e59fe26a-34a3-491b-a1b7-6c66fed02f77 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:03:45.835138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:45.835138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:45.835138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:45.835138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:45.835138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:45.835138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:45.835138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:45.835138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:45.835138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:45.835138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:45.835138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:45.835138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:45.835138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:45.835138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:45.835138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:45.836160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:45.836160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:45.836160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:45.836160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:45.836160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:45.836160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:45.836160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:45.836160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:45.836160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:45.836160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:45.836160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:45.836160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:45.836160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:45.836160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:45.836160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:45.836160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:45.837232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:45.837232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:45.837232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:45.837232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:45.837232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:45.837232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:45.837232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:45.837232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:45.837232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:45.837232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:45.837232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:03:45.837232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:03:45.837232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 96/192] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Jul 12 13:03:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:03:45.837232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fe26a-34a3-491b-a1b7-6c66fed02f77 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:45.841984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bd2f9-a606-49d1-a528-94fa3ccd800a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:45.842952 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bd2f9-a606-49d1-a528-94fa3ccd800a None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:45.843317 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bd2f9-a606-49d1-a528-94fa3ccd800a None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:45.843701 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bd2f9-a606-49d1-a528-94fa3ccd800a None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:45.844641 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451bd2f9-a606-49d1-a528-94fa3ccd800a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:45.845085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451bd2f9-a606-49d1-a528-94fa3ccd800a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:45.847191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451bd2f9-a606-49d1-a528-94fa3ccd800a None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:45.856292 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 97/193] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:03:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:45.857355 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bd2f9-a606-49d1-a528-94fa3ccd800a None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:45.909146 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:45.954717 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:45.960102 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bd2f9-a606-49d1-a528-94fa3ccd800a None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:45.965804 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fe26a-34a3-491b-a1b7-6c66fed02f77 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:45.993718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6aa93-8e83-440a-8c21-326b77b20b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:45.994619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6aa93-8e83-440a-8c21-326b77b20b89 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:45.994911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6aa93-8e83-440a-8c21-326b77b20b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:45.995190 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6aa93-8e83-440a-8c21-326b77b20b89 None admin] PATH_INFO: `/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:45.996385 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6aa93-8e83-440a-8c21-326b77b20b89 None admin] RBAC: Authorizing `identity:get_project(project_id=3afe0ad2d6234e83b0fd6f35ed37e7c9)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:45.997842 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6aa93-8e83-440a-8c21-326b77b20b89 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:45.999563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531d944-f8d7-450d-8541-b4b657037076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:45.999698 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 98/194] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:03:45 2022] GET /identity/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:46.000225 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531d944-f8d7-450d-8541-b4b657037076 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:46.000319 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6aa93-8e83-440a-8c21-326b77b20b89 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:46.000509 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531d944-f8d7-450d-8541-b4b657037076 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:46.000862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531d944-f8d7-450d-8541-b4b657037076 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:46.068585 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531d944-f8d7-450d-8541-b4b657037076 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:46.070070 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531d944-f8d7-450d-8541-b4b657037076 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:46.099417 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6aa93-8e83-440a-8c21-326b77b20b89 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:46.115946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:46.132298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93315172-8b59-4d1e-bf82-18b580eabfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:46.132973 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93315172-8b59-4d1e-bf82-18b580eabfea None admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:46.133259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93315172-8b59-4d1e-bf82-18b580eabfea None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:46.133533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93315172-8b59-4d1e-bf82-18b580eabfea None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:46.134808 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93315172-8b59-4d1e-bf82-18b580eabfea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:46.136516 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93315172-8b59-4d1e-bf82-18b580eabfea None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:46.155566 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 99/195] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Jul 12 13:03:45 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:03:46.155566 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93315172-8b59-4d1e-bf82-18b580eabfea None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:46.170643 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:46.176020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 97/196] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:03:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:03:46.176020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531d944-f8d7-450d-8541-b4b657037076 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:46.294903 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93315172-8b59-4d1e-bf82-18b580eabfea None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:46.298683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531d944-f8d7-450d-8541-b4b657037076 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:46.335723 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39408dfb-4702-48fc-bd03-05165bbddd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:46.336601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39408dfb-4702-48fc-bd03-05165bbddd65 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:46.336890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39408dfb-4702-48fc-bd03-05165bbddd65 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:46.337167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39408dfb-4702-48fc-bd03-05165bbddd65 None admin] PATH_INFO: `/v3/users/a3b0ac6eef3b4063b28ad17e7d0da017` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:46.340963 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39408dfb-4702-48fc-bd03-05165bbddd65 None admin] RBAC: Authorizing `identity:get_user(user_id=a3b0ac6eef3b4063b28ad17e7d0da017)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:46.341273 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39408dfb-4702-48fc-bd03-05165bbddd65 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:46.344114 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 98/197] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:46 2022] GET /identity/v3/users/a3b0ac6eef3b4063b28ad17e7d0da017 => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:46.344114 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39408dfb-4702-48fc-bd03-05165bbddd65 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:46.344623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274a601-10ce-4bdb-a366-446580be8410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:46.345318 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274a601-10ce-4bdb-a366-446580be8410 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:46.345610 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274a601-10ce-4bdb-a366-446580be8410 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:46.345887 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274a601-10ce-4bdb-a366-446580be8410 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:46.346889 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274a601-10ce-4bdb-a366-446580be8410 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:46.348073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274a601-10ce-4bdb-a366-446580be8410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:46.349487 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274a601-10ce-4bdb-a366-446580be8410 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:46.361274 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 100/198] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:03:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:46.366306 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274a601-10ce-4bdb-a366-446580be8410 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:46.411337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:46.418407 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:46.473176 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39408dfb-4702-48fc-bd03-05165bbddd65 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:46.501325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274a601-10ce-4bdb-a366-446580be8410 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:46.515561 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428a229-5b24-4a8b-97d9-270e295d1226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:46.516233 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428a229-5b24-4a8b-97d9-270e295d1226 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:46.516539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428a229-5b24-4a8b-97d9-270e295d1226 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:46.516808 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428a229-5b24-4a8b-97d9-270e295d1226 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:46.517664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428a229-5b24-4a8b-97d9-270e295d1226 None admin] RBAC: Adding query filter params (role.id=4d86c48385634483af68ab63e48f9787, scope.project.id=3afe0ad2d6234e83b0fd6f35ed37e7c9, user.id=83d847fc6deb46e7aec5aa75d815215c) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:46.517977 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428a229-5b24-4a8b-97d9-270e295d1226 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:46.519475 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428a229-5b24-4a8b-97d9-270e295d1226 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:46.525872 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 99/199] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:03:46 2022] GET /identity/v3/role_assignments?user.id=83d847fc6deb46e7aec5aa75d815215c&scope.project.id=3afe0ad2d6234e83b0fd6f35ed37e7c9&role.id=4d86c48385634483af68ab63e48f9787 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:46.526720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428a229-5b24-4a8b-97d9-270e295d1226 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:46.546025 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69759934-2d7a-48de-b738-c65cd90e3d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:46.547347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69759934-2d7a-48de-b738-c65cd90e3d73 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:46.547917 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69759934-2d7a-48de-b738-c65cd90e3d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:46.548201 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69759934-2d7a-48de-b738-c65cd90e3d73 None admin] PATH_INFO: `/v3/projects/878eddd0b05c4cc382e41c3d429ddcee` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:46.549548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69759934-2d7a-48de-b738-c65cd90e3d73 None admin] RBAC: Authorizing `identity:get_project(project_id=878eddd0b05c4cc382e41c3d429ddcee)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:46.551845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69759934-2d7a-48de-b738-c65cd90e3d73 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:46.553884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 101/200] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:03:46 2022] GET /identity/v3/projects/878eddd0b05c4cc382e41c3d429ddcee => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:46.559102 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69759934-2d7a-48de-b738-c65cd90e3d73 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:46.656344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428a229-5b24-4a8b-97d9-270e295d1226 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:46.682739 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:46.695665 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e98d47-ea34-4855-9d06-36dd0e957f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:46.696511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e98d47-ea34-4855-9d06-36dd0e957f23 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:46.697472 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e98d47-ea34-4855-9d06-36dd0e957f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:46.697845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e98d47-ea34-4855-9d06-36dd0e957f23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:46.736277 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69759934-2d7a-48de-b738-c65cd90e3d73 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:46.743518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:46.776704 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e98d47-ea34-4855-9d06-36dd0e957f23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:46.778430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e98d47-ea34-4855-9d06-36dd0e957f23 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:46.796735 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f5692-2ac7-41d9-a5b7-f7ff3f809736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:46.797741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f5692-2ac7-41d9-a5b7-f7ff3f809736 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:46.798036 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f5692-2ac7-41d9-a5b7-f7ff3f809736 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:46.798433 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f5692-2ac7-41d9-a5b7-f7ff3f809736 None admin] PATH_INFO: `/v3/users/6cd7f45a3461442b918c132a09ca1276` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:46.799678 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f5692-2ac7-41d9-a5b7-f7ff3f809736 None admin] RBAC: Authorizing `identity:get_user(user_id=6cd7f45a3461442b918c132a09ca1276)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:46.801272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f5692-2ac7-41d9-a5b7-f7ff3f809736 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:46.803166 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 102/201] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:46 2022] GET /identity/v3/users/6cd7f45a3461442b918c132a09ca1276 => generated 283 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:46.803941 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f5692-2ac7-41d9-a5b7-f7ff3f809736 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:46.909987 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 100/202] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:03:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:03:46.912650 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e98d47-ea34-4855-9d06-36dd0e957f23 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:46.939707 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:46.946652 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f5692-2ac7-41d9-a5b7-f7ff3f809736 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:47.008291 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d37a9-46fb-42bf-a25d-98b6da7bba6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:47.009414 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d37a9-46fb-42bf-a25d-98b6da7bba6f None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:47.010507 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d37a9-46fb-42bf-a25d-98b6da7bba6f None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:47.011234 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d37a9-46fb-42bf-a25d-98b6da7bba6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:47.013165 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d37a9-46fb-42bf-a25d-98b6da7bba6f None admin] RBAC: Adding query filter params (role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0, scope.project.id=878eddd0b05c4cc382e41c3d429ddcee, user.id=6cd7f45a3461442b918c132a09ca1276) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:47.013668 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d37a9-46fb-42bf-a25d-98b6da7bba6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:47.017376 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d37a9-46fb-42bf-a25d-98b6da7bba6f None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:47.029305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 103/203] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:03:46 2022] GET /identity/v3/role_assignments?user.id=6cd7f45a3461442b918c132a09ca1276&scope.project.id=878eddd0b05c4cc382e41c3d429ddcee&role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:47.030711 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d37a9-46fb-42bf-a25d-98b6da7bba6f None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:47.073195 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e98d47-ea34-4855-9d06-36dd0e957f23 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:47.114539 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:47.183139 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b82734-5e16-4157-9a31-27e3a760fc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:47.183984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b82734-5e16-4157-9a31-27e3a760fc0c None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:47.184390 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b82734-5e16-4157-9a31-27e3a760fc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:47.184681 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b82734-5e16-4157-9a31-27e3a760fc0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:47.201403 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d37a9-46fb-42bf-a25d-98b6da7bba6f None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:47.240353 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1684a-2345-4386-a61c-7e8662ba412f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:47.241280 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1684a-2345-4386-a61c-7e8662ba412f None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:47.241566 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1684a-2345-4386-a61c-7e8662ba412f None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:47.241892 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1684a-2345-4386-a61c-7e8662ba412f None admin] PATH_INFO: `/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:47.243334 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1684a-2345-4386-a61c-7e8662ba412f None admin] RBAC: Authorizing `identity:get_project(project_id=3afe0ad2d6234e83b0fd6f35ed37e7c9)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:47.244955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1684a-2345-4386-a61c-7e8662ba412f None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:47.247125 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 104/204] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:03:47 2022] GET /identity/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:47.253233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1684a-2345-4386-a61c-7e8662ba412f None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:47.365788 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b82734-5e16-4157-9a31-27e3a760fc0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:47.367282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b82734-5e16-4157-9a31-27e3a760fc0c None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:47.372107 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1684a-2345-4386-a61c-7e8662ba412f None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:47.398535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:47.410903 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c7bf0-0bc7-48ed-8918-348f8607e439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:47.411487 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c7bf0-0bc7-48ed-8918-348f8607e439 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:47.412019 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c7bf0-0bc7-48ed-8918-348f8607e439 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:47.412177 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c7bf0-0bc7-48ed-8918-348f8607e439 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:47.413544 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c7bf0-0bc7-48ed-8918-348f8607e439 None admin] RBAC: Adding query filter params (role.id=ef9c44b998b048b0a8db160073bc0e6f, scope.project.id=3afe0ad2d6234e83b0fd6f35ed37e7c9, user.id=a3b0ac6eef3b4063b28ad17e7d0da017) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:47.414017 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c7bf0-0bc7-48ed-8918-348f8607e439 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:47.416921 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c7bf0-0bc7-48ed-8918-348f8607e439 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:47.423664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:47.429438 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 105/205] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:03:47 2022] GET /identity/v3/role_assignments?user.id=a3b0ac6eef3b4063b28ad17e7d0da017&scope.project.id=3afe0ad2d6234e83b0fd6f35ed37e7c9&role.id=ef9c44b998b048b0a8db160073bc0e6f => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:47.574793 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 101/206] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:03:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:03:47.582918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c7bf0-0bc7-48ed-8918-348f8607e439 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:47.768131 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c7bf0-0bc7-48ed-8918-348f8607e439 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:47.823944 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18df94d-adf4-4b75-adce-e8acf2f3999f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:47.825334 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18df94d-adf4-4b75-adce-e8acf2f3999f None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:47.825790 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18df94d-adf4-4b75-adce-e8acf2f3999f None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:47.826269 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18df94d-adf4-4b75-adce-e8acf2f3999f None admin] PATH_INFO: `/v3/projects/878eddd0b05c4cc382e41c3d429ddcee` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:47.828150 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18df94d-adf4-4b75-adce-e8acf2f3999f None admin] RBAC: Authorizing `identity:get_project(project_id=878eddd0b05c4cc382e41c3d429ddcee)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:47.830617 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18df94d-adf4-4b75-adce-e8acf2f3999f None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:47.833439 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 106/207] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:03:47 2022] GET /identity/v3/projects/878eddd0b05c4cc382e41c3d429ddcee => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:47.839511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b82734-5e16-4157-9a31-27e3a760fc0c None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:47.965751 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b82734-5e16-4157-9a31-27e3a760fc0c None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:47.995765 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:48.016555 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9457e10-2011-41ab-bce1-82b1cf262e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:48.017238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9457e10-2011-41ab-bce1-82b1cf262e82 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:48.017523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9457e10-2011-41ab-bce1-82b1cf262e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:48.017806 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9457e10-2011-41ab-bce1-82b1cf262e82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:48.018681 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9457e10-2011-41ab-bce1-82b1cf262e82 None admin] RBAC: Adding query filter params (role.id=4d86c48385634483af68ab63e48f9787, scope.project.id=878eddd0b05c4cc382e41c3d429ddcee, user.id=6cd7f45a3461442b918c132a09ca1276) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:48.019000 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9457e10-2011-41ab-bce1-82b1cf262e82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:48.020443 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9457e10-2011-41ab-bce1-82b1cf262e82 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:48.032982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 102/208] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:03:47 2022] GET /identity/v3/role_assignments?user.id=6cd7f45a3461442b918c132a09ca1276&scope.project.id=878eddd0b05c4cc382e41c3d429ddcee&role.id=4d86c48385634483af68ab63e48f9787 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:48.620844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371246c-5052-4c3a-b504-70bcd05afbfa None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:48.621459 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371246c-5052-4c3a-b504-70bcd05afbfa None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:48.621459 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371246c-5052-4c3a-b504-70bcd05afbfa None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:48.624074 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 107/209] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:48.628459 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9801c-fecf-4e5c-b79e-004b74aed9c9 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:48.628754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9801c-fecf-4e5c-b79e-004b74aed9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:48.629037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9801c-fecf-4e5c-b79e-004b74aed9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:48.648902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-cfb9801c-fecf-4e5c-b79e-004b74aed9c9 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:48.650633 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-cfb9801c-fecf-4e5c-b79e-004b74aed9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:48.721619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 103/210] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:48.737392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883aa89-1256-4e13-a4bb-1c8f61163d8c None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:48.737686 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883aa89-1256-4e13-a4bb-1c8f61163d8c None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:48.737968 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883aa89-1256-4e13-a4bb-1c8f61163d8c None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:48.739507 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 108/211] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:48.746697 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9745870-6704-4299-9f44-1154590acf43 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:48.746697 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9745870-6704-4299-9f44-1154590acf43 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:48.746697 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9745870-6704-4299-9f44-1154590acf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:48.751287 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883aa89-1256-4e13-a4bb-1c8f61163d8c None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:48.764469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-f9745870-6704-4299-9f44-1154590acf43 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:48.766265 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-f9745870-6704-4299-9f44-1154590acf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:48.805334 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:48.843973 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 104/212] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:48.863523 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883aa89-1256-4e13-a4bb-1c8f61163d8c None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:48.871319 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9745870-6704-4299-9f44-1154590acf43 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:48.902164 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3e52e-d483-473b-902f-d4c48dfbd62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:48.902927 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3e52e-d483-473b-902f-d4c48dfbd62f None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:48.903210 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3e52e-d483-473b-902f-d4c48dfbd62f None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:48.903542 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3e52e-d483-473b-902f-d4c48dfbd62f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:48.905087 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3e52e-d483-473b-902f-d4c48dfbd62f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:48.919013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3e52e-d483-473b-902f-d4c48dfbd62f None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:48.920830 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 109/213] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:03:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:48.926641 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3e52e-d483-473b-902f-d4c48dfbd62f None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:48.934028 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:48.989271 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9745870-6704-4299-9f44-1154590acf43 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:49.026061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc54b24-08ff-4f81-953b-a2a651bbd4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:49.027253 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc54b24-08ff-4f81-953b-a2a651bbd4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:49.027752 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc54b24-08ff-4f81-953b-a2a651bbd4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:49.028209 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc54b24-08ff-4f81-953b-a2a651bbd4b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:49.039721 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3e52e-d483-473b-902f-d4c48dfbd62f None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:49.040158 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc54b24-08ff-4f81-953b-a2a651bbd4b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:49.042443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:49.048876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-cbc54b24-08ff-4f81-953b-a2a651bbd4b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:03:49.048876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:49.048876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:49.048876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:49.048876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:49.048876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:49.048876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:49.048876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:49.048876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:49.048876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:49.048876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:49.048876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:49.048876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:49.048876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:49.048876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:49.048876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:49.049831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:49.049831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:49.049831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:49.049831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:49.049831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:49.049831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:49.049831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:49.049831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:49.049831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:49.049831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:49.049831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:49.049831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:49.049831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:49.049831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:49.049831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:49.049831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:49.050664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:49.050664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:49.050664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:49.050664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:49.050664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:49.050664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:49.050664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:49.050664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:49.050664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:49.050664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:49.050664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:03:49.050664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:03:49.052722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 105/214] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:03:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:03:49.058547 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc54b24-08ff-4f81-953b-a2a651bbd4b3 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:49.077819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3bc11f-0851-45aa-9722-706156732dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:49.078557 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bc11f-0851-45aa-9722-706156732dde None admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:49.078844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bc11f-0851-45aa-9722-706156732dde None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:49.079124 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bc11f-0851-45aa-9722-706156732dde None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:49.079958 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3bc11f-0851-45aa-9722-706156732dde None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:49.081685 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3bc11f-0851-45aa-9722-706156732dde None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:49.106425 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 110/215] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Jul 12 13:03:48 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:03:49.189626 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc54b24-08ff-4f81-953b-a2a651bbd4b3 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:49.201287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:49.232341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807c25a-56f3-447f-85bb-90ce911ac966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:49.233406 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807c25a-56f3-447f-85bb-90ce911ac966 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:49.233881 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807c25a-56f3-447f-85bb-90ce911ac966 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:49.234402 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807c25a-56f3-447f-85bb-90ce911ac966 None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:49.235403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807c25a-56f3-447f-85bb-90ce911ac966 None admin] RBAC: Adding query filter params (name=member) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:49.235908 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807c25a-56f3-447f-85bb-90ce911ac966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:49.237549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807c25a-56f3-447f-85bb-90ce911ac966 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:49.247950 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 106/216] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:03:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:49.253938 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3bc11f-0851-45aa-9722-706156732dde None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:49.377761 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3bc11f-0851-45aa-9722-706156732dde None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:49.405060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442ab22-5afa-4c42-8dd8-e585ec12bcb5 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:49.405832 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442ab22-5afa-4c42-8dd8-e585ec12bcb5 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:49.406440 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442ab22-5afa-4c42-8dd8-e585ec12bcb5 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:49.408388 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 107/217] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:03:49.423903 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8caca08-519b-4d3d-bf1a-94a4effa901c None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:49.425903 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8caca08-519b-4d3d-bf1a-94a4effa901c None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:49.426527 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8caca08-519b-4d3d-bf1a-94a4effa901c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:49.428126 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62faaad1-0b80-4001-9519-8bdd7a9f91c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:49.429024 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62faaad1-0b80-4001-9519-8bdd7a9f91c3 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:49.429512 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62faaad1-0b80-4001-9519-8bdd7a9f91c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:49.429671 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62faaad1-0b80-4001-9519-8bdd7a9f91c3 None admin] PATH_INFO: `/v3/users/b7b6ffbe46c64d1a86f5d723acfc6f9a` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:49.451555 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62faaad1-0b80-4001-9519-8bdd7a9f91c3 None admin] RBAC: Authorizing `identity:get_user(user_id=b7b6ffbe46c64d1a86f5d723acfc6f9a)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:49.453071 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62faaad1-0b80-4001-9519-8bdd7a9f91c3 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:49.455171 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 111/218] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:49 2022] GET /identity/v3/users/b7b6ffbe46c64d1a86f5d723acfc6f9a => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:49.455676 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-d8caca08-519b-4d3d-bf1a-94a4effa901c None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:49.457523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-d8caca08-519b-4d3d-bf1a-94a4effa901c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:49.460792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62faaad1-0b80-4001-9519-8bdd7a9f91c3 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:49.488305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:49.550328 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 108/219] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:03:49.573363 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8caca08-519b-4d3d-bf1a-94a4effa901c None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:49.586076 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62faaad1-0b80-4001-9519-8bdd7a9f91c3 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:49.631206 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6691d-e762-4bd8-9264-9872c7e5842e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:49.631967 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6691d-e762-4bd8-9264-9872c7e5842e None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:49.632137 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6691d-e762-4bd8-9264-9872c7e5842e None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:49.632419 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6691d-e762-4bd8-9264-9872c7e5842e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:49.707859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6691d-e762-4bd8-9264-9872c7e5842e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:49.709616 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6691d-e762-4bd8-9264-9872c7e5842e None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:49.737038 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:49.799209 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:49.804331 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8caca08-519b-4d3d-bf1a-94a4effa901c None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:49.831158 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 112/220] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:03:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 13:03:49.839235 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6691d-e762-4bd8-9264-9872c7e5842e None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:49.862939 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e3c3d-37c4-453d-b606-f0904fa67a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:49.863667 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e3c3d-37c4-453d-b606-f0904fa67a24 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:49.863956 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e3c3d-37c4-453d-b606-f0904fa67a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:49.864239 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e3c3d-37c4-453d-b606-f0904fa67a24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:49.893261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e3c3d-37c4-453d-b606-f0904fa67a24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:49.901532 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-1d6e3c3d-37c4-453d-b606-f0904fa67a24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:03:49.901532 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:49.901532 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:49.901532 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:49.901532 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:49.901532 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:49.901532 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:49.901532 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:49.901532 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:49.901532 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:49.901532 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:49.901532 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:49.901532 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:49.901532 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:49.901532 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:49.901532 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:49.902481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:49.902481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:49.902481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:49.902481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:49.902481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:49.902481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:49.902481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:49.902481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:49.902481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:49.902481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:49.902481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:49.902481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:49.902481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:49.902481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:49.902481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:49.902481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:49.903314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:49.903314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:49.903314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:49.903314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:49.903314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:49.903314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:49.903314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:49.903314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:49.903314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:49.903314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:49.903314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:03:49.903314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:03:49.914648 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 109/221] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:03:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:03:49.929181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e3c3d-37c4-453d-b606-f0904fa67a24 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:49.985969 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6691d-e762-4bd8-9264-9872c7e5842e None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:50.025262 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:50.050968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e3c3d-37c4-453d-b606-f0904fa67a24 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:50.078885 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5421c-a7e9-4c49-8798-fad9e6dfd93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:50.079907 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5421c-a7e9-4c49-8798-fad9e6dfd93a None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:50.080245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5421c-a7e9-4c49-8798-fad9e6dfd93a None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:50.080560 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5421c-a7e9-4c49-8798-fad9e6dfd93a None admin] PATH_INFO: `/v3/projects/878eddd0b05c4cc382e41c3d429ddcee` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:50.085842 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052f9bf-7458-4f1a-aa2a-90ee0257b274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:50.086641 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052f9bf-7458-4f1a-aa2a-90ee0257b274 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:50.086931 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052f9bf-7458-4f1a-aa2a-90ee0257b274 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:50.087036 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5421c-a7e9-4c49-8798-fad9e6dfd93a None admin] RBAC: Authorizing `identity:get_project(project_id=878eddd0b05c4cc382e41c3d429ddcee)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:50.087241 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052f9bf-7458-4f1a-aa2a-90ee0257b274 None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:50.088003 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052f9bf-7458-4f1a-aa2a-90ee0257b274 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:50.088314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052f9bf-7458-4f1a-aa2a-90ee0257b274 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:50.088736 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5421c-a7e9-4c49-8798-fad9e6dfd93a None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:50.089690 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052f9bf-7458-4f1a-aa2a-90ee0257b274 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:50.090853 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 113/222] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:03:49 2022] GET /identity/v3/projects/878eddd0b05c4cc382e41c3d429ddcee => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:50.097540 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5421c-a7e9-4c49-8798-fad9e6dfd93a None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:50.098614 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 110/223] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:03:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:50.108136 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052f9bf-7458-4f1a-aa2a-90ee0257b274 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:50.162484 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:50.277266 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052f9bf-7458-4f1a-aa2a-90ee0257b274 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:50.307352 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5421c-a7e9-4c49-8798-fad9e6dfd93a None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:50.319459 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55597c1c-8e7e-40f0-acb7-9bd8dbeb31df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:50.320465 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55597c1c-8e7e-40f0-acb7-9bd8dbeb31df None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:50.320844 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55597c1c-8e7e-40f0-acb7-9bd8dbeb31df None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:50.321214 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55597c1c-8e7e-40f0-acb7-9bd8dbeb31df None admin] PATH_INFO: `/v3/users/6cd7f45a3461442b918c132a09ca1276` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:50.323129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55597c1c-8e7e-40f0-acb7-9bd8dbeb31df None admin] RBAC: Authorizing `identity:get_user(user_id=6cd7f45a3461442b918c132a09ca1276)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:50.324671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55597c1c-8e7e-40f0-acb7-9bd8dbeb31df None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:50.326488 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 111/224] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:50 2022] GET /identity/v3/users/6cd7f45a3461442b918c132a09ca1276 => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:50.331515 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7aee7-cc97-49f2-8a2b-91c3e12bdd0a None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:50.331873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7aee7-cc97-49f2-8a2b-91c3e12bdd0a None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:50.332245 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7aee7-cc97-49f2-8a2b-91c3e12bdd0a None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:50.333586 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 112/225] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:50.335736 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7aee7-cc97-49f2-8a2b-91c3e12bdd0a None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:50.352013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947189d-24d3-4fe0-9d27-7b6c8341b87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:50.353656 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947189d-24d3-4fe0-9d27-7b6c8341b87b None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:50.354241 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947189d-24d3-4fe0-9d27-7b6c8341b87b None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:50.354529 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947189d-24d3-4fe0-9d27-7b6c8341b87b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:50.355624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947189d-24d3-4fe0-9d27-7b6c8341b87b None admin] RBAC: Adding query filter params (role.id=1727bdbc17d94ff08782d404dce97d35, scope.project.id=878eddd0b05c4cc382e41c3d429ddcee, user.id=b7b6ffbe46c64d1a86f5d723acfc6f9a) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:50.355946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947189d-24d3-4fe0-9d27-7b6c8341b87b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:50.357815 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947189d-24d3-4fe0-9d27-7b6c8341b87b None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:50.365276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 114/226] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:03:50 2022] GET /identity/v3/role_assignments?user.id=b7b6ffbe46c64d1a86f5d723acfc6f9a&scope.project.id=878eddd0b05c4cc382e41c3d429ddcee&role.id=1727bdbc17d94ff08782d404dce97d35 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:50.366630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179911a-6d65-41de-bf84-f7d7583ae204 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:50.366925 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179911a-6d65-41de-bf84-f7d7583ae204 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:50.367209 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179911a-6d65-41de-bf84-f7d7583ae204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:50.387850 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-3179911a-6d65-41de-bf84-f7d7583ae204 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:50.389390 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-3179911a-6d65-41de-bf84-f7d7583ae204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:50.468620 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:50.502522 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 115/227] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:50.529383 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179911a-6d65-41de-bf84-f7d7583ae204 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:50.530276 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:50.563829 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7aee7-cc97-49f2-8a2b-91c3e12bdd0a None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:50.607059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf46f31-d217-442b-85d7-84ef226f5c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:50.607956 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf46f31-d217-442b-85d7-84ef226f5c8d None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:50.608241 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf46f31-d217-442b-85d7-84ef226f5c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:50.608519 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf46f31-d217-442b-85d7-84ef226f5c8d None admin] PATH_INFO: `/v3/projects/878eddd0b05c4cc382e41c3d429ddcee` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:50.609745 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf46f31-d217-442b-85d7-84ef226f5c8d None admin] RBAC: Authorizing `identity:get_project(project_id=878eddd0b05c4cc382e41c3d429ddcee)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:50.611353 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf46f31-d217-442b-85d7-84ef226f5c8d None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:50.618219 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 113/228] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:03:50 2022] GET /identity/v3/projects/878eddd0b05c4cc382e41c3d429ddcee => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:50.620099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf46f31-d217-442b-85d7-84ef226f5c8d None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:50.671798 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179911a-6d65-41de-bf84-f7d7583ae204 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:50.740981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa39c2-66d7-445f-b7f5-ca44864f809a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:50.742561 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa39c2-66d7-445f-b7f5-ca44864f809a None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:50.743064 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa39c2-66d7-445f-b7f5-ca44864f809a None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:50.744184 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa39c2-66d7-445f-b7f5-ca44864f809a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:50.776738 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa39c2-66d7-445f-b7f5-ca44864f809a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:50.802851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-c8fa39c2-66d7-445f-b7f5-ca44864f809a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:03:50.802851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:50.802851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:50.802851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:50.802851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:50.802851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:50.802851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:50.802851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:50.802851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:50.802851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:50.802851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:50.802851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:50.802851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:50.802851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:50.802851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:50.802851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:50.804161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:50.804161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:50.804161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:50.804161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:50.804161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:50.804161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:50.804161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:50.804161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:50.804161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:50.804161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:50.804161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:50.804161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:50.804161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:50.804161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:50.804161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:50.804161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:50.805273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:50.805273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:50.805273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:50.805273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:50.805273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:50.805273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:50.805273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:50.805273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:50.805273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:50.805273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:50.805273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:03:50.805273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:03:50.808242 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 116/229] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Jul 12 13:03:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:03:50.824962 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa39c2-66d7-445f-b7f5-ca44864f809a None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:50.873385 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf46f31-d217-442b-85d7-84ef226f5c8d None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:50.898501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:50.960871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa39c2-66d7-445f-b7f5-ca44864f809a None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:50.998408 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950f671-91cc-489f-9221-8e4b7675a54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:50.998648 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba23382-a128-4915-9163-7210846c139f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:50.999418 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba23382-a128-4915-9163-7210846c139f None admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:50.999627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950f671-91cc-489f-9221-8e4b7675a54e None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:50.999745 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba23382-a128-4915-9163-7210846c139f None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:50.999965 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba23382-a128-4915-9163-7210846c139f None admin] PATH_INFO: `/v3/projects/878eddd0b05c4cc382e41c3d429ddcee/users/6cd7f45a3461442b918c132a09ca1276/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:51.000292 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950f671-91cc-489f-9221-8e4b7675a54e None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:51.000707 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950f671-91cc-489f-9221-8e4b7675a54e None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:51.001596 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950f671-91cc-489f-9221-8e4b7675a54e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:51.001949 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba23382-a128-4915-9163-7210846c139f None admin] RBAC: Authorizing `identity:create_grant(project_id=878eddd0b05c4cc382e41c3d429ddcee, user_id=6cd7f45a3461442b918c132a09ca1276, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:51.002260 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950f671-91cc-489f-9221-8e4b7675a54e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:51.003621 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba23382-a128-4915-9163-7210846c139f None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:51.004084 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950f671-91cc-489f-9221-8e4b7675a54e None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:51.014353 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 117/230] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:03:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:51.022144 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950f671-91cc-489f-9221-8e4b7675a54e None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:51.049211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 114/231] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Jul 12 13:03:50 2022] PUT /identity/v3/projects/878eddd0b05c4cc382e41c3d429ddcee/users/6cd7f45a3461442b918c132a09ca1276/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:03:51.146341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950f671-91cc-489f-9221-8e4b7675a54e None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:51.147937 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:51.205854 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65dfc17-79db-4a63-85e7-f58c23e0ba91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:51.207307 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65dfc17-79db-4a63-85e7-f58c23e0ba91 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:51.207769 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65dfc17-79db-4a63-85e7-f58c23e0ba91 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:51.208218 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65dfc17-79db-4a63-85e7-f58c23e0ba91 None admin] PATH_INFO: `/v3/users/6cd7f45a3461442b918c132a09ca1276` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:51.215568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65dfc17-79db-4a63-85e7-f58c23e0ba91 None admin] RBAC: Authorizing `identity:get_user(user_id=6cd7f45a3461442b918c132a09ca1276)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:51.218047 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65dfc17-79db-4a63-85e7-f58c23e0ba91 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:51.220942 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 118/232] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:51 2022] GET /identity/v3/users/6cd7f45a3461442b918c132a09ca1276 => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:51.227002 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba23382-a128-4915-9163-7210846c139f None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:51.262028 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:51.388580 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba23382-a128-4915-9163-7210846c139f None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:51.426394 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756b9ae-b316-4b5d-9f08-f67ae1e002c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:51.427200 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756b9ae-b316-4b5d-9f08-f67ae1e002c2 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:51.427486 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756b9ae-b316-4b5d-9f08-f67ae1e002c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:51.427766 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756b9ae-b316-4b5d-9f08-f67ae1e002c2 None admin] PATH_INFO: `/v3/projects/878eddd0b05c4cc382e41c3d429ddcee` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:51.429077 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756b9ae-b316-4b5d-9f08-f67ae1e002c2 None admin] RBAC: Authorizing `identity:get_project(project_id=878eddd0b05c4cc382e41c3d429ddcee)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:51.430569 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756b9ae-b316-4b5d-9f08-f67ae1e002c2 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:51.433013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 115/233] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:03:51 2022] GET /identity/v3/projects/878eddd0b05c4cc382e41c3d429ddcee => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:51.438515 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65dfc17-79db-4a63-85e7-f58c23e0ba91 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:51.565101 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65dfc17-79db-4a63-85e7-f58c23e0ba91 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:51.606142 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc243ff-af40-4013-a97f-495e9ce30d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:51.607059 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc243ff-af40-4013-a97f-495e9ce30d00 None admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:51.607347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc243ff-af40-4013-a97f-495e9ce30d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:51.607630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc243ff-af40-4013-a97f-495e9ce30d00 None admin] PATH_INFO: `/v3/projects/878eddd0b05c4cc382e41c3d429ddcee/users/6cd7f45a3461442b918c132a09ca1276/roles/4d86c48385634483af68ab63e48f9787` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:51.609906 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc243ff-af40-4013-a97f-495e9ce30d00 None admin] RBAC: Authorizing `identity:create_grant(project_id=878eddd0b05c4cc382e41c3d429ddcee, user_id=6cd7f45a3461442b918c132a09ca1276, role_id=4d86c48385634483af68ab63e48f9787)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:51.611417 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc243ff-af40-4013-a97f-495e9ce30d00 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:51.629126 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 119/234] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Jul 12 13:03:51 2022] PUT /identity/v3/projects/878eddd0b05c4cc382e41c3d429ddcee/users/6cd7f45a3461442b918c132a09ca1276/roles/4d86c48385634483af68ab63e48f9787 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:03:51.849064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceac49a-87da-4744-9c22-98ad05c93c7d None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:51.849430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceac49a-87da-4744-9c22-98ad05c93c7d None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:51.849624 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceac49a-87da-4744-9c22-98ad05c93c7d None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:51.851038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 116/235] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:51.859471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa082adb-4724-4a9c-a755-7b60281ce20e None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:51.859962 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa082adb-4724-4a9c-a755-7b60281ce20e None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:51.860040 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa082adb-4724-4a9c-a755-7b60281ce20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:51.878628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-fa082adb-4724-4a9c-a755-7b60281ce20e None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:51.879829 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-fa082adb-4724-4a9c-a755-7b60281ce20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:51.906065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:51.964976 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 120/236] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:51.988767 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddfb20-738a-4d17-ab3f-8acbf1542451 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:51.989285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddfb20-738a-4d17-ab3f-8acbf1542451 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:51.989362 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddfb20-738a-4d17-ab3f-8acbf1542451 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:51.990865 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 117/237] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:51.995877 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3f852-43c7-4a1f-bf64-421bf9936c1c None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:51.996176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3f852-43c7-4a1f-bf64-421bf9936c1c None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:51.996463 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3f852-43c7-4a1f-bf64-421bf9936c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:52.017562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-15c3f852-43c7-4a1f-bf64-421bf9936c1c None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:52.017741 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddfb20-738a-4d17-ab3f-8acbf1542451 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:52.019413 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-15c3f852-43c7-4a1f-bf64-421bf9936c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:52.143043 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 121/238] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:52.175889 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddfb20-738a-4d17-ab3f-8acbf1542451 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:52.180621 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3f852-43c7-4a1f-bf64-421bf9936c1c None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:52.194518 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:52.249741 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda1f07-9785-4e06-9e3c-26debd6a3c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:52.250998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda1f07-9785-4e06-9e3c-26debd6a3c3a None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:52.251497 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda1f07-9785-4e06-9e3c-26debd6a3c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:52.252084 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda1f07-9785-4e06-9e3c-26debd6a3c3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:52.254312 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda1f07-9785-4e06-9e3c-26debd6a3c3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:52.255983 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda1f07-9785-4e06-9e3c-26debd6a3c3a None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:52.258869 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 118/239] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:03:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:52.267052 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda1f07-9785-4e06-9e3c-26debd6a3c3a None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:52.322281 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:52.332268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3f852-43c7-4a1f-bf64-421bf9936c1c None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:52.373513 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fd27d-b7ee-44c9-a651-27cd32b38e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:52.374376 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fd27d-b7ee-44c9-a651-27cd32b38e66 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:52.374664 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fd27d-b7ee-44c9-a651-27cd32b38e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:52.374947 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fd27d-b7ee-44c9-a651-27cd32b38e66 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:52.388008 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fd27d-b7ee-44c9-a651-27cd32b38e66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:52.397528 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-8d5fd27d-b7ee-44c9-a651-27cd32b38e66 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:03:52.397528 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:52.397528 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:52.397528 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:52.397528 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:52.397528 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:52.397528 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:52.397528 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:52.397528 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:52.397528 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:52.397528 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:52.397528 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:52.397528 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:52.397528 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:52.397528 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:52.397528 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:52.398490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:52.398490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:52.398490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:52.398490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:52.398490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:52.398490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:52.398490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:52.398490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:52.398490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:52.398490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:52.398490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:52.398490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:52.398490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:52.398490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:52.398490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:52.398490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:52.399284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:52.399284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:52.399284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:52.399284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:52.399284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:52.399284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:52.399284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:52.399284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:52.399284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:52.399284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:52.399284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:03:52.399284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:03:52.399284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 122/240] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:03:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:03:52.405971 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fd27d-b7ee-44c9-a651-27cd32b38e66 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:52.467821 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda1f07-9785-4e06-9e3c-26debd6a3c3a None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:52.506897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72693d8b-8015-427f-a219-da1fd64c526b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:52.507997 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72693d8b-8015-427f-a219-da1fd64c526b None admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:52.508290 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72693d8b-8015-427f-a219-da1fd64c526b None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:52.508569 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72693d8b-8015-427f-a219-da1fd64c526b None admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:52.509926 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72693d8b-8015-427f-a219-da1fd64c526b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:52.511901 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72693d8b-8015-427f-a219-da1fd64c526b None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:52.545205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 119/241] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Jul 12 13:03:52 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:03:52.616882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fd27d-b7ee-44c9-a651-27cd32b38e66 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:52.662144 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5b41a-6978-4610-b3a0-1bc81c71ee13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:52.662920 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5b41a-6978-4610-b3a0-1bc81c71ee13 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:52.663209 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5b41a-6978-4610-b3a0-1bc81c71ee13 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:52.663489 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5b41a-6978-4610-b3a0-1bc81c71ee13 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:52.664275 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5b41a-6978-4610-b3a0-1bc81c71ee13 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:52.664584 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5b41a-6978-4610-b3a0-1bc81c71ee13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:52.666665 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5b41a-6978-4610-b3a0-1bc81c71ee13 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:52.677142 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 123/242] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:03:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:52.690238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72693d8b-8015-427f-a219-da1fd64c526b None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:52.693018 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161f767-dded-43e8-864f-0af693835d9d None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:52.693317 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161f767-dded-43e8-864f-0af693835d9d None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:52.693809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161f767-dded-43e8-864f-0af693835d9d None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:52.695365 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 124/243] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:52.701773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75433b10-f5a3-421c-9df5-f18535b34859 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:52.702068 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75433b10-f5a3-421c-9df5-f18535b34859 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:52.702373 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75433b10-f5a3-421c-9df5-f18535b34859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:52.721556 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:52.734236 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-75433b10-f5a3-421c-9df5-f18535b34859 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:52.735471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-75433b10-f5a3-421c-9df5-f18535b34859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:52.754752 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:52.866639 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 125/244] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:03:52.883731 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72693d8b-8015-427f-a219-da1fd64c526b None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:52.895756 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75433b10-f5a3-421c-9df5-f18535b34859 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:52.939132 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77672887-99b8-44a6-b5f7-ae165f0e3661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:52.941389 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77672887-99b8-44a6-b5f7-ae165f0e3661 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:52.942064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77672887-99b8-44a6-b5f7-ae165f0e3661 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:52.942575 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77672887-99b8-44a6-b5f7-ae165f0e3661 None admin] PATH_INFO: `/v3/users/cf7fca8496e741fc95b0921de3cc6492` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:52.973383 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77672887-99b8-44a6-b5f7-ae165f0e3661 None admin] RBAC: Authorizing `identity:get_user(user_id=cf7fca8496e741fc95b0921de3cc6492)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:52.975550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77672887-99b8-44a6-b5f7-ae165f0e3661 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:52.978356 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 120/245] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:52 2022] GET /identity/v3/users/cf7fca8496e741fc95b0921de3cc6492 => generated 297 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:52.985183 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77672887-99b8-44a6-b5f7-ae165f0e3661 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:53.045040 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75433b10-f5a3-421c-9df5-f18535b34859 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:53.101343 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:53.105534 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6b291-f901-487e-9ab1-5b887c63b8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:53.106557 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6b291-f901-487e-9ab1-5b887c63b8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:53.106947 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6b291-f901-487e-9ab1-5b887c63b8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:53.107407 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6b291-f901-487e-9ab1-5b887c63b8b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:53.126836 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6b291-f901-487e-9ab1-5b887c63b8b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:53.137823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-1df6b291-f901-487e-9ab1-5b887c63b8b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:03:53.137823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:53.137823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:53.137823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:53.137823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:53.137823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:53.137823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:53.137823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:53.137823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:53.137823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:53.137823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:53.137823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:53.137823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:53.137823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:53.137823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:53.137823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:53.138843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:53.138843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:53.138843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:53.138843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:53.138843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:53.138843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:53.138843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:53.138843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:53.138843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:53.138843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:53.138843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:53.138843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:53.138843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:53.138843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:53.138843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:53.138843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:53.139649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:53.139649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:53.139649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:53.139649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:53.139649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:53.139649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:53.139649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:53.139649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:53.139649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:53.139649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:53.139649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:03:53.139649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:03:53.143115 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 126/246] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:03:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:03:53.149394 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6b291-f901-487e-9ab1-5b887c63b8b7 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:53.156548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:53.164362 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77672887-99b8-44a6-b5f7-ae165f0e3661 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:53.210980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a902d-e2e7-45b2-8c5a-852c58cd489c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:53.212641 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a902d-e2e7-45b2-8c5a-852c58cd489c None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:53.213529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a902d-e2e7-45b2-8c5a-852c58cd489c None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:53.214219 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a902d-e2e7-45b2-8c5a-852c58cd489c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:53.308120 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6b291-f901-487e-9ab1-5b887c63b8b7 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:53.332240 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a902d-e2e7-45b2-8c5a-852c58cd489c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:53.334896 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a902d-e2e7-45b2-8c5a-852c58cd489c None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:53.406947 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1639751-2b14-4be3-a20c-ed7817ae399b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:53.407571 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1639751-2b14-4be3-a20c-ed7817ae399b None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:53.407863 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1639751-2b14-4be3-a20c-ed7817ae399b None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:53.408152 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1639751-2b14-4be3-a20c-ed7817ae399b None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:53.409038 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1639751-2b14-4be3-a20c-ed7817ae399b None admin] RBAC: Adding query filter params (name=member) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:53.409318 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1639751-2b14-4be3-a20c-ed7817ae399b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:53.410773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1639751-2b14-4be3-a20c-ed7817ae399b None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:53.424788 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 127/247] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:03:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:53.425981 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:53.431702 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1639751-2b14-4be3-a20c-ed7817ae399b None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:53.493385 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 121/248] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:03:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 13:03:53.499324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a902d-e2e7-45b2-8c5a-852c58cd489c None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:53.595619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:53.720256 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1639751-2b14-4be3-a20c-ed7817ae399b None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:53.760152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a902d-e2e7-45b2-8c5a-852c58cd489c None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:53.799871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e157968-0940-4008-8214-d22ddfbe74a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:53.800888 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e157968-0940-4008-8214-d22ddfbe74a0 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:53.801182 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e157968-0940-4008-8214-d22ddfbe74a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:53.801516 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e157968-0940-4008-8214-d22ddfbe74a0 None admin] PATH_INFO: `/v3/users/b7b6ffbe46c64d1a86f5d723acfc6f9a` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:53.803026 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e157968-0940-4008-8214-d22ddfbe74a0 None admin] RBAC: Authorizing `identity:get_user(user_id=b7b6ffbe46c64d1a86f5d723acfc6f9a)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:53.804618 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e157968-0940-4008-8214-d22ddfbe74a0 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:53.815266 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 128/249] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:53 2022] GET /identity/v3/users/b7b6ffbe46c64d1a86f5d723acfc6f9a => generated 297 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:53.821092 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e157968-0940-4008-8214-d22ddfbe74a0 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:53.847876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492974df-c7a4-4c1b-b2fd-2813f5aeb028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:53.848767 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492974df-c7a4-4c1b-b2fd-2813f5aeb028 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:53.849058 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492974df-c7a4-4c1b-b2fd-2813f5aeb028 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:53.849337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492974df-c7a4-4c1b-b2fd-2813f5aeb028 None admin] PATH_INFO: `/v3/projects/878eddd0b05c4cc382e41c3d429ddcee` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:53.850671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492974df-c7a4-4c1b-b2fd-2813f5aeb028 None admin] RBAC: Authorizing `identity:get_project(project_id=878eddd0b05c4cc382e41c3d429ddcee)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:53.852152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492974df-c7a4-4c1b-b2fd-2813f5aeb028 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:53.855291 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 122/250] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:03:53 2022] GET /identity/v3/projects/878eddd0b05c4cc382e41c3d429ddcee => generated 302 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:53.859684 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131a9ee-871d-42b5-882a-45e8d3e52779 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:53.859977 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131a9ee-871d-42b5-882a-45e8d3e52779 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:53.860265 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131a9ee-871d-42b5-882a-45e8d3e52779 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:53.861618 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 123/251] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:53.863541 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131a9ee-871d-42b5-882a-45e8d3e52779 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:53.958550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:53.997593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e157968-0940-4008-8214-d22ddfbe74a0 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:54.033899 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:54.040946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d8fcf-ef8a-47dc-9d11-8cec72be71ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:54.041835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d8fcf-ef8a-47dc-9d11-8cec72be71ae None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:54.042145 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d8fcf-ef8a-47dc-9d11-8cec72be71ae None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:54.042430 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d8fcf-ef8a-47dc-9d11-8cec72be71ae None admin] PATH_INFO: `/v3/projects/878eddd0b05c4cc382e41c3d429ddcee` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:54.044136 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d8fcf-ef8a-47dc-9d11-8cec72be71ae None admin] RBAC: Authorizing `identity:get_project(project_id=878eddd0b05c4cc382e41c3d429ddcee)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:54.045609 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d8fcf-ef8a-47dc-9d11-8cec72be71ae None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:54.047366 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 129/252] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:03:53 2022] GET /identity/v3/projects/878eddd0b05c4cc382e41c3d429ddcee => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:54.048547 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3ecc3-0e89-4c53-8155-1d0a3d1a3227 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:54.048837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3ecc3-0e89-4c53-8155-1d0a3d1a3227 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:54.049123 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3ecc3-0e89-4c53-8155-1d0a3d1a3227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:54.066532 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-2df3ecc3-0e89-4c53-8155-1d0a3d1a3227 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:54.067734 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-2df3ecc3-0e89-4c53-8155-1d0a3d1a3227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:54.078817 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131a9ee-871d-42b5-882a-45e8d3e52779 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:54.141846 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 130/253] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:54.142729 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3ecc3-0e89-4c53-8155-1d0a3d1a3227 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:54.187407 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252aed3-1267-49c5-829f-b4f39fd4ccd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:54.188094 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252aed3-1267-49c5-829f-b4f39fd4ccd5 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:54.188382 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252aed3-1267-49c5-829f-b4f39fd4ccd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:54.188663 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252aed3-1267-49c5-829f-b4f39fd4ccd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:54.189517 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252aed3-1267-49c5-829f-b4f39fd4ccd5 None admin] RBAC: Adding query filter params (role.id=ef9c44b998b048b0a8db160073bc0e6f, scope.project.id=878eddd0b05c4cc382e41c3d429ddcee, user.id=cf7fca8496e741fc95b0921de3cc6492) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:54.189832 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252aed3-1267-49c5-829f-b4f39fd4ccd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:54.191320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252aed3-1267-49c5-829f-b4f39fd4ccd5 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:54.210384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 124/254] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:03:53 2022] GET /identity/v3/role_assignments?user.id=cf7fca8496e741fc95b0921de3cc6492&scope.project.id=878eddd0b05c4cc382e41c3d429ddcee&role.id=ef9c44b998b048b0a8db160073bc0e6f => generated 259 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:54.214688 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252aed3-1267-49c5-829f-b4f39fd4ccd5 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:54.309431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3ecc3-0e89-4c53-8155-1d0a3d1a3227 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:54.360213 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:54.369575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c761c-66a5-4e97-8ff9-a122f3004d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:54.370949 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c761c-66a5-4e97-8ff9-a122f3004d7d None admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:54.371473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c761c-66a5-4e97-8ff9-a122f3004d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:54.372008 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c761c-66a5-4e97-8ff9-a122f3004d7d None admin] PATH_INFO: `/v3/projects/878eddd0b05c4cc382e41c3d429ddcee/users/b7b6ffbe46c64d1a86f5d723acfc6f9a/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:54.374419 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c761c-66a5-4e97-8ff9-a122f3004d7d None admin] RBAC: Authorizing `identity:create_grant(project_id=878eddd0b05c4cc382e41c3d429ddcee, user_id=b7b6ffbe46c64d1a86f5d723acfc6f9a, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:54.376143 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c761c-66a5-4e97-8ff9-a122f3004d7d None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:54.408543 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 131/255] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Jul 12 13:03:54 2022] PUT /identity/v3/projects/878eddd0b05c4cc382e41c3d429ddcee/users/b7b6ffbe46c64d1a86f5d723acfc6f9a/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:03:54.410282 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4aead8-f7e4-4347-909c-5d083b374934 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:54.410786 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4aead8-f7e4-4347-909c-5d083b374934 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:54.411278 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4aead8-f7e4-4347-909c-5d083b374934 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:54.412961 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 132/256] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:54.418949 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252aed3-1267-49c5-829f-b4f39fd4ccd5 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:54.442657 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:54.459803 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710bcb0-b318-43a4-a77d-83347f9be2d2 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:54.460496 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710bcb0-b318-43a4-a77d-83347f9be2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:54.460978 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710bcb0-b318-43a4-a77d-83347f9be2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:54.483239 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37778271-149e-42b1-aeae-3c53608bf2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:54.484461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37778271-149e-42b1-aeae-3c53608bf2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:54.486183 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37778271-149e-42b1-aeae-3c53608bf2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:54.486696 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37778271-149e-42b1-aeae-3c53608bf2e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:54.505985 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-6710bcb0-b318-43a4-a77d-83347f9be2d2 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:54.508391 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-6710bcb0-b318-43a4-a77d-83347f9be2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:54.515369 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37778271-149e-42b1-aeae-3c53608bf2e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:54.532128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-37778271-149e-42b1-aeae-3c53608bf2e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:03:54.532128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:54.532128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:54.532128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:54.532128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:54.532128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:54.532128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:54.532128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:54.532128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:54.532128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:54.532128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:54.532128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:54.532128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:54.532128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:54.532128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:54.532128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:54.533086 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:54.533086 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:54.533086 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:54.533086 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:54.533086 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:54.533086 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:54.533086 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:54.533086 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:54.533086 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:54.533086 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:54.533086 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:54.533086 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:54.533086 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:54.533086 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:54.533086 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:54.533086 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:54.533885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:54.533885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:54.533885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:54.533885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:54.533885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:54.533885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:54.533885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:54.533885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:54.533885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:54.533885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:54.533885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:03:54.533885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:03:54.538489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 125/257] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:03:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:03:54.546205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37778271-149e-42b1-aeae-3c53608bf2e1 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:54.688922 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 133/258] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:54.726662 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37778271-149e-42b1-aeae-3c53608bf2e1 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:54.730721 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710bcb0-b318-43a4-a77d-83347f9be2d2 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:54.766807 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e5531-e649-4d75-87b8-8ee4665ed801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:54.767859 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e5531-e649-4d75-87b8-8ee4665ed801 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:54.768349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e5531-e649-4d75-87b8-8ee4665ed801 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:54.768841 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e5531-e649-4d75-87b8-8ee4665ed801 None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:54.769847 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7e5531-e649-4d75-87b8-8ee4665ed801 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:54.770414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7e5531-e649-4d75-87b8-8ee4665ed801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:54.772013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7e5531-e649-4d75-87b8-8ee4665ed801 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:54.782282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 126/259] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:03:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:54.787660 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e5531-e649-4d75-87b8-8ee4665ed801 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:54.838502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:54.926257 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e5531-e649-4d75-87b8-8ee4665ed801 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:54.962333 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6552dd-74c6-4902-a867-471b8f4b9dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:54.963478 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6552dd-74c6-4902-a867-471b8f4b9dfe None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:54.963870 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6552dd-74c6-4902-a867-471b8f4b9dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:54.964252 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6552dd-74c6-4902-a867-471b8f4b9dfe None admin] PATH_INFO: `/v3/users/6cd7f45a3461442b918c132a09ca1276` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:54.965586 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6552dd-74c6-4902-a867-471b8f4b9dfe None admin] RBAC: Authorizing `identity:get_user(user_id=6cd7f45a3461442b918c132a09ca1276)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:54.967303 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6552dd-74c6-4902-a867-471b8f4b9dfe None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:54.969140 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 127/260] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:54 2022] GET /identity/v3/users/6cd7f45a3461442b918c132a09ca1276 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:54.974925 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6552dd-74c6-4902-a867-471b8f4b9dfe None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:54.984435 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710bcb0-b318-43a4-a77d-83347f9be2d2 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:55.030325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:55.078864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291723bd-88f4-4da9-9a2b-ecdb7625d86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:55.079706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291723bd-88f4-4da9-9a2b-ecdb7625d86e None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:55.079995 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291723bd-88f4-4da9-9a2b-ecdb7625d86e None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:55.080276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291723bd-88f4-4da9-9a2b-ecdb7625d86e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:55.080674 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:55.092830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6552dd-74c6-4902-a867-471b8f4b9dfe None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:55.115422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291723bd-88f4-4da9-9a2b-ecdb7625d86e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:55.130030 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f0264-2359-4ab9-afa9-247e0b0bbd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:55.130996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f0264-2359-4ab9-afa9-247e0b0bbd80 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:55.131432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f0264-2359-4ab9-afa9-247e0b0bbd80 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:55.131568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-291723bd-88f4-4da9-9a2b-ecdb7625d86e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:03:55.131568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:55.131568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:55.131568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:55.131568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:55.131568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:55.131568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:55.131568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:55.131568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:55.131568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:55.131568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:55.131568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:55.131568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:55.131568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:55.131568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:55.131568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:55.132675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:55.132675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:55.132675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:55.132675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:55.132675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:55.132675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:55.132675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:55.132675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:55.132675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:55.132675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:55.132675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:55.132675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:55.132675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:55.132675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:55.132675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:55.132675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:55.133677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:55.133677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:55.133677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:55.133677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:55.133677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:55.133677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:55.133677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:55.133677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:55.133677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:55.133677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:55.133677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:03:55.133677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:03:55.133677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 134/261] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Jul 12 13:03:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:03:55.135332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f0264-2359-4ab9-afa9-247e0b0bbd80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:55.140598 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291723bd-88f4-4da9-9a2b-ecdb7625d86e None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:55.212889 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f0264-2359-4ab9-afa9-247e0b0bbd80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:55.215076 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f0264-2359-4ab9-afa9-247e0b0bbd80 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:55.315611 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:55.328480 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 128/262] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:03:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 13:03:55.334270 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f0264-2359-4ab9-afa9-247e0b0bbd80 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:55.343609 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291723bd-88f4-4da9-9a2b-ecdb7625d86e None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:55.403293 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1050f0e-6a19-49e3-a319-bdc290131ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:55.404242 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1050f0e-6a19-49e3-a319-bdc290131ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:55.404681 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1050f0e-6a19-49e3-a319-bdc290131ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:55.405283 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1050f0e-6a19-49e3-a319-bdc290131ed4 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:55.406260 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1050f0e-6a19-49e3-a319-bdc290131ed4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:55.406743 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1050f0e-6a19-49e3-a319-bdc290131ed4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:55.408963 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1050f0e-6a19-49e3-a319-bdc290131ed4 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:55.421460 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 135/263] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:03:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:55.427562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1050f0e-6a19-49e3-a319-bdc290131ed4 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:55.523228 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:55.569995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f0264-2359-4ab9-afa9-247e0b0bbd80 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:55.656730 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1050f0e-6a19-49e3-a319-bdc290131ed4 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:55.695539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b4c41-c238-4c88-a5b3-d0ab11c9c9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:55.696530 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b4c41-c238-4c88-a5b3-d0ab11c9c9b6 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:55.696840 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b4c41-c238-4c88-a5b3-d0ab11c9c9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:55.697141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b4c41-c238-4c88-a5b3-d0ab11c9c9b6 None admin] PATH_INFO: `/v3/projects/878eddd0b05c4cc382e41c3d429ddcee` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:55.698422 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b4c41-c238-4c88-a5b3-d0ab11c9c9b6 None admin] RBAC: Authorizing `identity:get_project(project_id=878eddd0b05c4cc382e41c3d429ddcee)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:55.700603 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b4c41-c238-4c88-a5b3-d0ab11c9c9b6 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:55.702081 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 129/264] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:03:55 2022] GET /identity/v3/projects/878eddd0b05c4cc382e41c3d429ddcee => generated 302 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:55.711117 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b4c41-c238-4c88-a5b3-d0ab11c9c9b6 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:55.744986 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d53be2-6e20-4029-9b49-7c950059cf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:55.746563 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d53be2-6e20-4029-9b49-7c950059cf03 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:55.747194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d53be2-6e20-4029-9b49-7c950059cf03 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:55.747738 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d53be2-6e20-4029-9b49-7c950059cf03 None admin] PATH_INFO: `/v3/users/6cd7f45a3461442b918c132a09ca1276` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:55.749550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d53be2-6e20-4029-9b49-7c950059cf03 None admin] RBAC: Authorizing `identity:get_user(user_id=6cd7f45a3461442b918c132a09ca1276)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:55.758138 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d53be2-6e20-4029-9b49-7c950059cf03 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:55.758138 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 136/265] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:55 2022] GET /identity/v3/users/6cd7f45a3461442b918c132a09ca1276 => generated 283 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:55.762052 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d53be2-6e20-4029-9b49-7c950059cf03 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:55.871638 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:55.919844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d53be2-6e20-4029-9b49-7c950059cf03 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:55.932149 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:55.936196 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b4c41-c238-4c88-a5b3-d0ab11c9c9b6 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:55.956340 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c54540-a3d1-43d1-905e-f5d8348442cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:55.957069 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c54540-a3d1-43d1-905e-f5d8348442cc None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:55.957418 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c54540-a3d1-43d1-905e-f5d8348442cc None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:55.957759 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c54540-a3d1-43d1-905e-f5d8348442cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:55.982722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0d598-2a70-4ae0-84b7-aadbb6aa85d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:55.983498 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0d598-2a70-4ae0-84b7-aadbb6aa85d8 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:55.984042 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0d598-2a70-4ae0-84b7-aadbb6aa85d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:55.984388 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0d598-2a70-4ae0-84b7-aadbb6aa85d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:55.985600 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0d598-2a70-4ae0-84b7-aadbb6aa85d8 None admin] RBAC: Adding query filter params (role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0, scope.project.id=878eddd0b05c4cc382e41c3d429ddcee, user.id=6cd7f45a3461442b918c132a09ca1276) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:55.986230 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0d598-2a70-4ae0-84b7-aadbb6aa85d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:55.988373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0d598-2a70-4ae0-84b7-aadbb6aa85d8 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:55.998045 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 130/266] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:03:55 2022] GET /identity/v3/role_assignments?user.id=6cd7f45a3461442b918c132a09ca1276&scope.project.id=878eddd0b05c4cc382e41c3d429ddcee&role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 608 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:55.999324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22ec31-8874-489e-81f9-da523b5785ab None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:55.999615 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22ec31-8874-489e-81f9-da523b5785ab None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:55.999895 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22ec31-8874-489e-81f9-da523b5785ab None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:56.001231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 131/267] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:56.006318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da1af9-356e-4915-b1b7-d5659fe038f7 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:56.006318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da1af9-356e-4915-b1b7-d5659fe038f7 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:56.006318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da1af9-356e-4915-b1b7-d5659fe038f7 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:56.008959 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 132/268] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:56.011498 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124cf7b-c3fd-4e06-9c45-78c94ffcdfc0 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:56.012000 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124cf7b-c3fd-4e06-9c45-78c94ffcdfc0 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:56.012480 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124cf7b-c3fd-4e06-9c45-78c94ffcdfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:56.048659 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-b124cf7b-c3fd-4e06-9c45-78c94ffcdfc0 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:56.051513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-b124cf7b-c3fd-4e06-9c45-78c94ffcdfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:56.079934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c54540-a3d1-43d1-905e-f5d8348442cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:56.081718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c54540-a3d1-43d1-905e-f5d8348442cc None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:56.205945 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 133/269] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:56.207409 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba3fbe-8363-436f-8394-908bf96ffdd8 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:56.207709 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba3fbe-8363-436f-8394-908bf96ffdd8 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:56.207995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba3fbe-8363-436f-8394-908bf96ffdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:56.230673 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-8cba3fbe-8363-436f-8394-908bf96ffdd8 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:56.231879 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-8cba3fbe-8363-436f-8394-908bf96ffdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:56.275420 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 137/270] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:03:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:03:56.276109 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c54540-a3d1-43d1-905e-f5d8348442cc None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:56.294058 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:56.297975 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:56.323813 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 134/271] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:56.324639 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba3fbe-8363-436f-8394-908bf96ffdd8 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:56.397077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c54540-a3d1-43d1-905e-f5d8348442cc None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:56.442276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6afa0-7b45-45e7-ab2a-da3665d8171f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:56.443111 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6afa0-7b45-45e7-ab2a-da3665d8171f None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:56.443402 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6afa0-7b45-45e7-ab2a-da3665d8171f None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:56.443688 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6afa0-7b45-45e7-ab2a-da3665d8171f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:56.445818 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6afa0-7b45-45e7-ab2a-da3665d8171f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:56.448172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6afa0-7b45-45e7-ab2a-da3665d8171f None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:56.450378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 138/272] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:03:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:56.451128 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6afa0-7b45-45e7-ab2a-da3665d8171f None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:56.481047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba3fbe-8363-436f-8394-908bf96ffdd8 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:56.529086 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e3ce8-63fd-4418-901b-6bd73ca9cde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:56.530035 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e3ce8-63fd-4418-901b-6bd73ca9cde6 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:56.530378 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e3ce8-63fd-4418-901b-6bd73ca9cde6 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:56.530687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e3ce8-63fd-4418-901b-6bd73ca9cde6 None admin] PATH_INFO: `/v3/projects/878eddd0b05c4cc382e41c3d429ddcee` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:56.532085 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e3ce8-63fd-4418-901b-6bd73ca9cde6 None admin] RBAC: Authorizing `identity:get_project(project_id=878eddd0b05c4cc382e41c3d429ddcee)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:56.533679 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e3ce8-63fd-4418-901b-6bd73ca9cde6 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:56.541281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 135/273] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:03:56 2022] GET /identity/v3/projects/878eddd0b05c4cc382e41c3d429ddcee => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:56.542237 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e3ce8-63fd-4418-901b-6bd73ca9cde6 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:56.549613 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:56.582160 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6afa0-7b45-45e7-ab2a-da3665d8171f None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:56.614801 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:56.632596 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316ea18-9516-474c-8c0a-5e373a4e9207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:56.634705 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316ea18-9516-474c-8c0a-5e373a4e9207 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:56.635072 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316ea18-9516-474c-8c0a-5e373a4e9207 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:56.636183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316ea18-9516-474c-8c0a-5e373a4e9207 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:56.654107 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316ea18-9516-474c-8c0a-5e373a4e9207 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:56.661762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e3ce8-63fd-4418-901b-6bd73ca9cde6 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:56.666934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-9316ea18-9516-474c-8c0a-5e373a4e9207 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:03:56.666934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:56.666934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:56.666934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:56.666934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:56.666934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:56.666934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:56.666934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:56.666934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:56.666934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:56.666934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:56.666934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:56.666934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:56.666934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:56.666934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:56.666934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:56.667990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:56.667990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:56.667990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:56.667990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:56.667990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:56.667990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:56.667990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:56.667990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:56.667990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:56.667990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:56.667990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:56.667990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:56.667990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:56.667990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:56.667990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:56.667990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:56.668839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:56.668839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:56.668839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:56.668839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:56.668839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:56.668839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:56.668839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:56.668839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:56.668839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:56.668839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:56.668839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:03:56.668839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:03:56.668839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 139/274] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:03:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:03:56.669678 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316ea18-9516-474c-8c0a-5e373a4e9207 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:56.723313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbe039-0cc7-49ad-839a-05e281b9dc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:56.724121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbe039-0cc7-49ad-839a-05e281b9dc15 None admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:56.724434 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbe039-0cc7-49ad-839a-05e281b9dc15 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:56.724719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbe039-0cc7-49ad-839a-05e281b9dc15 None admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:56.725671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dbe039-0cc7-49ad-839a-05e281b9dc15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:56.727522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dbe039-0cc7-49ad-839a-05e281b9dc15 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:56.761954 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 136/275] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Jul 12 13:03:56 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:03:56.762705 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbe039-0cc7-49ad-839a-05e281b9dc15 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:56.807186 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316ea18-9516-474c-8c0a-5e373a4e9207 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:56.856289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109c040-1978-4f92-98a7-719ec31d7fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:56.857076 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109c040-1978-4f92-98a7-719ec31d7fff None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:56.857492 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109c040-1978-4f92-98a7-719ec31d7fff None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:56.857838 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109c040-1978-4f92-98a7-719ec31d7fff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:56.858750 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109c040-1978-4f92-98a7-719ec31d7fff None admin] RBAC: Adding query filter params (role.id=4d86c48385634483af68ab63e48f9787, scope.project.id=878eddd0b05c4cc382e41c3d429ddcee, user.id=6cd7f45a3461442b918c132a09ca1276) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:56.859068 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109c040-1978-4f92-98a7-719ec31d7fff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:56.861449 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109c040-1978-4f92-98a7-719ec31d7fff None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:56.870332 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 140/276] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:03:56 2022] GET /identity/v3/role_assignments?user.id=6cd7f45a3461442b918c132a09ca1276&scope.project.id=878eddd0b05c4cc382e41c3d429ddcee&role.id=4d86c48385634483af68ab63e48f9787 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:56.967154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbe039-0cc7-49ad-839a-05e281b9dc15 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:56.975549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:57.017935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4e513-6b02-47bd-bf26-d8071472da62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:57.018585 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4e513-6b02-47bd-bf26-d8071472da62 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:57.018874 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4e513-6b02-47bd-bf26-d8071472da62 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:57.019152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4e513-6b02-47bd-bf26-d8071472da62 None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:57.019918 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4e513-6b02-47bd-bf26-d8071472da62 None admin] RBAC: Adding query filter params (name=member) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:57.020222 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4e513-6b02-47bd-bf26-d8071472da62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:57.021646 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4e513-6b02-47bd-bf26-d8071472da62 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:57.038707 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 137/277] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:03:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:57.047308 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109c040-1978-4f92-98a7-719ec31d7fff None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:57.050295 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:57.176195 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109c040-1978-4f92-98a7-719ec31d7fff None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:57.213878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665496d-423d-467d-827a-a48f52d89cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:57.214799 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665496d-423d-467d-827a-a48f52d89cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:57.215086 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665496d-423d-467d-827a-a48f52d89cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:57.215367 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665496d-423d-467d-827a-a48f52d89cf3 None admin] PATH_INFO: `/v3/users/53985c6cc54342b6b4f725a9fe78599c` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:57.233761 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665496d-423d-467d-827a-a48f52d89cf3 None admin] RBAC: Authorizing `identity:get_user(user_id=53985c6cc54342b6b4f725a9fe78599c)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:57.235320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665496d-423d-467d-827a-a48f52d89cf3 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:57.237362 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 141/278] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:57 2022] GET /identity/v3/users/53985c6cc54342b6b4f725a9fe78599c => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:57.242932 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4e513-6b02-47bd-bf26-d8071472da62 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:57.283760 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847c192-03f5-401a-8d9e-edeb69d6b129 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:57.284824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847c192-03f5-401a-8d9e-edeb69d6b129 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:57.285119 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847c192-03f5-401a-8d9e-edeb69d6b129 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:57.286792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 142/279] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:57.293599 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f9c55-4838-4602-891a-13dcacb588a0 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:57.293923 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f9c55-4838-4602-891a-13dcacb588a0 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:57.294234 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f9c55-4838-4602-891a-13dcacb588a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:57.312508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-409f9c55-4838-4602-891a-13dcacb588a0 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:57.313701 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-409f9c55-4838-4602-891a-13dcacb588a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:57.381878 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4e513-6b02-47bd-bf26-d8071472da62 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:57.382378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:57.396102 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 143/280] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:03:57.397792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e4003-7078-4999-ab2f-968730d7f358 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:57.398650 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e4003-7078-4999-ab2f-968730d7f358 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:57.398650 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e4003-7078-4999-ab2f-968730d7f358 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:57.400549 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 144/281] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:57.405762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6d235-90b9-4182-a39e-59b21edfe47f None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:57.405915 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6d235-90b9-4182-a39e-59b21edfe47f None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:57.406272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6d235-90b9-4182-a39e-59b21edfe47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:57.428770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-56e6d235-90b9-4182-a39e-59b21edfe47f None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:57.429966 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-56e6d235-90b9-4182-a39e-59b21edfe47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:57.431821 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614e9d9-cab7-4389-be45-4c7d5648313d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:57.432778 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614e9d9-cab7-4389-be45-4c7d5648313d None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:57.433128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614e9d9-cab7-4389-be45-4c7d5648313d None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:57.433479 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614e9d9-cab7-4389-be45-4c7d5648313d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:57.434408 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614e9d9-cab7-4389-be45-4c7d5648313d None admin] RBAC: Adding query filter params (role.id=1727bdbc17d94ff08782d404dce97d35, user.id=53985c6cc54342b6b4f725a9fe78599c, scope.system=all) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:57.434725 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614e9d9-cab7-4389-be45-4c7d5648313d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:57.436180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614e9d9-cab7-4389-be45-4c7d5648313d None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:57.442083 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 138/282] 10.222.0.17 () {56 vars in 1308 bytes} [Tue Jul 12 13:03:57 2022] GET /identity/v3/role_assignments?user.id=53985c6cc54342b6b4f725a9fe78599c&scope.system=all&role.id=1727bdbc17d94ff08782d404dce97d35 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:57.445761 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614e9d9-cab7-4389-be45-4c7d5648313d None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:57.494067 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:57.520441 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 145/283] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:03:57.564225 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6d235-90b9-4182-a39e-59b21edfe47f None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:57.623075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614e9d9-cab7-4389-be45-4c7d5648313d None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:57.667344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afff152-740b-4b13-8672-1d508dbeea35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:57.668167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afff152-740b-4b13-8672-1d508dbeea35 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:57.668492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afff152-740b-4b13-8672-1d508dbeea35 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:57.668814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afff152-740b-4b13-8672-1d508dbeea35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:57.690456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afff152-740b-4b13-8672-1d508dbeea35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:57.705021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-7afff152-740b-4b13-8672-1d508dbeea35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:03:57.705021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:57.705021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:57.705021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:57.705021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:57.705021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:57.705021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:57.705021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:57.705021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:57.705021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:57.705021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:57.705021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:57.705021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:57.705021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:57.705021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:57.705021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:57.705983 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:57.705983 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:57.705983 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:57.705983 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:57.705983 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:57.705983 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:57.705983 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:57.705983 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:57.705983 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:57.705983 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:57.705983 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:57.705983 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:57.705983 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:57.705983 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:57.705983 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:57.705983 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:57.706810 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:57.706810 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:57.706810 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:57.706810 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:57.706810 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:57.706810 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:57.706810 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:57.706810 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:57.706810 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:57.706810 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:57.706810 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:03:57.706810 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:03:57.709379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 139/284] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:03:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:03:57.715545 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afff152-740b-4b13-8672-1d508dbeea35 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:57.764029 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6d235-90b9-4182-a39e-59b21edfe47f None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:57.806418 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:57.858944 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f4326-d193-4cec-b750-d1becbf208bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:57.860118 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f4326-d193-4cec-b750-d1becbf208bd None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:57.860627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f4326-d193-4cec-b750-d1becbf208bd None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:57.861103 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f4326-d193-4cec-b750-d1becbf208bd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:57.863646 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:57.869021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afff152-740b-4b13-8672-1d508dbeea35 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:57.888190 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f4326-d193-4cec-b750-d1becbf208bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:57.902981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-5f4f4326-d193-4cec-b750-d1becbf208bd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:03:57.902981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:57.902981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:57.902981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:57.902981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:57.902981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:57.902981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:57.902981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:57.902981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:57.902981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:57.902981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:57.902981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:57.902981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:57.902981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:57.902981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:57.902981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:57.903918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:57.903918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:57.903918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:57.903918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:57.903918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:57.903918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:57.903918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:57.903918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:57.903918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:57.903918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:57.903918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:57.903918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:57.903918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:57.903918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:57.903918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:57.903918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:57.904718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:57.904718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:57.904718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:57.904718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:57.904718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:57.904718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:57.904718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:57.904718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:57.904718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:57.904718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:57.904718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:03:57.904718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:03:57.904718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 146/285] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:03:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:03:57.912126 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f4326-d193-4cec-b750-d1becbf208bd None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:57.939811 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c219c1-f28d-4b30-a825-64c9e0c38da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:57.940512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c219c1-f28d-4b30-a825-64c9e0c38da9 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:57.940796 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c219c1-f28d-4b30-a825-64c9e0c38da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:57.941078 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c219c1-f28d-4b30-a825-64c9e0c38da9 None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:57.942000 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c219c1-f28d-4b30-a825-64c9e0c38da9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:57.942334 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c219c1-f28d-4b30-a825-64c9e0c38da9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:57.943742 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c219c1-f28d-4b30-a825-64c9e0c38da9 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:57.961254 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 140/286] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:03:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:57.967713 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c219c1-f28d-4b30-a825-64c9e0c38da9 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:58.086739 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f4326-d193-4cec-b750-d1becbf208bd None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:58.139477 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734bcfb5-a682-476a-a599-9be1a72ed626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:58.140242 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734bcfb5-a682-476a-a599-9be1a72ed626 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:58.140642 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734bcfb5-a682-476a-a599-9be1a72ed626 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:58.141036 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734bcfb5-a682-476a-a599-9be1a72ed626 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:58.141972 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734bcfb5-a682-476a-a599-9be1a72ed626 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:58.142398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734bcfb5-a682-476a-a599-9be1a72ed626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:58.144007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734bcfb5-a682-476a-a599-9be1a72ed626 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:58.153915 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 147/287] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:03:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:58.162317 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734bcfb5-a682-476a-a599-9be1a72ed626 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:58.177584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c219c1-f28d-4b30-a825-64c9e0c38da9 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:58.210478 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:58.270014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734bcfb5-a682-476a-a599-9be1a72ed626 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:58.275416 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea13c6-7303-4d70-bd48-3cd127323d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:58.276951 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea13c6-7303-4d70-bd48-3cd127323d09 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:58.277443 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea13c6-7303-4d70-bd48-3cd127323d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:58.277922 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea13c6-7303-4d70-bd48-3cd127323d09 None admin] PATH_INFO: `/v3/users/b7b6ffbe46c64d1a86f5d723acfc6f9a` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:58.282949 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea13c6-7303-4d70-bd48-3cd127323d09 None admin] RBAC: Authorizing `identity:get_user(user_id=b7b6ffbe46c64d1a86f5d723acfc6f9a)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:58.284742 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea13c6-7303-4d70-bd48-3cd127323d09 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:58.286694 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 141/288] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:57 2022] GET /identity/v3/users/b7b6ffbe46c64d1a86f5d723acfc6f9a => generated 297 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:03:58.297658 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea13c6-7303-4d70-bd48-3cd127323d09 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:58.335817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48b725-a1a7-4500-a82d-59d6c910ffaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:58.337598 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48b725-a1a7-4500-a82d-59d6c910ffaa None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:58.338085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48b725-a1a7-4500-a82d-59d6c910ffaa None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:58.338589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48b725-a1a7-4500-a82d-59d6c910ffaa None admin] PATH_INFO: `/v3/users/cf7fca8496e741fc95b0921de3cc6492` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:58.340180 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48b725-a1a7-4500-a82d-59d6c910ffaa None admin] RBAC: Authorizing `identity:get_user(user_id=cf7fca8496e741fc95b0921de3cc6492)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:58.341680 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48b725-a1a7-4500-a82d-59d6c910ffaa None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:58.343796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 148/289] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:03:58 2022] GET /identity/v3/users/cf7fca8496e741fc95b0921de3cc6492 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:58.352647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48b725-a1a7-4500-a82d-59d6c910ffaa None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:58.360307 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:58.469369 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea13c6-7303-4d70-bd48-3cd127323d09 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:58.543794 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab42bcb-68d5-4d1b-9e18-42eb1bb068de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:58.544472 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab42bcb-68d5-4d1b-9e18-42eb1bb068de None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:58.544759 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab42bcb-68d5-4d1b-9e18-42eb1bb068de None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:58.545042 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab42bcb-68d5-4d1b-9e18-42eb1bb068de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:58.575105 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48b725-a1a7-4500-a82d-59d6c910ffaa None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:58.594511 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:58.646990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c788f-a4dc-40f5-83b7-0f8c424a7cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:58.647876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c788f-a4dc-40f5-83b7-0f8c424a7cfe None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:58.648166 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c788f-a4dc-40f5-83b7-0f8c424a7cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:58.648446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c788f-a4dc-40f5-83b7-0f8c424a7cfe None admin] PATH_INFO: `/v3/projects/878eddd0b05c4cc382e41c3d429ddcee` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:58.650282 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c788f-a4dc-40f5-83b7-0f8c424a7cfe None admin] RBAC: Authorizing `identity:get_project(project_id=878eddd0b05c4cc382e41c3d429ddcee)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:58.651750 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c788f-a4dc-40f5-83b7-0f8c424a7cfe None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:58.655235 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 149/290] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:03:58 2022] GET /identity/v3/projects/878eddd0b05c4cc382e41c3d429ddcee => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:58.667130 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c788f-a4dc-40f5-83b7-0f8c424a7cfe None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:58.672065 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab42bcb-68d5-4d1b-9e18-42eb1bb068de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:58.673542 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab42bcb-68d5-4d1b-9e18-42eb1bb068de None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:58.700993 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:58.785759 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 142/291] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:03:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:03:58.791855 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab42bcb-68d5-4d1b-9e18-42eb1bb068de None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:58.922378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c788f-a4dc-40f5-83b7-0f8c424a7cfe None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:58.956858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab42bcb-68d5-4d1b-9e18-42eb1bb068de None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:58.990523 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601583ce-af38-48f4-9e46-fd5ae6f3d188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:58.991442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601583ce-af38-48f4-9e46-fd5ae6f3d188 None admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:58.991729 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601583ce-af38-48f4-9e46-fd5ae6f3d188 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:58.992007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601583ce-af38-48f4-9e46-fd5ae6f3d188 None admin] PATH_INFO: `/v3/projects/878eddd0b05c4cc382e41c3d429ddcee/users/cf7fca8496e741fc95b0921de3cc6492/roles/ef9c44b998b048b0a8db160073bc0e6f` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:58.995566 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601583ce-af38-48f4-9e46-fd5ae6f3d188 None admin] RBAC: Authorizing `identity:create_grant(project_id=878eddd0b05c4cc382e41c3d429ddcee, user_id=cf7fca8496e741fc95b0921de3cc6492, role_id=ef9c44b998b048b0a8db160073bc0e6f)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:58.997033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601583ce-af38-48f4-9e46-fd5ae6f3d188 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:59.005148 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:59.024045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 150/292] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Jul 12 13:03:58 2022] PUT /identity/v3/projects/878eddd0b05c4cc382e41c3d429ddcee/users/cf7fca8496e741fc95b0921de3cc6492/roles/ef9c44b998b048b0a8db160073bc0e6f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:03:59.026752 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e86b1-d017-48a2-979b-df2fd43a43aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:59.027663 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e86b1-d017-48a2-979b-df2fd43a43aa None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:59.027955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e86b1-d017-48a2-979b-df2fd43a43aa None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:59.028237 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e86b1-d017-48a2-979b-df2fd43a43aa None admin] PATH_INFO: `/v3/projects/878eddd0b05c4cc382e41c3d429ddcee` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:59.029600 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e86b1-d017-48a2-979b-df2fd43a43aa None admin] RBAC: Authorizing `identity:get_project(project_id=878eddd0b05c4cc382e41c3d429ddcee)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:59.031147 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e86b1-d017-48a2-979b-df2fd43a43aa None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:59.032997 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 143/293] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:03:58 2022] GET /identity/v3/projects/878eddd0b05c4cc382e41c3d429ddcee => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:59.039285 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601583ce-af38-48f4-9e46-fd5ae6f3d188 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:59.084795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:59.165930 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601583ce-af38-48f4-9e46-fd5ae6f3d188 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:59.215688 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac551fd6-5e00-4492-b0ee-fe0a670d8e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:59.216432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac551fd6-5e00-4492-b0ee-fe0a670d8e78 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:59.216653 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac551fd6-5e00-4492-b0ee-fe0a670d8e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:59.216937 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac551fd6-5e00-4492-b0ee-fe0a670d8e78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:59.217794 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac551fd6-5e00-4492-b0ee-fe0a670d8e78 None admin] RBAC: Adding query filter params (role.id=1727bdbc17d94ff08782d404dce97d35, scope.project.id=878eddd0b05c4cc382e41c3d429ddcee, user.id=b7b6ffbe46c64d1a86f5d723acfc6f9a) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:03:59.218149 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac551fd6-5e00-4492-b0ee-fe0a670d8e78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:03:59.219624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac551fd6-5e00-4492-b0ee-fe0a670d8e78 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:03:59.230245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 151/294] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:03:59 2022] GET /identity/v3/role_assignments?user.id=b7b6ffbe46c64d1a86f5d723acfc6f9a&scope.project.id=878eddd0b05c4cc382e41c3d429ddcee&role.id=1727bdbc17d94ff08782d404dce97d35 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:03:59.553469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500d096-cd1d-4a6c-9816-4fe444d6ca7c None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:59.553997 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500d096-cd1d-4a6c-9816-4fe444d6ca7c None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:59.554074 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500d096-cd1d-4a6c-9816-4fe444d6ca7c None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:59.556485 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 144/295] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:59.562522 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eed26f-1112-46f6-83b8-1681d387bcc0 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:59.563177 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eed26f-1112-46f6-83b8-1681d387bcc0 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:59.563680 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eed26f-1112-46f6-83b8-1681d387bcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:59.583094 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-26eed26f-1112-46f6-83b8-1681d387bcc0 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:59.584611 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-26eed26f-1112-46f6-83b8-1681d387bcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:59.664026 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 152/296] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:59.666424 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf4869-57bd-4168-b293-c7317d4a5667 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:59.667027 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf4869-57bd-4168-b293-c7317d4a5667 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:59.667503 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf4869-57bd-4168-b293-c7317d4a5667 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:59.669140 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 145/297] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:03:59.675698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850e740-3b76-4ac5-a995-50e9060717df None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:59.676273 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850e740-3b76-4ac5-a995-50e9060717df None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:59.676764 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850e740-3b76-4ac5-a995-50e9060717df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:59.691704 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eed26f-1112-46f6-83b8-1681d387bcc0 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:59.701375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-9850e740-3b76-4ac5-a995-50e9060717df None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:03:59.702876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-9850e740-3b76-4ac5-a995-50e9060717df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:03:59.729765 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:03:59.806375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 146/298] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:03:59.823930 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eed26f-1112-46f6-83b8-1681d387bcc0 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:59.839103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850e740-3b76-4ac5-a995-50e9060717df None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:59.863763 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5dc00e-ae93-44c4-8268-4b380aed8ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:03:59.864621 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dc00e-ae93-44c4-8268-4b380aed8ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:03:59.864905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dc00e-ae93-44c4-8268-4b380aed8ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:03:59.865232 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dc00e-ae93-44c4-8268-4b380aed8ab5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:03:59.876474 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5dc00e-ae93-44c4-8268-4b380aed8ab5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:03:59.884393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-df5dc00e-ae93-44c4-8268-4b380aed8ab5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:03:59.884393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:03:59.884393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:03:59.884393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:03:59.884393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:03:59.884393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:03:59.884393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:03:59.884393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:03:59.884393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:03:59.884393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:03:59.884393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:03:59.884393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:03:59.884393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:03:59.884393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:03:59.884393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:03:59.884393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:03:59.885321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:03:59.885321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:03:59.885321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:03:59.885321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:03:59.885321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:03:59.885321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:03:59.885321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:03:59.885321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:03:59.885321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:03:59.885321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:03:59.885321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:03:59.885321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:03:59.885321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:03:59.885321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:03:59.885321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:03:59.885321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:03:59.886805 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:03:59.886805 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:03:59.886805 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:03:59.886805 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:03:59.886805 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:03:59.886805 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:03:59.886805 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:03:59.886805 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:03:59.886805 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:03:59.886805 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:03:59.886805 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:03:59.886805 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:03:59.886805 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 153/299] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:03:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:03:59.892009 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5dc00e-ae93-44c4-8268-4b380aed8ab5 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:03:59.969068 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850e740-3b76-4ac5-a995-50e9060717df None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:03:59.990691 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:00.002326 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:00.012336 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5dc00e-ae93-44c4-8268-4b380aed8ab5 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:00.012989 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6862d09-98a2-4c68-a22d-e556ae79ea11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:00.014238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6862d09-98a2-4c68-a22d-e556ae79ea11 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:00.015755 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6862d09-98a2-4c68-a22d-e556ae79ea11 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:00.016069 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6862d09-98a2-4c68-a22d-e556ae79ea11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:00.017349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6862d09-98a2-4c68-a22d-e556ae79ea11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:00.018882 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6862d09-98a2-4c68-a22d-e556ae79ea11 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:00.024978 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 147/300] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:03:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:04:00.024978 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d929f8e-d3ab-47cd-89ec-fc8eb57ceb4f None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:00.024978 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d929f8e-d3ab-47cd-89ec-fc8eb57ceb4f None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:00.024978 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d929f8e-d3ab-47cd-89ec-fc8eb57ceb4f None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:00.024978 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 148/301] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:00.028462 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d929f8e-d3ab-47cd-89ec-fc8eb57ceb4f None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:00.052110 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d568f94-4ae1-41b0-bdc2-9a79fc96e307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:00.052790 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d568f94-4ae1-41b0-bdc2-9a79fc96e307 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:00.053073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d568f94-4ae1-41b0-bdc2-9a79fc96e307 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:00.053346 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d568f94-4ae1-41b0-bdc2-9a79fc96e307 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:00.054101 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d568f94-4ae1-41b0-bdc2-9a79fc96e307 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:00.054430 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d568f94-4ae1-41b0-bdc2-9a79fc96e307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:00.056365 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d568f94-4ae1-41b0-bdc2-9a79fc96e307 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:00.065562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 154/302] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:03:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:04:00.071025 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d68c6-611a-4c51-92cc-f2dd019961f9 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:00.071381 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d68c6-611a-4c51-92cc-f2dd019961f9 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:00.072174 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d68c6-611a-4c51-92cc-f2dd019961f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:00.089870 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-4c5d68c6-611a-4c51-92cc-f2dd019961f9 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:00.091103 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-4c5d68c6-611a-4c51-92cc-f2dd019961f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:00.143406 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d929f8e-d3ab-47cd-89ec-fc8eb57ceb4f None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:00.166751 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 155/303] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:00.167610 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d68c6-611a-4c51-92cc-f2dd019961f9 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:00.191982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea76995-ec8a-4ddb-b861-4adc42569c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:00.192749 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea76995-ec8a-4ddb-b861-4adc42569c79 None admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:00.193105 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea76995-ec8a-4ddb-b861-4adc42569c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:00.193387 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea76995-ec8a-4ddb-b861-4adc42569c79 None admin] PATH_INFO: `/v3/groups` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:00.194173 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea76995-ec8a-4ddb-b861-4adc42569c79 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:00.195576 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea76995-ec8a-4ddb-b861-4adc42569c79 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:00.218337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 149/304] 10.222.0.17 () {60 vars in 1134 bytes} [Tue Jul 12 13:04:00 2022] POST /identity/v3/groups => generated 229 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:04:00.220340 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea76995-ec8a-4ddb-b861-4adc42569c79 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:00.274736 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:00.294683 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d68c6-611a-4c51-92cc-f2dd019961f9 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:00.300799 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:00.339475 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c3801-300a-4f4f-be87-acb4b8acd288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:00.340350 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c3801-300a-4f4f-be87-acb4b8acd288 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:00.340738 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c3801-300a-4f4f-be87-acb4b8acd288 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:00.341018 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c3801-300a-4f4f-be87-acb4b8acd288 None admin] PATH_INFO: `/v3/users/b99e3af5db8c4a80a2cd13f7e22cc95f` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:00.358298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c3801-300a-4f4f-be87-acb4b8acd288 None admin] RBAC: Authorizing `identity:get_user(user_id=b99e3af5db8c4a80a2cd13f7e22cc95f)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:00.359993 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c3801-300a-4f4f-be87-acb4b8acd288 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:00.361949 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 156/305] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:04:00 2022] GET /identity/v3/users/b99e3af5db8c4a80a2cd13f7e22cc95f => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:00.367903 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c3801-300a-4f4f-be87-acb4b8acd288 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:00.374784 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea76995-ec8a-4ddb-b861-4adc42569c79 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:00.418564 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc17230-3aa7-4a91-9b65-316ca92689bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:00.419381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc17230-3aa7-4a91-9b65-316ca92689bf None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:00.419670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc17230-3aa7-4a91-9b65-316ca92689bf None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:00.419951 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc17230-3aa7-4a91-9b65-316ca92689bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:00.433523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc17230-3aa7-4a91-9b65-316ca92689bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:00.443114 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-9dc17230-3aa7-4a91-9b65-316ca92689bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:04:00.443114 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:00.443114 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:00.443114 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:00.443114 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:00.443114 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:00.443114 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:00.443114 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:00.443114 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:00.443114 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:00.443114 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:00.443114 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:00.443114 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:00.443114 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:00.443114 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:00.443114 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:00.444239 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:00.444239 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:00.444239 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:00.444239 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:00.444239 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:00.444239 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:00.444239 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:00.444239 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:00.444239 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:00.444239 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:00.444239 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:00.444239 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:00.444239 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:00.444239 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:00.444239 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:00.444239 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:00.445042 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:00.445042 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:00.445042 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:00.445042 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:00.445042 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:00.445042 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:00.445042 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:00.445042 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:00.445042 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:00.445042 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:00.445042 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:04:00.445042 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:00.445042 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 150/306] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:04:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:00.454830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc17230-3aa7-4a91-9b65-316ca92689bf None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:00.503064 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c3801-300a-4f4f-be87-acb4b8acd288 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:00.542740 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f0c01-9b26-4cfd-b40c-2a690012b3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:00.543782 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f0c01-9b26-4cfd-b40c-2a690012b3b3 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:00.544245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f0c01-9b26-4cfd-b40c-2a690012b3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:00.544674 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f0c01-9b26-4cfd-b40c-2a690012b3b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:00.545761 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f0c01-9b26-4cfd-b40c-2a690012b3b3 None admin] RBAC: Adding query filter params (role.id=ef9c44b998b048b0a8db160073bc0e6f, user.id=b99e3af5db8c4a80a2cd13f7e22cc95f, scope.system=all) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:00.546318 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f0c01-9b26-4cfd-b40c-2a690012b3b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:00.548155 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f0c01-9b26-4cfd-b40c-2a690012b3b3 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:00.554157 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 157/307] 10.222.0.17 () {56 vars in 1308 bytes} [Tue Jul 12 13:04:00 2022] GET /identity/v3/role_assignments?user.id=b99e3af5db8c4a80a2cd13f7e22cc95f&scope.system=all&role.id=ef9c44b998b048b0a8db160073bc0e6f => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:00.571197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc17230-3aa7-4a91-9b65-316ca92689bf None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:00.583040 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:00.610702 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c34d05-bdad-49fb-86a1-78f0610a5089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:00.611463 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c34d05-bdad-49fb-86a1-78f0610a5089 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:00.611760 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c34d05-bdad-49fb-86a1-78f0610a5089 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:00.612039 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c34d05-bdad-49fb-86a1-78f0610a5089 None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:00.612812 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c34d05-bdad-49fb-86a1-78f0610a5089 None admin] RBAC: Adding query filter params (name=member) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:00.613127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c34d05-bdad-49fb-86a1-78f0610a5089 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:00.614589 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c34d05-bdad-49fb-86a1-78f0610a5089 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:00.625535 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 151/308] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:04:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:00.635431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f0c01-9b26-4cfd-b40c-2a690012b3b3 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:00.645588 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:00.760411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f0c01-9b26-4cfd-b40c-2a690012b3b3 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:00.804543 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12de128-5142-4863-be7b-875d7b49b273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:00.805499 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12de128-5142-4863-be7b-875d7b49b273 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:00.806361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12de128-5142-4863-be7b-875d7b49b273 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:00.806643 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12de128-5142-4863-be7b-875d7b49b273 None admin] PATH_INFO: `/v3/users/53985c6cc54342b6b4f725a9fe78599c` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:00.807860 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12de128-5142-4863-be7b-875d7b49b273 None admin] RBAC: Authorizing `identity:get_user(user_id=53985c6cc54342b6b4f725a9fe78599c)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:00.809349 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12de128-5142-4863-be7b-875d7b49b273 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:00.811345 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 158/309] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:04:00 2022] GET /identity/v3/users/53985c6cc54342b6b4f725a9fe78599c => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:00.817179 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c34d05-bdad-49fb-86a1-78f0610a5089 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:00.925346 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c34d05-bdad-49fb-86a1-78f0610a5089 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:00.962201 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe39ee7-171b-4af4-9fea-9160357b4d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:00.963088 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe39ee7-171b-4af4-9fea-9160357b4d9d None admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:00.963374 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe39ee7-171b-4af4-9fea-9160357b4d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:00.963660 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe39ee7-171b-4af4-9fea-9160357b4d9d None admin] PATH_INFO: `/v3/system/users/53985c6cc54342b6b4f725a9fe78599c/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:00.965174 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe39ee7-171b-4af4-9fea-9160357b4d9d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=53985c6cc54342b6b4f725a9fe78599c, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:00.966618 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe39ee7-171b-4af4-9fea-9160357b4d9d None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:00.982373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 152/310] 10.222.0.17 () {58 vars in 1334 bytes} [Tue Jul 12 13:04:00 2022] PUT /identity/v3/system/users/53985c6cc54342b6b4f725a9fe78599c/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:04:01.470825 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ac248-d355-4a86-9a99-608b9c79bbfc None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:01.471342 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ac248-d355-4a86-9a99-608b9c79bbfc None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:01.471418 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ac248-d355-4a86-9a99-608b9c79bbfc None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:01.473046 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 159/311] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:01.479154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0880ce0-d468-4742-a413-bd7d2030c3a3 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:01.479454 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0880ce0-d468-4742-a413-bd7d2030c3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:01.479740 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0880ce0-d468-4742-a413-bd7d2030c3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:01.498311 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-b0880ce0-d468-4742-a413-bd7d2030c3a3 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:01.499538 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-b0880ce0-d468-4742-a413-bd7d2030c3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:01.528761 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:01.573350 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 153/312] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:01.596990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ac248-d355-4a86-9a99-608b9c79bbfc None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:01.681932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:01.712600 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ac248-d355-4a86-9a99-608b9c79bbfc None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:01.749218 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a30216-89aa-41a6-82b7-728c8cb5ad42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:01.750397 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a30216-89aa-41a6-82b7-728c8cb5ad42 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:01.750833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a30216-89aa-41a6-82b7-728c8cb5ad42 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:01.751249 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a30216-89aa-41a6-82b7-728c8cb5ad42 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:01.763556 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a30216-89aa-41a6-82b7-728c8cb5ad42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:01.771819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-15a30216-89aa-41a6-82b7-728c8cb5ad42 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:04:01.771819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:01.771819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:01.771819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:01.771819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:01.771819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:01.771819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:01.771819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:01.771819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:01.771819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:01.771819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:01.771819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:01.771819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:01.771819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:01.771819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:01.771819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:01.772881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:01.772881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:01.772881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:01.772881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:01.772881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:01.772881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:01.772881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:01.772881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:01.772881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:01.772881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:01.772881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:01.772881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:01.772881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:01.772881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:01.772881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:01.772881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:01.773806 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:01.773806 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:01.773806 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:01.773806 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:01.773806 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:01.773806 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:01.773806 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:01.773806 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:01.773806 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:01.773806 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:01.773806 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:04:01.773806 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:01.776869 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 160/313] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:04:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:01.782897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0880ce0-d468-4742-a413-bd7d2030c3a3 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:01.905237 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0880ce0-d468-4742-a413-bd7d2030c3a3 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:01.942250 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582a548-104b-43a7-a5b5-62e6f693ec1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:01.942938 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582a548-104b-43a7-a5b5-62e6f693ec1b None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:01.943221 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582a548-104b-43a7-a5b5-62e6f693ec1b None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:01.943501 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582a548-104b-43a7-a5b5-62e6f693ec1b None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:01.944257 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582a548-104b-43a7-a5b5-62e6f693ec1b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:01.944566 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582a548-104b-43a7-a5b5-62e6f693ec1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:01.946298 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582a548-104b-43a7-a5b5-62e6f693ec1b None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:01.955060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 154/314] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:04:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:01.960847 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a30216-89aa-41a6-82b7-728c8cb5ad42 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:02.072354 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a30216-89aa-41a6-82b7-728c8cb5ad42 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:02.108545 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bea006-1fa0-4f6b-8f77-774b553e68c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:02.109823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bea006-1fa0-4f6b-8f77-774b553e68c1 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:02.110333 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bea006-1fa0-4f6b-8f77-774b553e68c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:02.110809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bea006-1fa0-4f6b-8f77-774b553e68c1 None admin] PATH_INFO: `/v3/users/cf7fca8496e741fc95b0921de3cc6492` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:02.112198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bea006-1fa0-4f6b-8f77-774b553e68c1 None admin] RBAC: Authorizing `identity:get_user(user_id=cf7fca8496e741fc95b0921de3cc6492)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:02.113823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bea006-1fa0-4f6b-8f77-774b553e68c1 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:02.116076 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 161/315] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:04:01 2022] GET /identity/v3/users/cf7fca8496e741fc95b0921de3cc6492 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:02.122144 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582a548-104b-43a7-a5b5-62e6f693ec1b None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:02.154498 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:02.242434 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582a548-104b-43a7-a5b5-62e6f693ec1b None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:02.281214 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18534c7-02f3-42aa-9ba5-234938c8df4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:02.281877 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18534c7-02f3-42aa-9ba5-234938c8df4a None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:02.282189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18534c7-02f3-42aa-9ba5-234938c8df4a None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:02.282474 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18534c7-02f3-42aa-9ba5-234938c8df4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:02.353785 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18534c7-02f3-42aa-9ba5-234938c8df4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:02.355205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18534c7-02f3-42aa-9ba5-234938c8df4a None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:02.382753 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:02.388503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d0a18-dc83-4e4d-8641-387bffa62797 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:02.388791 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d0a18-dc83-4e4d-8641-387bffa62797 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:02.389075 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d0a18-dc83-4e4d-8641-387bffa62797 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:02.390744 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 162/316] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:02.395683 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f0992-9312-4f2b-8deb-a7c72979aa2f None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:02.395973 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f0992-9312-4f2b-8deb-a7c72979aa2f None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:02.396258 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f0992-9312-4f2b-8deb-a7c72979aa2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:02.403470 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:02.417409 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-685f0992-9312-4f2b-8deb-a7c72979aa2f None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:02.418900 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-685f0992-9312-4f2b-8deb-a7c72979aa2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:02.466821 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 155/317] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:04:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:04:02.468899 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18534c7-02f3-42aa-9ba5-234938c8df4a None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:02.501622 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 163/318] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:04:02.543836 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f0992-9312-4f2b-8deb-a7c72979aa2f None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:02.613308 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18534c7-02f3-42aa-9ba5-234938c8df4a None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:02.641865 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:02.652017 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71660b9-bd00-41f3-9a8e-875d69f45e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:02.652992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71660b9-bd00-41f3-9a8e-875d69f45e03 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:02.653377 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71660b9-bd00-41f3-9a8e-875d69f45e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:02.653728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71660b9-bd00-41f3-9a8e-875d69f45e03 None admin] PATH_INFO: `/v3/projects/878eddd0b05c4cc382e41c3d429ddcee` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:02.655040 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71660b9-bd00-41f3-9a8e-875d69f45e03 None admin] RBAC: Authorizing `identity:get_project(project_id=878eddd0b05c4cc382e41c3d429ddcee)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:02.656554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71660b9-bd00-41f3-9a8e-875d69f45e03 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:02.658384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 156/319] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:04:02 2022] GET /identity/v3/projects/878eddd0b05c4cc382e41c3d429ddcee => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:02.664055 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71660b9-bd00-41f3-9a8e-875d69f45e03 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:02.694783 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f0992-9312-4f2b-8deb-a7c72979aa2f None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:02.728768 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:02.734916 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893173b-e1e4-4345-9a2f-7219d9e46cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:02.736056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893173b-e1e4-4345-9a2f-7219d9e46cec None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:02.736497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893173b-e1e4-4345-9a2f-7219d9e46cec None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:02.736943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893173b-e1e4-4345-9a2f-7219d9e46cec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:02.739259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893173b-e1e4-4345-9a2f-7219d9e46cec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:02.740892 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893173b-e1e4-4345-9a2f-7219d9e46cec None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:02.748103 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 164/320] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:04:02.749156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893173b-e1e4-4345-9a2f-7219d9e46cec None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:02.779784 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71660b9-bd00-41f3-9a8e-875d69f45e03 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:02.814957 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd3ed4-f8a9-4949-9349-505bf14d6fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:02.815746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd3ed4-f8a9-4949-9349-505bf14d6fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:02.816089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd3ed4-f8a9-4949-9349-505bf14d6fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:02.816378 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd3ed4-f8a9-4949-9349-505bf14d6fa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:02.817221 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd3ed4-f8a9-4949-9349-505bf14d6fa0 None admin] RBAC: Adding query filter params (role.id=ef9c44b998b048b0a8db160073bc0e6f, scope.project.id=878eddd0b05c4cc382e41c3d429ddcee, user.id=cf7fca8496e741fc95b0921de3cc6492) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:02.817538 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd3ed4-f8a9-4949-9349-505bf14d6fa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:02.819261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd3ed4-f8a9-4949-9349-505bf14d6fa0 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:02.826506 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 157/321] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:04:02 2022] GET /identity/v3/role_assignments?user.id=cf7fca8496e741fc95b0921de3cc6492&scope.project.id=878eddd0b05c4cc382e41c3d429ddcee&role.id=ef9c44b998b048b0a8db160073bc0e6f => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:04:02.835744 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41ca51-99d6-45b9-8e5d-fdd581f537ef None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:02.836037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41ca51-99d6-45b9-8e5d-fdd581f537ef None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:02.836318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41ca51-99d6-45b9-8e5d-fdd581f537ef None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:02.837745 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 158/322] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:02.843762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75dfd73-a3bb-46de-b54f-481ae0316c4f None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:02.843958 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75dfd73-a3bb-46de-b54f-481ae0316c4f None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:02.844165 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75dfd73-a3bb-46de-b54f-481ae0316c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:02.871929 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-e75dfd73-a3bb-46de-b54f-481ae0316c4f None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:02.873127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-e75dfd73-a3bb-46de-b54f-481ae0316c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:02.874617 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893173b-e1e4-4345-9a2f-7219d9e46cec None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:02.924423 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812f55c-616b-4787-8b1e-07fc314d3381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:02.925232 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812f55c-616b-4787-8b1e-07fc314d3381 None admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:02.925518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812f55c-616b-4787-8b1e-07fc314d3381 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:02.925794 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812f55c-616b-4787-8b1e-07fc314d3381 None admin] PATH_INFO: `/v3/groups` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:02.926537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812f55c-616b-4787-8b1e-07fc314d3381 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:02.928168 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812f55c-616b-4787-8b1e-07fc314d3381 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:02.954517 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 165/323] 10.222.0.17 () {60 vars in 1134 bytes} [Tue Jul 12 13:04:02 2022] POST /identity/v3/groups => generated 226 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:04:02.966848 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:02.977337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 159/324] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:04:03.001417 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812f55c-616b-4787-8b1e-07fc314d3381 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:03.079562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:03.129400 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812f55c-616b-4787-8b1e-07fc314d3381 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:03.155080 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d3789-23fe-41d6-aa97-e9ae3c97ecd4 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:03.155382 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d3789-23fe-41d6-aa97-e9ae3c97ecd4 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:03.155646 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d3789-23fe-41d6-aa97-e9ae3c97ecd4 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:03.158518 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 160/325] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:03.163904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7240874-6f13-4357-8916-102e7da87aa3 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:03.164195 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7240874-6f13-4357-8916-102e7da87aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:03.164475 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7240874-6f13-4357-8916-102e7da87aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:03.171634 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf87c3-c505-4391-a0b3-daa61dc6453c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:03.172450 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf87c3-c505-4391-a0b3-daa61dc6453c None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:03.172740 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf87c3-c505-4391-a0b3-daa61dc6453c None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:03.173026 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf87c3-c505-4391-a0b3-daa61dc6453c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:03.186165 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf87c3-c505-4391-a0b3-daa61dc6453c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:03.186594 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-d7240874-6f13-4357-8916-102e7da87aa3 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:03.187742 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-d7240874-6f13-4357-8916-102e7da87aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:03.193546 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-dccf87c3-c505-4391-a0b3-daa61dc6453c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:04:03.193546 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:03.193546 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:03.193546 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:03.193546 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:03.193546 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:03.193546 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:03.193546 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:03.193546 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:03.193546 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:03.193546 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:03.193546 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:03.193546 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:03.193546 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:03.193546 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:03.193546 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:03.195345 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:03.195345 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:03.195345 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:03.195345 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:03.195345 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:03.195345 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:03.195345 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:03.195345 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:03.195345 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:03.195345 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:03.195345 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:03.195345 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:03.195345 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:03.195345 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:03.195345 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:03.195345 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:03.197173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:03.197173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:03.197173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:03.197173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:03.197173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:03.197173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:03.197173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:03.197173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:03.197173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:03.197173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:03.197173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:04:03.197173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:03.197173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 166/326] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:04:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:03.203392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf87c3-c505-4391-a0b3-daa61dc6453c None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:03.274154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 161/327] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:04:03.299124 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7240874-6f13-4357-8916-102e7da87aa3 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:03.325974 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf87c3-c505-4391-a0b3-daa61dc6453c None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:03.357482 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:03.384373 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11689e-5b6a-4800-8435-eed1a5e53cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:03.385026 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11689e-5b6a-4800-8435-eed1a5e53cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:03.385348 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11689e-5b6a-4800-8435-eed1a5e53cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:03.385632 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11689e-5b6a-4800-8435-eed1a5e53cf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:03.386745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11689e-5b6a-4800-8435-eed1a5e53cf5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:03.387055 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11689e-5b6a-4800-8435-eed1a5e53cf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:03.389347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11689e-5b6a-4800-8435-eed1a5e53cf5 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:03.398694 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 167/328] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:04:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:04:03.404778 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11689e-5b6a-4800-8435-eed1a5e53cf5 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:03.484551 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7240874-6f13-4357-8916-102e7da87aa3 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:03.514926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11689e-5b6a-4800-8435-eed1a5e53cf5 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:03.530525 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:03.545634 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0842211-04a0-405f-9d59-58ce5640e9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:03.546886 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0842211-04a0-405f-9d59-58ce5640e9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:03.547536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0842211-04a0-405f-9d59-58ce5640e9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:03.547969 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0842211-04a0-405f-9d59-58ce5640e9f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:03.550128 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5c177-90be-453d-a157-e6a90bec0996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:03.551024 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5c177-90be-453d-a157-e6a90bec0996 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:03.551308 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5c177-90be-453d-a157-e6a90bec0996 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:03.551584 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5c177-90be-453d-a157-e6a90bec0996 None admin] PATH_INFO: `/v3/users/b99e3af5db8c4a80a2cd13f7e22cc95f` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:03.552786 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5c177-90be-453d-a157-e6a90bec0996 None admin] RBAC: Authorizing `identity:get_user(user_id=b99e3af5db8c4a80a2cd13f7e22cc95f)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:03.554329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5c177-90be-453d-a157-e6a90bec0996 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:03.556796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 168/329] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:04:03 2022] GET /identity/v3/users/b99e3af5db8c4a80a2cd13f7e22cc95f => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:03.562199 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5c177-90be-453d-a157-e6a90bec0996 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:03.565405 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0842211-04a0-405f-9d59-58ce5640e9f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:03.583522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-a0842211-04a0-405f-9d59-58ce5640e9f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:04:03.583522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:03.583522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:03.583522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:03.583522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:03.583522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:03.583522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:03.583522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:03.583522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:03.583522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:03.583522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:03.583522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:03.583522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:03.583522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:03.583522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:03.583522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:03.584461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:03.584461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:03.584461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:03.584461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:03.584461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:03.584461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:03.584461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:03.584461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:03.584461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:03.584461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:03.584461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:03.584461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:03.584461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:03.584461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:03.584461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:03.584461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:03.585314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:03.585314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:03.585314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:03.585314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:03.585314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:03.585314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:03.585314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:03.585314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:03.585314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:03.585314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:03.585314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:04:03.585314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:03.586708 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 162/330] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:04:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:04:03.594463 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0842211-04a0-405f-9d59-58ce5640e9f2 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:03.615160 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:03.727086 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5c177-90be-453d-a157-e6a90bec0996 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:03.740550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0842211-04a0-405f-9d59-58ce5640e9f2 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:03.767231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd6af0-c788-4a3d-a050-97a0c33484da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:03.768664 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd6af0-c788-4a3d-a050-97a0c33484da None admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:03.769186 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd6af0-c788-4a3d-a050-97a0c33484da None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:03.769682 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd6af0-c788-4a3d-a050-97a0c33484da None admin] PATH_INFO: `/v3/system/users/b99e3af5db8c4a80a2cd13f7e22cc95f/roles/ef9c44b998b048b0a8db160073bc0e6f` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:03.771632 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd6af0-c788-4a3d-a050-97a0c33484da None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b99e3af5db8c4a80a2cd13f7e22cc95f, role_id=ef9c44b998b048b0a8db160073bc0e6f)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:03.773225 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd6af0-c788-4a3d-a050-97a0c33484da None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:03.781490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310853cb-7115-4152-81fd-9c1b7734b48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:03.782931 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310853cb-7115-4152-81fd-9c1b7734b48f None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:03.782931 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310853cb-7115-4152-81fd-9c1b7734b48f None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:03.782931 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310853cb-7115-4152-81fd-9c1b7734b48f None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:03.783622 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310853cb-7115-4152-81fd-9c1b7734b48f None admin] RBAC: Adding query filter params (name=member) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:03.783963 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310853cb-7115-4152-81fd-9c1b7734b48f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:03.785357 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310853cb-7115-4152-81fd-9c1b7734b48f None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:03.786750 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 169/331] 10.222.0.17 () {58 vars in 1334 bytes} [Tue Jul 12 13:04:03 2022] PUT /identity/v3/system/users/b99e3af5db8c4a80a2cd13f7e22cc95f/roles/ef9c44b998b048b0a8db160073bc0e6f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:04:03.804324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 163/332] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:04:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:03.812711 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd6af0-c788-4a3d-a050-97a0c33484da None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:03.968729 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd6af0-c788-4a3d-a050-97a0c33484da None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:03.989126 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:04.016866 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae2c63-af6c-4669-90eb-bd0011bd9766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:04.017769 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae2c63-af6c-4669-90eb-bd0011bd9766 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:04.018045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae2c63-af6c-4669-90eb-bd0011bd9766 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:04.018358 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae2c63-af6c-4669-90eb-bd0011bd9766 None admin] PATH_INFO: `/v3/users/53985c6cc54342b6b4f725a9fe78599c` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:04.019993 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae2c63-af6c-4669-90eb-bd0011bd9766 None admin] RBAC: Authorizing `identity:get_user(user_id=53985c6cc54342b6b4f725a9fe78599c)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:04.021470 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae2c63-af6c-4669-90eb-bd0011bd9766 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:04.023435 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 170/333] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:04:03 2022] GET /identity/v3/users/53985c6cc54342b6b4f725a9fe78599c => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:04.029637 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310853cb-7115-4152-81fd-9c1b7734b48f None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:04.092902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:04.174595 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310853cb-7115-4152-81fd-9c1b7734b48f None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:04.226879 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242c3d7-a186-44f9-a907-e5379df15d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:04.228132 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242c3d7-a186-44f9-a907-e5379df15d71 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:04.228734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242c3d7-a186-44f9-a907-e5379df15d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:04.229419 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242c3d7-a186-44f9-a907-e5379df15d71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:04.230814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242c3d7-a186-44f9-a907-e5379df15d71 None admin] RBAC: Adding query filter params (role.id=1727bdbc17d94ff08782d404dce97d35, user.id=53985c6cc54342b6b4f725a9fe78599c, scope.system=all) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:04.231602 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242c3d7-a186-44f9-a907-e5379df15d71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:04.233687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242c3d7-a186-44f9-a907-e5379df15d71 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:04.257087 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 164/334] 10.222.0.17 () {56 vars in 1308 bytes} [Tue Jul 12 13:04:04 2022] GET /identity/v3/role_assignments?user.id=53985c6cc54342b6b4f725a9fe78599c&scope.system=all&role.id=1727bdbc17d94ff08782d404dce97d35 => generated 510 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:05.545574 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad05f2-9658-41b3-ad31-eaa415f8b835 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:05.546100 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad05f2-9658-41b3-ad31-eaa415f8b835 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:05.546100 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad05f2-9658-41b3-ad31-eaa415f8b835 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:05.547881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 171/335] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:05.553173 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57a395-0799-4d51-883f-c624a50283d5 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:05.553645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57a395-0799-4d51-883f-c624a50283d5 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:05.553720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57a395-0799-4d51-883f-c624a50283d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:05.575136 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-5d57a395-0799-4d51-883f-c624a50283d5 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:05.576334 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-5d57a395-0799-4d51-883f-c624a50283d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:05.657843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 165/336] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:05.690446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad05f2-9658-41b3-ad31-eaa415f8b835 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:05.721798 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1add4-cb03-4907-ab59-613c924645b2 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:05.722143 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1add4-cb03-4907-ab59-613c924645b2 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:05.722389 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1add4-cb03-4907-ab59-613c924645b2 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:05.723834 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 166/337] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:05.729415 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8d876-ba77-403e-96f0-d95f3e9ecb39 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:05.729705 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8d876-ba77-403e-96f0-d95f3e9ecb39 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:05.729990 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8d876-ba77-403e-96f0-d95f3e9ecb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:05.767151 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-8ae8d876-ba77-403e-96f0-d95f3e9ecb39 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:05.768357 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-8ae8d876-ba77-403e-96f0-d95f3e9ecb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:05.839997 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:05.841951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad05f2-9658-41b3-ad31-eaa415f8b835 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:05.929098 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ff364-853f-47cb-82cc-e419b16259ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:05.929929 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ff364-853f-47cb-82cc-e419b16259ed None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:05.930241 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ff364-853f-47cb-82cc-e419b16259ed None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:05.931058 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ff364-853f-47cb-82cc-e419b16259ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:05.950215 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ff364-853f-47cb-82cc-e419b16259ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:05.958490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-124ff364-853f-47cb-82cc-e419b16259ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:04:05.958490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:05.958490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:05.958490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:05.958490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:05.958490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:05.958490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:05.958490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:05.958490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:05.958490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:05.958490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:05.958490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:05.958490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:05.958490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:05.958490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:05.958490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:05.959432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:05.959432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:05.959432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:05.959432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:05.959432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:05.959432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:05.959432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:05.959432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:05.959432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:05.959432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:05.959432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:05.959432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:05.959432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:05.959432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:05.959432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:05.959432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:05.960233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:05.960233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:05.960233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:05.960233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:05.960233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:05.960233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:05.960233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:05.960233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:05.960233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:05.960233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:05.960233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:04:05.960233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:05.961077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 172/338] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:04:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:05.968999 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ff364-853f-47cb-82cc-e419b16259ed None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:05.969530 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 167/339] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:06.002342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8d876-ba77-403e-96f0-d95f3e9ecb39 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:06.074748 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:06.194162 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ff364-853f-47cb-82cc-e419b16259ed None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:06.260743 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e9eed-7c55-4fe2-882c-65211634fc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:06.261698 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e9eed-7c55-4fe2-882c-65211634fc0f None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:06.261979 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e9eed-7c55-4fe2-882c-65211634fc0f None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:06.262286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e9eed-7c55-4fe2-882c-65211634fc0f None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:06.263036 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e9eed-7c55-4fe2-882c-65211634fc0f None admin] RBAC: Adding query filter params (name=member) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:06.263344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e9eed-7c55-4fe2-882c-65211634fc0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:06.264734 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e9eed-7c55-4fe2-882c-65211634fc0f None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:06.280437 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8d876-ba77-403e-96f0-d95f3e9ecb39 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:06.282155 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 173/340] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:04:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:06.288297 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e9eed-7c55-4fe2-882c-65211634fc0f None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:06.370895 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad98f2-63d6-4c1f-941c-6ce06fedbdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:06.371809 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad98f2-63d6-4c1f-941c-6ce06fedbdf2 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:06.372013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad98f2-63d6-4c1f-941c-6ce06fedbdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:06.372244 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad98f2-63d6-4c1f-941c-6ce06fedbdf2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:06.399095 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad98f2-63d6-4c1f-941c-6ce06fedbdf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:06.412234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-b8ad98f2-63d6-4c1f-941c-6ce06fedbdf2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:04:06.412234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:06.412234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:06.412234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:06.412234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:06.412234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:06.412234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:06.412234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:06.412234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:06.412234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:06.412234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:06.412234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:06.412234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:06.412234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:06.412234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:06.412234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:06.415718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:06.415718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:06.415718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:06.415718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:06.415718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:06.415718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:06.415718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:06.415718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:06.415718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:06.415718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:06.415718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:06.415718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:06.415718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:06.415718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:06.415718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:06.415718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:06.416539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:06.416539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:06.416539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:06.416539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:06.416539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:06.416539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:06.416539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:06.416539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:06.416539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:06.416539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:06.416539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:04:06.416539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:06.416539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 168/341] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Jul 12 13:04:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:06.423197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad98f2-63d6-4c1f-941c-6ce06fedbdf2 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:06.450453 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e9eed-7c55-4fe2-882c-65211634fc0f None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:06.453541 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:06.478526 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:06.492738 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f17bfb-3191-4098-9602-0ff823ea3823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:06.494312 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f17bfb-3191-4098-9602-0ff823ea3823 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:06.494825 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f17bfb-3191-4098-9602-0ff823ea3823 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:06.495309 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f17bfb-3191-4098-9602-0ff823ea3823 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:06.573591 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f17bfb-3191-4098-9602-0ff823ea3823 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:06.575959 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f17bfb-3191-4098-9602-0ff823ea3823 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:06.589733 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad98f2-63d6-4c1f-941c-6ce06fedbdf2 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:06.646849 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480fcec-e264-43fe-a8cd-5ac8d5c4123f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:06.647547 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480fcec-e264-43fe-a8cd-5ac8d5c4123f None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:06.647833 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480fcec-e264-43fe-a8cd-5ac8d5c4123f None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:06.648107 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480fcec-e264-43fe-a8cd-5ac8d5c4123f None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:06.648864 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480fcec-e264-43fe-a8cd-5ac8d5c4123f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:06.649692 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480fcec-e264-43fe-a8cd-5ac8d5c4123f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:06.651122 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480fcec-e264-43fe-a8cd-5ac8d5c4123f None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:06.664076 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 169/342] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:06.671373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480fcec-e264-43fe-a8cd-5ac8d5c4123f None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:06.693775 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 174/343] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:04:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 13:04:06.700542 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f17bfb-3191-4098-9602-0ff823ea3823 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:06.703883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:06.790476 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:06.825395 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480fcec-e264-43fe-a8cd-5ac8d5c4123f None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:06.876588 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f17bfb-3191-4098-9602-0ff823ea3823 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:06.910888 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f2af5-a787-47c9-b818-acde489e06bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:06.911574 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f2af5-a787-47c9-b818-acde489e06bd None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:06.911864 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f2af5-a787-47c9-b818-acde489e06bd None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:06.912143 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f2af5-a787-47c9-b818-acde489e06bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:06.920429 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e6d21-92ff-47cc-841e-7e1203ffd764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:06.921638 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e6d21-92ff-47cc-841e-7e1203ffd764 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:06.922143 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e6d21-92ff-47cc-841e-7e1203ffd764 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:06.922619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e6d21-92ff-47cc-841e-7e1203ffd764 None admin] PATH_INFO: `/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:06.924010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e6d21-92ff-47cc-841e-7e1203ffd764 None admin] RBAC: Authorizing `identity:get_project(project_id=3afe0ad2d6234e83b0fd6f35ed37e7c9)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:06.925671 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e6d21-92ff-47cc-841e-7e1203ffd764 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:06.929635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 175/344] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:04:06 2022] GET /identity/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:04:06.931385 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118dad6-6cf3-4362-bff7-dbb8da944908 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:06.932377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118dad6-6cf3-4362-bff7-dbb8da944908 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:06.932862 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118dad6-6cf3-4362-bff7-dbb8da944908 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:06.934418 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 176/345] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:06.935886 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118dad6-6cf3-4362-bff7-dbb8da944908 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:07.047493 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f2af5-a787-47c9-b818-acde489e06bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:07.050370 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f2af5-a787-47c9-b818-acde489e06bd None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:07.055053 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:07.114564 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118dad6-6cf3-4362-bff7-dbb8da944908 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:07.178781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4e1e8-5176-4ce0-9632-bd8b0f18f4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:07.182154 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4e1e8-5176-4ce0-9632-bd8b0f18f4ef None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:07.182646 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4e1e8-5176-4ce0-9632-bd8b0f18f4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:07.183120 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4e1e8-5176-4ce0-9632-bd8b0f18f4ef None admin] PATH_INFO: `/v3/groups/c7ba2c33e654464284d92944a04b3201` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:07.193347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4e1e8-5176-4ce0-9632-bd8b0f18f4ef None admin] RBAC: Authorizing `identity:get_group(group_id=c7ba2c33e654464284d92944a04b3201)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:07.200216 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4e1e8-5176-4ce0-9632-bd8b0f18f4ef None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:07.202197 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 177/346] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Jul 12 13:04:06 2022] GET /identity/v3/groups/c7ba2c33e654464284d92944a04b3201 => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:07.203912 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593455d-6279-441f-899a-37c3c0339c93 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:07.206035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593455d-6279-441f-899a-37c3c0339c93 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:07.206547 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593455d-6279-441f-899a-37c3c0339c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:07.215935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:07.236773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-0593455d-6279-441f-899a-37c3c0339c93 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:07.240219 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-0593455d-6279-441f-899a-37c3c0339c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:07.253242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 170/347] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:04:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:04:07.258282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f2af5-a787-47c9-b818-acde489e06bd None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:07.349840 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 178/348] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:07.350679 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593455d-6279-441f-899a-37c3c0339c93 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:07.403873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f2af5-a787-47c9-b818-acde489e06bd None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:07.434084 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:07.454917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da8cf5-80ba-4883-b36c-db13355719ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:07.456268 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da8cf5-80ba-4883-b36c-db13355719ee None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:07.456268 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da8cf5-80ba-4883-b36c-db13355719ee None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:07.456463 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da8cf5-80ba-4883-b36c-db13355719ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:07.457248 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da8cf5-80ba-4883-b36c-db13355719ee None admin] RBAC: Adding query filter params (group.id=c7ba2c33e654464284d92944a04b3201, role.id=1727bdbc17d94ff08782d404dce97d35, scope.project.id=3afe0ad2d6234e83b0fd6f35ed37e7c9) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:07.457566 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da8cf5-80ba-4883-b36c-db13355719ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:07.459756 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da8cf5-80ba-4883-b36c-db13355719ee None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:07.467447 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 171/349] 10.222.0.17 () {56 vars in 1376 bytes} [Tue Jul 12 13:04:07 2022] GET /identity/v3/role_assignments?group.id=c7ba2c33e654464284d92944a04b3201&scope.project.id=3afe0ad2d6234e83b0fd6f35ed37e7c9&role.id=1727bdbc17d94ff08782d404dce97d35 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:07.469507 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6363c-cb96-41c1-84a7-efbfa0325154 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:07.469801 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6363c-cb96-41c1-84a7-efbfa0325154 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:07.470080 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6363c-cb96-41c1-84a7-efbfa0325154 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:07.472255 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 172/350] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:07.473219 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf6363c-cb96-41c1-84a7-efbfa0325154 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:07.486073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593455d-6279-441f-899a-37c3c0339c93 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:07.525410 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc8019-9db4-48b5-8395-e086f89b024f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:07.526791 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc8019-9db4-48b5-8395-e086f89b024f None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:07.527348 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc8019-9db4-48b5-8395-e086f89b024f None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:07.527829 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc8019-9db4-48b5-8395-e086f89b024f None admin] PATH_INFO: `/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:07.529448 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc8019-9db4-48b5-8395-e086f89b024f None admin] RBAC: Authorizing `identity:get_project(project_id=3afe0ad2d6234e83b0fd6f35ed37e7c9)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:07.531234 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc8019-9db4-48b5-8395-e086f89b024f None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:07.533310 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 179/351] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:04:07 2022] GET /identity/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:07.534806 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:07.535151 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbe1e8-0019-4817-a118-f1dc8bc15e45 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:07.535645 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbe1e8-0019-4817-a118-f1dc8bc15e45 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:07.536115 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbe1e8-0019-4817-a118-f1dc8bc15e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:07.556468 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-9bbbe1e8-0019-4817-a118-f1dc8bc15e45 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:07.558143 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-9bbbe1e8-0019-4817-a118-f1dc8bc15e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:07.603667 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf6363c-cb96-41c1-84a7-efbfa0325154 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:07.642433 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd15de-60e2-441b-af32-aea970841287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:07.643281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd15de-60e2-441b-af32-aea970841287 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:07.643609 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd15de-60e2-441b-af32-aea970841287 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:07.643822 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd15de-60e2-441b-af32-aea970841287 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:07.651379 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 180/352] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:07.652989 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbe1e8-0019-4817-a118-f1dc8bc15e45 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:07.657574 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd15de-60e2-441b-af32-aea970841287 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:07.665540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-33cd15de-60e2-441b-af32-aea970841287 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:04:07.665540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:07.665540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:07.665540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:07.665540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:07.665540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:07.665540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:07.665540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:07.665540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:07.665540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:07.665540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:07.665540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:07.665540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:07.665540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:07.665540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:07.665540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:07.666559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:07.666559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:07.666559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:07.666559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:07.666559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:07.666559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:07.666559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:07.666559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:07.666559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:07.666559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:07.666559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:07.666559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:07.666559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:07.666559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:07.666559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:07.666559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:07.667384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:07.667384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:07.667384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:07.667384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:07.667384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:07.667384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:07.667384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:07.667384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:07.667384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:07.667384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:07.667384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:04:07.667384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:07.667384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 173/353] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:04:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:07.676552 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd15de-60e2-441b-af32-aea970841287 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:07.746272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:07.799420 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbe1e8-0019-4817-a118-f1dc8bc15e45 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:07.800937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd15de-60e2-441b-af32-aea970841287 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:07.816686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:07.842369 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d3b19-e2a4-426b-a688-660f253b06ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:07.843573 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d3b19-e2a4-426b-a688-660f253b06ad None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:07.844017 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d3b19-e2a4-426b-a688-660f253b06ad None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:07.844499 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d3b19-e2a4-426b-a688-660f253b06ad None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:07.845689 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d3b19-e2a4-426b-a688-660f253b06ad None admin] RBAC: Adding query filter params (name=reader) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:07.846256 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d3b19-e2a4-426b-a688-660f253b06ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:07.846916 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe770f6-9f88-49c2-9f53-51846ea4f312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:07.847924 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe770f6-9f88-49c2-9f53-51846ea4f312 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:07.848167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d3b19-e2a4-426b-a688-660f253b06ad None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:07.848384 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe770f6-9f88-49c2-9f53-51846ea4f312 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:07.848757 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe770f6-9f88-49c2-9f53-51846ea4f312 None admin] PATH_INFO: `/v3/groups/c7ba2c33e654464284d92944a04b3201` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:07.850601 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe770f6-9f88-49c2-9f53-51846ea4f312 None admin] RBAC: Authorizing `identity:get_group(group_id=c7ba2c33e654464284d92944a04b3201)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:07.852150 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe770f6-9f88-49c2-9f53-51846ea4f312 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:07.854369 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 181/354] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Jul 12 13:04:07 2022] GET /identity/v3/groups/c7ba2c33e654464284d92944a04b3201 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:07.855697 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12482131-e5e6-4820-82f2-47b7291dcdb2 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:07.856082 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12482131-e5e6-4820-82f2-47b7291dcdb2 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:07.856456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12482131-e5e6-4820-82f2-47b7291dcdb2 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:07.858185 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 182/355] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:07.859079 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12482131-e5e6-4820-82f2-47b7291dcdb2 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:07.861876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 174/356] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:04:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:07.863563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58f905-aeb5-45b4-b02b-96284e04d450 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:07.864041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58f905-aeb5-45b4-b02b-96284e04d450 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:07.864615 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58f905-aeb5-45b4-b02b-96284e04d450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:07.886748 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-6a58f905-aeb5-45b4-b02b-96284e04d450 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:07.888219 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-6a58f905-aeb5-45b4-b02b-96284e04d450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:07.969686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 175/357] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:07.970882 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58f905-aeb5-45b4-b02b-96284e04d450 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:07.979424 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12482131-e5e6-4820-82f2-47b7291dcdb2 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:08.016259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:08.025352 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082d68f-719e-47d0-bdf0-c59c15c5d113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:08.026562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082d68f-719e-47d0-bdf0-c59c15c5d113 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:08.027029 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082d68f-719e-47d0-bdf0-c59c15c5d113 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:08.027518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082d68f-719e-47d0-bdf0-c59c15c5d113 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:08.041529 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082d68f-719e-47d0-bdf0-c59c15c5d113 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:08.050580 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-0082d68f-719e-47d0-bdf0-c59c15c5d113 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:04:08.050580 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:08.050580 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:08.050580 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:08.050580 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:08.050580 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:08.050580 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:08.050580 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:08.050580 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:08.050580 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:08.050580 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:08.050580 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:08.050580 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:08.050580 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:08.050580 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:08.050580 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:08.051537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:08.051537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:08.051537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:08.051537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:08.051537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:08.051537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:08.051537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:08.051537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:08.051537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:08.051537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:08.051537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:08.051537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:08.051537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:08.051537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:08.051537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:08.051537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:08.052320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:08.052320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:08.052320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:08.052320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:08.052320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:08.052320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:08.052320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:08.052320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:08.052320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:08.052320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:08.052320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:04:08.052320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:08.055061 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 183/358] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:04:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:08.056341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082d68f-719e-47d0-bdf0-c59c15c5d113 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:08.091705 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:08.101894 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58f905-aeb5-45b4-b02b-96284e04d450 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:08.155459 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaeff9d-f77b-4f5e-bafb-20207e54c87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:08.156217 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeff9d-f77b-4f5e-bafb-20207e54c87b None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:08.156639 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeff9d-f77b-4f5e-bafb-20207e54c87b None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:08.156977 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeff9d-f77b-4f5e-bafb-20207e54c87b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:08.158014 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaeff9d-f77b-4f5e-bafb-20207e54c87b None admin] RBAC: Adding query filter params (group.id=c7ba2c33e654464284d92944a04b3201, role.id=4d86c48385634483af68ab63e48f9787, scope.project.id=3afe0ad2d6234e83b0fd6f35ed37e7c9) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:08.158389 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaeff9d-f77b-4f5e-bafb-20207e54c87b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:08.160717 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaeff9d-f77b-4f5e-bafb-20207e54c87b None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:08.168060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 176/359] 10.222.0.17 () {56 vars in 1376 bytes} [Tue Jul 12 13:04:07 2022] GET /identity/v3/role_assignments?group.id=c7ba2c33e654464284d92944a04b3201&scope.project.id=3afe0ad2d6234e83b0fd6f35ed37e7c9&role.id=4d86c48385634483af68ab63e48f9787 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:08.168906 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaeff9d-f77b-4f5e-bafb-20207e54c87b None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:08.228995 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082d68f-719e-47d0-bdf0-c59c15c5d113 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:08.281085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746f3aa-1ee9-4ca5-9d13-eb83bba78c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:08.282134 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746f3aa-1ee9-4ca5-9d13-eb83bba78c65 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:08.282419 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746f3aa-1ee9-4ca5-9d13-eb83bba78c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:08.282697 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746f3aa-1ee9-4ca5-9d13-eb83bba78c65 None admin] PATH_INFO: `/v3/users/b99e3af5db8c4a80a2cd13f7e22cc95f` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:08.283977 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746f3aa-1ee9-4ca5-9d13-eb83bba78c65 None admin] RBAC: Authorizing `identity:get_user(user_id=b99e3af5db8c4a80a2cd13f7e22cc95f)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:08.285684 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746f3aa-1ee9-4ca5-9d13-eb83bba78c65 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:08.287430 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 184/360] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:04:08 2022] GET /identity/v3/users/b99e3af5db8c4a80a2cd13f7e22cc95f => generated 293 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:08.292747 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746f3aa-1ee9-4ca5-9d13-eb83bba78c65 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:08.310152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaeff9d-f77b-4f5e-bafb-20207e54c87b None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:08.351485 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc624bc-6a83-4151-af89-423dc109cca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:08.353231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc624bc-6a83-4151-af89-423dc109cca5 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:08.353688 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc624bc-6a83-4151-af89-423dc109cca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:08.354166 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc624bc-6a83-4151-af89-423dc109cca5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:08.368597 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:08.370852 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc624bc-6a83-4151-af89-423dc109cca5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:08.380528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-2cc624bc-6a83-4151-af89-423dc109cca5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:04:08.380528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:08.380528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:08.380528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:08.380528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:08.380528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:08.380528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:08.380528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:08.380528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:08.380528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:08.380528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:08.380528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:08.380528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:08.380528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:08.380528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:08.380528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:08.381584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:08.381584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:08.381584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:08.381584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:08.381584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:08.381584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:08.381584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:08.381584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:08.381584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:08.381584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:08.381584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:08.381584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:08.381584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:08.381584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:08.381584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:08.381584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:08.384071 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:08.384071 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:08.384071 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:08.384071 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:08.384071 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:08.384071 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:08.384071 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:08.384071 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:08.384071 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:08.384071 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:08.384071 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:04:08.384071 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:08.384071 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 177/361] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Jul 12 13:04:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:08.384071 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483035b-8a59-4353-854f-e8476ae5de8e None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:08.386392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483035b-8a59-4353-854f-e8476ae5de8e None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:08.386392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483035b-8a59-4353-854f-e8476ae5de8e None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:08.386392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 178/362] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:08.386392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483035b-8a59-4353-854f-e8476ae5de8e None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:08.414075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:08.424557 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746f3aa-1ee9-4ca5-9d13-eb83bba78c65 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:08.479419 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f52c04-0a5d-4d84-b3bd-d81d4ef115a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:08.480772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f52c04-0a5d-4d84-b3bd-d81d4ef115a1 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:08.481286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f52c04-0a5d-4d84-b3bd-d81d4ef115a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:08.481795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f52c04-0a5d-4d84-b3bd-d81d4ef115a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:08.483578 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f52c04-0a5d-4d84-b3bd-d81d4ef115a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:08.484404 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f52c04-0a5d-4d84-b3bd-d81d4ef115a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:08.486711 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f52c04-0a5d-4d84-b3bd-d81d4ef115a1 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:08.500553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 185/363] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:04:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:08.501940 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f52c04-0a5d-4d84-b3bd-d81d4ef115a1 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:08.561160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483035b-8a59-4353-854f-e8476ae5de8e None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:08.602241 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed045871-f6a8-400f-934c-2bd8e6a1ae08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:08.603290 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed045871-f6a8-400f-934c-2bd8e6a1ae08 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:08.603803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed045871-f6a8-400f-934c-2bd8e6a1ae08 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:08.604731 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed045871-f6a8-400f-934c-2bd8e6a1ae08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:08.605791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed045871-f6a8-400f-934c-2bd8e6a1ae08 None admin] RBAC: Adding query filter params (role.id=ef9c44b998b048b0a8db160073bc0e6f, user.id=b99e3af5db8c4a80a2cd13f7e22cc95f, scope.system=all) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:08.606348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed045871-f6a8-400f-934c-2bd8e6a1ae08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:08.608059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed045871-f6a8-400f-934c-2bd8e6a1ae08 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:08.623318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 179/364] 10.222.0.17 () {56 vars in 1308 bytes} [Tue Jul 12 13:04:08 2022] GET /identity/v3/role_assignments?user.id=b99e3af5db8c4a80a2cd13f7e22cc95f&scope.system=all&role.id=ef9c44b998b048b0a8db160073bc0e6f => generated 510 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:08.625007 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50472b-14cc-4476-83d4-1727ebb90456 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:08.625532 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50472b-14cc-4476-83d4-1727ebb90456 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:08.626033 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50472b-14cc-4476-83d4-1727ebb90456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:08.646478 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-3e50472b-14cc-4476-83d4-1727ebb90456 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:08.648209 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-3e50472b-14cc-4476-83d4-1727ebb90456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:08.652083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f52c04-0a5d-4d84-b3bd-d81d4ef115a1 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:08.696717 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:08.738976 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa438d-ef4b-416b-9008-47f6c5395153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:08.739690 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa438d-ef4b-416b-9008-47f6c5395153 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:08.739984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa438d-ef4b-416b-9008-47f6c5395153 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:08.740271 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa438d-ef4b-416b-9008-47f6c5395153 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:08.741308 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa438d-ef4b-416b-9008-47f6c5395153 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:08.741441 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa438d-ef4b-416b-9008-47f6c5395153 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:08.743423 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa438d-ef4b-416b-9008-47f6c5395153 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:08.761229 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 186/365] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:08.761954 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa438d-ef4b-416b-9008-47f6c5395153 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:08.765445 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 180/366] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:08.768743 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50472b-14cc-4476-83d4-1727ebb90456 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:08.784177 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:08.939742 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa438d-ef4b-416b-9008-47f6c5395153 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:08.940932 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50472b-14cc-4476-83d4-1727ebb90456 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:08.990595 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3a703-ff10-4bdd-82ee-a8cc0cb02c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:08.991544 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3a703-ff10-4bdd-82ee-a8cc0cb02c67 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:08.991986 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3a703-ff10-4bdd-82ee-a8cc0cb02c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:08.992429 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3a703-ff10-4bdd-82ee-a8cc0cb02c67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:08.997640 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbc016-ce58-4777-a935-315b59e8f1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:08.997838 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbc016-ce58-4777-a935-315b59e8f1dd None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:08.998173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbc016-ce58-4777-a935-315b59e8f1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:08.998493 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbc016-ce58-4777-a935-315b59e8f1dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:09.094322 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3a703-ff10-4bdd-82ee-a8cc0cb02c67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:09.095992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3a703-ff10-4bdd-82ee-a8cc0cb02c67 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:09.100405 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:09.109308 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:09.126029 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bbc016-ce58-4777-a935-315b59e8f1dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:09.127995 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bbc016-ce58-4777-a935-315b59e8f1dd None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:09.218140 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 181/367] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:04:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:04:09.218140 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3a703-ff10-4bdd-82ee-a8cc0cb02c67 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:09.261116 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 187/368] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:04:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:04:09.266428 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbc016-ce58-4777-a935-315b59e8f1dd None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:09.323845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3a703-ff10-4bdd-82ee-a8cc0cb02c67 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:09.333741 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:09.361072 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe6180-3473-4850-b4f7-bf044c6d4f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:09.361790 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe6180-3473-4850-b4f7-bf044c6d4f4c None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:09.362079 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe6180-3473-4850-b4f7-bf044c6d4f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:09.362501 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe6180-3473-4850-b4f7-bf044c6d4f4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:09.364309 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:09.375069 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe6180-3473-4850-b4f7-bf044c6d4f4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:09.383135 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-71fe6180-3473-4850-b4f7-bf044c6d4f4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:04:09.383135 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:09.383135 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:09.383135 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:09.383135 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:09.383135 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:09.383135 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:09.383135 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:09.383135 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:09.383135 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:09.383135 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:09.383135 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:09.383135 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:09.383135 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:09.383135 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:09.383135 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:09.384830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:09.384830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:09.384830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:09.384830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:09.384830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:09.384830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:09.384830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:09.384830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:09.384830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:09.384830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:09.384830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:09.384830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:09.384830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:09.384830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:09.384830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:09.384830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:09.386582 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:09.386582 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:09.386582 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:09.386582 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:09.386582 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:09.386582 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:09.386582 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:09.386582 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:09.386582 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:09.386582 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:09.386582 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:04:09.386582 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:09.386582 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 182/369] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:04:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:09.386582 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe6180-3473-4850-b4f7-bf044c6d4f4c None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:09.390231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbc016-ce58-4777-a935-315b59e8f1dd None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:09.438103 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226905ff-2359-431e-8a66-7df34e7d038f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:09.439688 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226905ff-2359-431e-8a66-7df34e7d038f None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:09.440122 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226905ff-2359-431e-8a66-7df34e7d038f None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:09.440806 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226905ff-2359-431e-8a66-7df34e7d038f None admin] PATH_INFO: `/v3/projects/878eddd0b05c4cc382e41c3d429ddcee` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:09.442429 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226905ff-2359-431e-8a66-7df34e7d038f None admin] RBAC: Authorizing `identity:get_project(project_id=878eddd0b05c4cc382e41c3d429ddcee)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:09.444053 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226905ff-2359-431e-8a66-7df34e7d038f None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:09.446771 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 188/370] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:04:09 2022] GET /identity/v3/projects/878eddd0b05c4cc382e41c3d429ddcee => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:09.447701 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226905ff-2359-431e-8a66-7df34e7d038f None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:09.529282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe6180-3473-4850-b4f7-bf044c6d4f4c None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:09.572968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f50a98-16a9-4d32-867e-1a03c0858562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:09.573868 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f50a98-16a9-4d32-867e-1a03c0858562 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:09.574206 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f50a98-16a9-4d32-867e-1a03c0858562 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:09.574492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f50a98-16a9-4d32-867e-1a03c0858562 None admin] PATH_INFO: `/v3/projects/878eddd0b05c4cc382e41c3d429ddcee` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:09.575792 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f50a98-16a9-4d32-867e-1a03c0858562 None admin] RBAC: Authorizing `identity:get_project(project_id=878eddd0b05c4cc382e41c3d429ddcee)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:09.577264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f50a98-16a9-4d32-867e-1a03c0858562 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:09.579568 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 183/371] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:04:09 2022] GET /identity/v3/projects/878eddd0b05c4cc382e41c3d429ddcee => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:09.580508 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f50a98-16a9-4d32-867e-1a03c0858562 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:09.603440 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226905ff-2359-431e-8a66-7df34e7d038f None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:09.634553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:09.649383 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956a24a-d642-4afe-b543-b14bb93c7c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:09.650377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956a24a-d642-4afe-b543-b14bb93c7c0f None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:09.650819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956a24a-d642-4afe-b543-b14bb93c7c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:09.651249 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956a24a-d642-4afe-b543-b14bb93c7c0f None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:09.652152 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956a24a-d642-4afe-b543-b14bb93c7c0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:09.654011 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956a24a-d642-4afe-b543-b14bb93c7c0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:09.657126 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956a24a-d642-4afe-b543-b14bb93c7c0f None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:09.673929 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 189/372] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:04:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:09.675608 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956a24a-d642-4afe-b543-b14bb93c7c0f None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:09.695477 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:09.713486 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f50a98-16a9-4d32-867e-1a03c0858562 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:09.757106 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7fc7b2-a215-4e73-a55c-b09f79a1dfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:09.759060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7fc7b2-a215-4e73-a55c-b09f79a1dfd6 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:09.760588 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7fc7b2-a215-4e73-a55c-b09f79a1dfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:09.761341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7fc7b2-a215-4e73-a55c-b09f79a1dfd6 None admin] PATH_INFO: `/v3/groups/c7ba2c33e654464284d92944a04b3201` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:09.764287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7fc7b2-a215-4e73-a55c-b09f79a1dfd6 None admin] RBAC: Authorizing `identity:get_group(group_id=c7ba2c33e654464284d92944a04b3201)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:09.767828 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7fc7b2-a215-4e73-a55c-b09f79a1dfd6 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:09.771086 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 184/373] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Jul 12 13:04:09 2022] GET /identity/v3/groups/c7ba2c33e654464284d92944a04b3201 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:09.772483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7fc7b2-a215-4e73-a55c-b09f79a1dfd6 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:09.795843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956a24a-d642-4afe-b543-b14bb93c7c0f None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:09.841184 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480d308-5676-4de3-bedf-641544ec6c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:09.842066 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480d308-5676-4de3-bedf-641544ec6c6c None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:09.842378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480d308-5676-4de3-bedf-641544ec6c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:09.842650 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480d308-5676-4de3-bedf-641544ec6c6c None admin] PATH_INFO: `/v3/groups/c7ba2c33e654464284d92944a04b3201` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:09.844495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480d308-5676-4de3-bedf-641544ec6c6c None admin] RBAC: Authorizing `identity:get_group(group_id=c7ba2c33e654464284d92944a04b3201)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:09.846264 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480d308-5676-4de3-bedf-641544ec6c6c None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:09.849304 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 190/374] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Jul 12 13:04:09 2022] GET /identity/v3/groups/c7ba2c33e654464284d92944a04b3201 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:09.850483 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480d308-5676-4de3-bedf-641544ec6c6c None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:09.921073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7fc7b2-a215-4e73-a55c-b09f79a1dfd6 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:09.924283 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:09.967877 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:09.978581 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9c8c2-bd0a-46c3-9d65-01bc0a277775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:09.979315 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9c8c2-bd0a-46c3-9d65-01bc0a277775 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:09.979604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9c8c2-bd0a-46c3-9d65-01bc0a277775 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:09.979932 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9c8c2-bd0a-46c3-9d65-01bc0a277775 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:09.997785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480d308-5676-4de3-bedf-641544ec6c6c None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:10.058088 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0261dc8-85fb-4cc7-94da-6df806838743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:10.059006 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0261dc8-85fb-4cc7-94da-6df806838743 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:10.059006 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0261dc8-85fb-4cc7-94da-6df806838743 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:10.059192 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0261dc8-85fb-4cc7-94da-6df806838743 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:10.060030 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0261dc8-85fb-4cc7-94da-6df806838743 None admin] RBAC: Adding query filter params (group.id=c7ba2c33e654464284d92944a04b3201, role.id=4d86c48385634483af68ab63e48f9787, scope.project.id=878eddd0b05c4cc382e41c3d429ddcee) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:10.060349 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0261dc8-85fb-4cc7-94da-6df806838743 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:10.061811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0261dc8-85fb-4cc7-94da-6df806838743 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:10.069485 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 191/375] 10.222.0.17 () {56 vars in 1376 bytes} [Tue Jul 12 13:04:09 2022] GET /identity/v3/role_assignments?group.id=c7ba2c33e654464284d92944a04b3201&scope.project.id=878eddd0b05c4cc382e41c3d429ddcee&role.id=4d86c48385634483af68ab63e48f9787 => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:10.070342 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0261dc8-85fb-4cc7-94da-6df806838743 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:10.103627 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed9c8c2-bd0a-46c3-9d65-01bc0a277775 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:10.105552 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed9c8c2-bd0a-46c3-9d65-01bc0a277775 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:10.255502 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0261dc8-85fb-4cc7-94da-6df806838743 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:10.262956 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 185/376] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:04:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:04:10.264355 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ba702-3821-492a-a75b-3fbd3ee85dad None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:10.264654 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ba702-3821-492a-a75b-3fbd3ee85dad None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:10.264939 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ba702-3821-492a-a75b-3fbd3ee85dad None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:10.267049 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 186/377] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:10.271157 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ba702-3821-492a-a75b-3fbd3ee85dad None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:10.283282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:10.305910 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa24c3a-169d-478d-ab97-aade8aa24992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:10.307015 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa24c3a-169d-478d-ab97-aade8aa24992 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:10.307539 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa24c3a-169d-478d-ab97-aade8aa24992 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:10.308011 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa24c3a-169d-478d-ab97-aade8aa24992 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:10.309109 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa24c3a-169d-478d-ab97-aade8aa24992 None admin] RBAC: Adding query filter params (group.id=c7ba2c33e654464284d92944a04b3201, role.id=1727bdbc17d94ff08782d404dce97d35, scope.project.id=878eddd0b05c4cc382e41c3d429ddcee) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:10.309646 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa24c3a-169d-478d-ab97-aade8aa24992 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:10.311370 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa24c3a-169d-478d-ab97-aade8aa24992 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:10.317858 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 192/378] 10.222.0.17 () {56 vars in 1376 bytes} [Tue Jul 12 13:04:10 2022] GET /identity/v3/role_assignments?group.id=c7ba2c33e654464284d92944a04b3201&scope.project.id=878eddd0b05c4cc382e41c3d429ddcee&role.id=1727bdbc17d94ff08782d404dce97d35 => generated 260 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:10.319504 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e194f80-c472-447a-a070-0d29f6fb9bb0 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:10.320676 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e194f80-c472-447a-a070-0d29f6fb9bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:10.321262 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e194f80-c472-447a-a070-0d29f6fb9bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:10.340979 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-8e194f80-c472-447a-a070-0d29f6fb9bb0 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:10.343621 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-8e194f80-c472-447a-a070-0d29f6fb9bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:10.352034 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:10.449950 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ba702-3821-492a-a75b-3fbd3ee85dad None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:10.456562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 193/379] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:10.495350 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e194f80-c472-447a-a070-0d29f6fb9bb0 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:10.515391 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388b3a9-25d9-4685-90fe-0d72025441de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:10.516306 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388b3a9-25d9-4685-90fe-0d72025441de None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:10.516590 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388b3a9-25d9-4685-90fe-0d72025441de None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:10.516865 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388b3a9-25d9-4685-90fe-0d72025441de None admin] PATH_INFO: `/v3/projects/b00723f48e18481b8e6c727fe321edb1` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:10.519082 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388b3a9-25d9-4685-90fe-0d72025441de None admin] RBAC: Authorizing `identity:get_project(project_id=b00723f48e18481b8e6c727fe321edb1)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:10.520558 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388b3a9-25d9-4685-90fe-0d72025441de None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:10.522386 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 187/380] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:04:10 2022] GET /identity/v3/projects/b00723f48e18481b8e6c727fe321edb1 => generated 344 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:10.530038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388b3a9-25d9-4685-90fe-0d72025441de None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:10.669553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:10.686469 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e194f80-c472-447a-a070-0d29f6fb9bb0 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:10.733448 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388b3a9-25d9-4685-90fe-0d72025441de None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:10.745456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d4ae6-623d-4fd0-95db-dc1001e496c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:10.746748 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d4ae6-623d-4fd0-95db-dc1001e496c3 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:10.747237 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d4ae6-623d-4fd0-95db-dc1001e496c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:10.747695 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d4ae6-623d-4fd0-95db-dc1001e496c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:10.759107 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:10.763097 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d4ae6-623d-4fd0-95db-dc1001e496c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:10.771793 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-453d4ae6-623d-4fd0-95db-dc1001e496c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:04:10.771793 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:10.771793 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:10.771793 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:10.771793 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:10.771793 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:10.771793 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:10.771793 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:10.771793 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:10.771793 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:10.771793 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:10.771793 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:10.771793 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:10.771793 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:10.771793 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:10.771793 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:10.772801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:10.772801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:10.772801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:10.772801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:10.772801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:10.772801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:10.772801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:10.772801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:10.772801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:10.772801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:10.772801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:10.772801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:10.772801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:10.772801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:10.772801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:10.772801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:10.773606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:10.773606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:10.773606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:10.773606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:10.773606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:10.773606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:10.773606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:10.773606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:10.773606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:10.773606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:10.773606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:04:10.773606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:10.774857 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bd312-52ce-4196-8136-7e51c4407de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:10.775496 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bd312-52ce-4196-8136-7e51c4407de4 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:10.775785 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bd312-52ce-4196-8136-7e51c4407de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:10.776064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bd312-52ce-4196-8136-7e51c4407de4 None admin] PATH_INFO: `/v3/groups/1e27ca02406e43a7858449f496d466be` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:10.776899 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 194/381] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:04:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:04:10.779790 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb85e5e-6ad4-4e40-92bc-83e554de79a4 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:10.780304 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb85e5e-6ad4-4e40-92bc-83e554de79a4 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:10.780843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb85e5e-6ad4-4e40-92bc-83e554de79a4 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:10.782566 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 195/382] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:10.783499 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb85e5e-6ad4-4e40-92bc-83e554de79a4 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:10.787463 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1bd312-52ce-4196-8136-7e51c4407de4 None admin] RBAC: Authorizing `identity:get_group(group_id=1e27ca02406e43a7858449f496d466be)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:10.788969 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1bd312-52ce-4196-8136-7e51c4407de4 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:10.792100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 188/383] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Jul 12 13:04:10 2022] GET /identity/v3/groups/1e27ca02406e43a7858449f496d466be => generated 229 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:10.798405 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c47a77-e79a-468e-acae-35f91c3840e7 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:10.798697 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c47a77-e79a-468e-acae-35f91c3840e7 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:10.798979 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c47a77-e79a-468e-acae-35f91c3840e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:10.818007 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-a8c47a77-e79a-468e-acae-35f91c3840e7 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:10.822740 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-a8c47a77-e79a-468e-acae-35f91c3840e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:10.914242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 189/384] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:10.915874 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c47a77-e79a-468e-acae-35f91c3840e7 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:10.959953 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb85e5e-6ad4-4e40-92bc-83e554de79a4 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:11.013660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a8295-ceba-4490-ba13-a3cb47d49c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:11.014825 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a8295-ceba-4490-ba13-a3cb47d49c6d None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:11.015311 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a8295-ceba-4490-ba13-a3cb47d49c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:11.015783 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a8295-ceba-4490-ba13-a3cb47d49c6d None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:11.017047 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a8295-ceba-4490-ba13-a3cb47d49c6d None admin] RBAC: Adding query filter params (name=member) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:11.017573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a8295-ceba-4490-ba13-a3cb47d49c6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:11.020206 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a8295-ceba-4490-ba13-a3cb47d49c6d None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:11.034834 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:11.038782 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 196/385] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:04:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:11.039850 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a8295-ceba-4490-ba13-a3cb47d49c6d None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:11.108696 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c47a77-e79a-468e-acae-35f91c3840e7 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:11.129791 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:11.150003 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3531702-9340-4c58-aedd-72c839b8b3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:11.150720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3531702-9340-4c58-aedd-72c839b8b3ec None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:11.151005 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3531702-9340-4c58-aedd-72c839b8b3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:11.151282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3531702-9340-4c58-aedd-72c839b8b3ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:11.152125 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3531702-9340-4c58-aedd-72c839b8b3ec None admin] RBAC: Adding query filter params (group.id=1e27ca02406e43a7858449f496d466be, role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0, scope.project.id=b00723f48e18481b8e6c727fe321edb1) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:11.152434 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3531702-9340-4c58-aedd-72c839b8b3ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:11.153934 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3531702-9340-4c58-aedd-72c839b8b3ec None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:11.163518 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 190/386] 10.222.0.17 () {56 vars in 1376 bytes} [Tue Jul 12 13:04:10 2022] GET /identity/v3/role_assignments?group.id=1e27ca02406e43a7858449f496d466be&scope.project.id=b00723f48e18481b8e6c727fe321edb1&role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 260 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:11.164390 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3531702-9340-4c58-aedd-72c839b8b3ec None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:11.173079 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a8295-ceba-4490-ba13-a3cb47d49c6d None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:11.224280 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389be16c-e0a4-421e-adcb-805e552617ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:11.225056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389be16c-e0a4-421e-adcb-805e552617ed None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:11.225343 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389be16c-e0a4-421e-adcb-805e552617ed None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:11.225620 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389be16c-e0a4-421e-adcb-805e552617ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:11.243484 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389be16c-e0a4-421e-adcb-805e552617ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:11.251830 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-389be16c-e0a4-421e-adcb-805e552617ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:04:11.251830 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:11.251830 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:11.251830 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:11.251830 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:11.251830 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:11.251830 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:11.251830 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:11.251830 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:11.251830 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:11.251830 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:11.251830 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:11.251830 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:11.251830 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:11.251830 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:11.251830 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:11.252796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:11.252796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:11.252796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:11.252796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:11.252796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:11.252796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:11.252796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:11.252796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:11.252796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:11.252796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:11.252796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:11.252796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:11.252796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:11.252796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:11.252796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:11.252796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:11.253660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:11.253660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:11.253660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:11.253660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:11.253660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:11.253660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:11.253660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:11.253660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:11.253660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:11.253660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:11.253660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:04:11.253660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:11.253660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 197/387] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Jul 12 13:04:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:11.260539 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389be16c-e0a4-421e-adcb-805e552617ed None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:11.370021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3531702-9340-4c58-aedd-72c839b8b3ec None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:11.417480 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389be16c-e0a4-421e-adcb-805e552617ed None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:11.443331 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:11.452504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b27c9-5167-4f00-9348-ba108ed78040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:11.453398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b27c9-5167-4f00-9348-ba108ed78040 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:11.453683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b27c9-5167-4f00-9348-ba108ed78040 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:11.453961 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b27c9-5167-4f00-9348-ba108ed78040 None admin] PATH_INFO: `/v3/groups/c7ba2c33e654464284d92944a04b3201` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:11.455244 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b27c9-5167-4f00-9348-ba108ed78040 None admin] RBAC: Authorizing `identity:get_group(group_id=c7ba2c33e654464284d92944a04b3201)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:11.456718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b27c9-5167-4f00-9348-ba108ed78040 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:11.461082 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 191/388] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Jul 12 13:04:11 2022] GET /identity/v3/groups/c7ba2c33e654464284d92944a04b3201 => generated 226 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:11.467370 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b27c9-5167-4f00-9348-ba108ed78040 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:11.472615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:11.493113 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafdc94-7ce8-4912-aa71-242f4002f2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:11.493732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafdc94-7ce8-4912-aa71-242f4002f2e7 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:11.494020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafdc94-7ce8-4912-aa71-242f4002f2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:11.494400 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafdc94-7ce8-4912-aa71-242f4002f2e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:11.495163 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbafdc94-7ce8-4912-aa71-242f4002f2e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:11.495477 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbafdc94-7ce8-4912-aa71-242f4002f2e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:11.496939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbafdc94-7ce8-4912-aa71-242f4002f2e7 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:11.507489 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 198/389] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:04:11.515803 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafdc94-7ce8-4912-aa71-242f4002f2e7 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:11.666592 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b27c9-5167-4f00-9348-ba108ed78040 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:11.738805 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafdc94-7ce8-4912-aa71-242f4002f2e7 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:11.741077 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655bf450-efab-4e8e-b1ca-0e597eb84c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:11.741975 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655bf450-efab-4e8e-b1ca-0e597eb84c0a None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:11.742285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655bf450-efab-4e8e-b1ca-0e597eb84c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:11.742561 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655bf450-efab-4e8e-b1ca-0e597eb84c0a None admin] PATH_INFO: `/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:11.746024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655bf450-efab-4e8e-b1ca-0e597eb84c0a None admin] RBAC: Authorizing `identity:get_project(project_id=3afe0ad2d6234e83b0fd6f35ed37e7c9)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:11.747452 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655bf450-efab-4e8e-b1ca-0e597eb84c0a None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:11.754712 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 192/390] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:04:11 2022] GET /identity/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9 => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:04:11.755625 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655bf450-efab-4e8e-b1ca-0e597eb84c0a None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:11.811918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cbb1b-6d83-4a38-b739-440a4c6e2ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:11.812805 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cbb1b-6d83-4a38-b739-440a4c6e2ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:11.813085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cbb1b-6d83-4a38-b739-440a4c6e2ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:11.813356 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cbb1b-6d83-4a38-b739-440a4c6e2ee1 None admin] PATH_INFO: `/v3/groups/c7ba2c33e654464284d92944a04b3201` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:11.815649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47cbb1b-6d83-4a38-b739-440a4c6e2ee1 None admin] RBAC: Authorizing `identity:get_group(group_id=c7ba2c33e654464284d92944a04b3201)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:11.817105 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47cbb1b-6d83-4a38-b739-440a4c6e2ee1 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:11.819010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 199/391] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Jul 12 13:04:11 2022] GET /identity/v3/groups/c7ba2c33e654464284d92944a04b3201 => generated 226 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:11.827237 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cbb1b-6d83-4a38-b739-440a4c6e2ee1 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:11.880169 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:11.902329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:11.975242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655bf450-efab-4e8e-b1ca-0e597eb84c0a None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:11.979293 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cbb1b-6d83-4a38-b739-440a4c6e2ee1 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:12.026319 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8ae01-00c9-4749-8afa-e8a8f97a7c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:12.027274 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8ae01-00c9-4749-8afa-e8a8f97a7c4d None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:12.027642 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8ae01-00c9-4749-8afa-e8a8f97a7c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:12.027970 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8ae01-00c9-4749-8afa-e8a8f97a7c4d None admin] PATH_INFO: `/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:12.030461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8ae01-00c9-4749-8afa-e8a8f97a7c4d None admin] RBAC: Authorizing `identity:get_project(project_id=3afe0ad2d6234e83b0fd6f35ed37e7c9)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:12.031969 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8ae01-00c9-4749-8afa-e8a8f97a7c4d None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:12.033989 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 200/392] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:04:11 2022] GET /identity/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:12.052330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc946de4-0634-4695-b243-b38bdf695a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:12.053243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc946de4-0634-4695-b243-b38bdf695a39 None admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:12.053530 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc946de4-0634-4695-b243-b38bdf695a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:12.053808 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc946de4-0634-4695-b243-b38bdf695a39 None admin] PATH_INFO: `/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9/groups/c7ba2c33e654464284d92944a04b3201/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:12.056530 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8ae01-00c9-4749-8afa-e8a8f97a7c4d None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:12.068798 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc946de4-0634-4695-b243-b38bdf695a39 None admin] RBAC: Authorizing `identity:create_grant(project_id=3afe0ad2d6234e83b0fd6f35ed37e7c9, group_id=c7ba2c33e654464284d92944a04b3201, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:12.071269 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc946de4-0634-4695-b243-b38bdf695a39 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:12.098548 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 193/393] 10.222.0.17 () {58 vars in 1442 bytes} [Tue Jul 12 13:04:11 2022] PUT /identity/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9/groups/c7ba2c33e654464284d92944a04b3201/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:04:12.200456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8ae01-00c9-4749-8afa-e8a8f97a7c4d None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:12.234941 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:12.253364 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74836f-32e5-41a8-828d-19b0050070d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:12.254315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74836f-32e5-41a8-828d-19b0050070d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:12.254606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74836f-32e5-41a8-828d-19b0050070d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:12.254886 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74836f-32e5-41a8-828d-19b0050070d4 None admin] PATH_INFO: `/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9/groups/c7ba2c33e654464284d92944a04b3201/roles/4d86c48385634483af68ab63e48f9787` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:12.263870 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74836f-32e5-41a8-828d-19b0050070d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=3afe0ad2d6234e83b0fd6f35ed37e7c9, group_id=c7ba2c33e654464284d92944a04b3201, role_id=4d86c48385634483af68ab63e48f9787)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:12.265379 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74836f-32e5-41a8-828d-19b0050070d4 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:12.290166 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 201/394] 10.222.0.17 () {58 vars in 1442 bytes} [Tue Jul 12 13:04:12 2022] PUT /identity/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9/groups/c7ba2c33e654464284d92944a04b3201/roles/4d86c48385634483af68ab63e48f9787 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:04:12.649636 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e37c4c-5345-4816-8602-0bb2cfb5688b None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:12.649931 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e37c4c-5345-4816-8602-0bb2cfb5688b None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:12.650145 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e37c4c-5345-4816-8602-0bb2cfb5688b None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:12.651844 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 194/395] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:12.658167 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1d3d3-b29b-41d1-9183-4b9e6f77c7ee None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:12.658465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1d3d3-b29b-41d1-9183-4b9e6f77c7ee None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:12.658750 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1d3d3-b29b-41d1-9183-4b9e6f77c7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:12.683400 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-e8f1d3d3-b29b-41d1-9183-4b9e6f77c7ee None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:12.684641 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-e8f1d3d3-b29b-41d1-9183-4b9e6f77c7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:12.783138 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 202/396] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:12.822722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e37c4c-5345-4816-8602-0bb2cfb5688b None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:12.992016 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e37c4c-5345-4816-8602-0bb2cfb5688b None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:13.029105 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:13.035124 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc54b45-f05e-4498-8804-0722da0b17ec None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:13.035415 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc54b45-f05e-4498-8804-0722da0b17ec None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:13.035703 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc54b45-f05e-4498-8804-0722da0b17ec None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:13.037729 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 203/397] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:04:13.040059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d05581-4e1b-4940-8c87-8fdc5492f7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:13.040950 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d05581-4e1b-4940-8c87-8fdc5492f7dd None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:13.041240 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d05581-4e1b-4940-8c87-8fdc5492f7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:13.041527 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d05581-4e1b-4940-8c87-8fdc5492f7dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:13.047355 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16f695-90f5-4d6f-a3e3-254f08e19a81 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:13.047980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16f695-90f5-4d6f-a3e3-254f08e19a81 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:13.048415 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16f695-90f5-4d6f-a3e3-254f08e19a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:13.060794 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d05581-4e1b-4940-8c87-8fdc5492f7dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:13.069212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-d3d05581-4e1b-4940-8c87-8fdc5492f7dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:04:13.069212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:13.069212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:13.069212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:13.069212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:13.069212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:13.069212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:13.069212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:13.069212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:13.069212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:13.069212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:13.069212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:13.069212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:13.069212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:13.069212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:13.069212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:13.070232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:13.070232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:13.070232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:13.070232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:13.070232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:13.070232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:13.070232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:13.070232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:13.070232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:13.070232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:13.070232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:13.070232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:13.070232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:13.070232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:13.070232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:13.070232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:13.071980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:13.071980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:13.071980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:13.071980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:13.071980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:13.071980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:13.071980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:13.071980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:13.071980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:13.071980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:13.071980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:04:13.071980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:13.071980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 195/398] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Jul 12 13:04:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:13.083208 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d05581-4e1b-4940-8c87-8fdc5492f7dd None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:13.091248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-9f16f695-90f5-4d6f-a3e3-254f08e19a81 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:13.092481 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-9f16f695-90f5-4d6f-a3e3-254f08e19a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:13.214874 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d05581-4e1b-4940-8c87-8fdc5492f7dd None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:13.251104 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 204/399] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:04:13.267963 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a08687-433a-4851-a8c1-6f3780d6ca1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:13.268655 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a08687-433a-4851-a8c1-6f3780d6ca1c None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:13.268940 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a08687-433a-4851-a8c1-6f3780d6ca1c None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:13.269217 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a08687-433a-4851-a8c1-6f3780d6ca1c None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:13.269976 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a08687-433a-4851-a8c1-6f3780d6ca1c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:13.270323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a08687-433a-4851-a8c1-6f3780d6ca1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:13.271704 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a08687-433a-4851-a8c1-6f3780d6ca1c None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:13.282590 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 196/400] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:13.290898 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16f695-90f5-4d6f-a3e3-254f08e19a81 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:13.301777 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a08687-433a-4851-a8c1-6f3780d6ca1c None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:13.357675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:13.421303 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:13.466532 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16f695-90f5-4d6f-a3e3-254f08e19a81 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:13.518143 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d64b1b-e3eb-4d6d-948f-203b2d63c472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:13.518954 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d64b1b-e3eb-4d6d-948f-203b2d63c472 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:13.519240 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d64b1b-e3eb-4d6d-948f-203b2d63c472 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:13.519516 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d64b1b-e3eb-4d6d-948f-203b2d63c472 None admin] PATH_INFO: `/v3/groups/c7ba2c33e654464284d92944a04b3201` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:13.521559 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d64b1b-e3eb-4d6d-948f-203b2d63c472 None admin] RBAC: Authorizing `identity:get_group(group_id=c7ba2c33e654464284d92944a04b3201)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:13.523064 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d64b1b-e3eb-4d6d-948f-203b2d63c472 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:13.524786 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 205/401] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Jul 12 13:04:13 2022] GET /identity/v3/groups/c7ba2c33e654464284d92944a04b3201 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:13.531225 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a08687-433a-4851-a8c1-6f3780d6ca1c None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:13.533482 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d64b1b-e3eb-4d6d-948f-203b2d63c472 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:13.596862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c86083-c8d8-4274-9ddd-8b0730659ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:13.597686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c86083-c8d8-4274-9ddd-8b0730659ace None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:13.597972 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c86083-c8d8-4274-9ddd-8b0730659ace None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:13.598275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c86083-c8d8-4274-9ddd-8b0730659ace None admin] PATH_INFO: `/v3/roles/member` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:13.627335 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c86083-c8d8-4274-9ddd-8b0730659ace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:13.637341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-34c86083-c8d8-4274-9ddd-8b0730659ace None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:04:13.637341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:13.637341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:13.637341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:13.637341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:13.637341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:13.637341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:13.637341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:13.637341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:13.637341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:13.637341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:13.637341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:13.637341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:13.637341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:13.637341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:13.637341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:13.638344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:13.638344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:13.638344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:13.638344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:13.638344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:13.638344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:13.638344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:13.638344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:13.638344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:13.638344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:13.638344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:13.638344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:13.638344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:13.638344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:13.638344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:13.638344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:13.639164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:13.639164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:13.639164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:13.639164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:13.639164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:13.639164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:13.639164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:13.639164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:13.639164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:13.639164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:13.639164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:04:13.639164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:13.639769 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 197/402] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:04:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:13.648187 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c86083-c8d8-4274-9ddd-8b0730659ace None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:13.777737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d64b1b-e3eb-4d6d-948f-203b2d63c472 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:13.783972 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c86083-c8d8-4274-9ddd-8b0730659ace None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:13.793252 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:13.796552 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:13.829648 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b083904-2f8e-4411-bab2-012ecf4184a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:13.831037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b083904-2f8e-4411-bab2-012ecf4184a3 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:13.831490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b083904-2f8e-4411-bab2-012ecf4184a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:13.831920 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b083904-2f8e-4411-bab2-012ecf4184a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:13.832816 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b083904-2f8e-4411-bab2-012ecf4184a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:13.833266 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b083904-2f8e-4411-bab2-012ecf4184a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:13.834812 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b083904-2f8e-4411-bab2-012ecf4184a3 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:13.835646 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7278f-f86f-4b5e-bd68-b59809676ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:13.837168 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7278f-f86f-4b5e-bd68-b59809676ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:13.837696 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7278f-f86f-4b5e-bd68-b59809676ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:13.838267 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7278f-f86f-4b5e-bd68-b59809676ae5 None admin] PATH_INFO: `/v3/projects/878eddd0b05c4cc382e41c3d429ddcee` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:13.842907 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d7278f-f86f-4b5e-bd68-b59809676ae5 None admin] RBAC: Authorizing `identity:get_project(project_id=878eddd0b05c4cc382e41c3d429ddcee)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:13.844394 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d7278f-f86f-4b5e-bd68-b59809676ae5 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:13.846352 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 206/403] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:04:13 2022] GET /identity/v3/projects/878eddd0b05c4cc382e41c3d429ddcee => generated 302 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:13.846468 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 198/404] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:04:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:13.847702 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccf2a5-0ca4-4159-8cb9-ee770ed14684 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:13.847998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccf2a5-0ca4-4159-8cb9-ee770ed14684 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:13.848281 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccf2a5-0ca4-4159-8cb9-ee770ed14684 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:13.849838 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 207/405] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:13.851787 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b083904-2f8e-4411-bab2-012ecf4184a3 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:13.852280 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccf2a5-0ca4-4159-8cb9-ee770ed14684 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:13.971864 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b083904-2f8e-4411-bab2-012ecf4184a3 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:13.972349 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccf2a5-0ca4-4159-8cb9-ee770ed14684 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:14.009716 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6c11e-6c45-4820-a94c-0c1a8eedcd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:14.010087 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae881385-2e32-4cf2-9875-1a0f882cf339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:14.010669 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6c11e-6c45-4820-a94c-0c1a8eedcd9d None admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:14.011201 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6c11e-6c45-4820-a94c-0c1a8eedcd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:14.011316 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae881385-2e32-4cf2-9875-1a0f882cf339 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:14.011479 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6c11e-6c45-4820-a94c-0c1a8eedcd9d None admin] PATH_INFO: `/v3/projects/878eddd0b05c4cc382e41c3d429ddcee/groups/c7ba2c33e654464284d92944a04b3201/roles/4d86c48385634483af68ab63e48f9787` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:14.011571 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae881385-2e32-4cf2-9875-1a0f882cf339 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:14.011831 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae881385-2e32-4cf2-9875-1a0f882cf339 None admin] PATH_INFO: `/v3/groups/c7ba2c33e654464284d92944a04b3201` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:14.013191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae881385-2e32-4cf2-9875-1a0f882cf339 None admin] RBAC: Authorizing `identity:get_group(group_id=c7ba2c33e654464284d92944a04b3201)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:14.014860 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae881385-2e32-4cf2-9875-1a0f882cf339 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:14.015302 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6c11e-6c45-4820-a94c-0c1a8eedcd9d None admin] RBAC: Authorizing `identity:create_grant(project_id=878eddd0b05c4cc382e41c3d429ddcee, group_id=c7ba2c33e654464284d92944a04b3201, role_id=4d86c48385634483af68ab63e48f9787)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:14.016738 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6c11e-6c45-4820-a94c-0c1a8eedcd9d None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:14.017561 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 208/406] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Jul 12 13:04:13 2022] GET /identity/v3/groups/c7ba2c33e654464284d92944a04b3201 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:14.018811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d862b6e-06f3-4c89-b422-9c919b7f49b7 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:14.019102 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d862b6e-06f3-4c89-b422-9c919b7f49b7 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:14.019382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d862b6e-06f3-4c89-b422-9c919b7f49b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:14.044600 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 199/407] 10.222.0.17 () {58 vars in 1442 bytes} [Tue Jul 12 13:04:13 2022] PUT /identity/v3/projects/878eddd0b05c4cc382e41c3d429ddcee/groups/c7ba2c33e654464284d92944a04b3201/roles/4d86c48385634483af68ab63e48f9787 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:04:14.045372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6c11e-6c45-4820-a94c-0c1a8eedcd9d None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:14.047040 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-6d862b6e-06f3-4c89-b422-9c919b7f49b7 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:14.048444 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-6d862b6e-06f3-4c89-b422-9c919b7f49b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:14.105360 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:14.135195 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:14.147832 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 209/408] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:14.177704 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d862b6e-06f3-4c89-b422-9c919b7f49b7 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:14.284152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6c11e-6c45-4820-a94c-0c1a8eedcd9d None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:14.328769 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c02ca-3f2e-4322-9439-c6dcf85b3628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:14.328769 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c02ca-3f2e-4322-9439-c6dcf85b3628 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:14.328769 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c02ca-3f2e-4322-9439-c6dcf85b3628 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:14.328769 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c02ca-3f2e-4322-9439-c6dcf85b3628 None admin] PATH_INFO: `/v3/projects/878eddd0b05c4cc382e41c3d429ddcee` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:14.329984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c02ca-3f2e-4322-9439-c6dcf85b3628 None admin] RBAC: Authorizing `identity:get_project(project_id=878eddd0b05c4cc382e41c3d429ddcee)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:14.331801 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c02ca-3f2e-4322-9439-c6dcf85b3628 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:14.333896 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 200/409] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:04:14 2022] GET /identity/v3/projects/878eddd0b05c4cc382e41c3d429ddcee => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:14.344190 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c02ca-3f2e-4322-9439-c6dcf85b3628 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:14.380689 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d862b6e-06f3-4c89-b422-9c919b7f49b7 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:14.443414 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4846c5-c870-41be-b4e8-1ecd4296c61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:14.444660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4846c5-c870-41be-b4e8-1ecd4296c61f None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:14.445121 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4846c5-c870-41be-b4e8-1ecd4296c61f None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:14.445662 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4846c5-c870-41be-b4e8-1ecd4296c61f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:14.467225 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:14.471438 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c02ca-3f2e-4322-9439-c6dcf85b3628 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:14.474836 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4846c5-c870-41be-b4e8-1ecd4296c61f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:14.491135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-cb4846c5-c870-41be-b4e8-1ecd4296c61f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:04:14.491135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:14.491135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:14.491135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:14.491135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:14.491135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:14.491135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:14.491135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:14.491135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:14.491135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:14.491135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:14.491135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:14.491135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:14.491135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:14.491135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:14.491135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:14.492070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:14.492070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:14.492070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:14.492070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:14.492070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:14.492070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:14.492070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:14.492070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:14.492070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:14.492070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:14.492070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:14.492070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:14.492070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:14.492070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:14.492070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:14.492070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:14.493455 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:14.493455 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:14.493455 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:14.493455 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:14.493455 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:14.493455 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:14.493455 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:14.493455 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:14.493455 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:14.493455 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:14.493455 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:04:14.493455 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:14.495991 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 210/410] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:04:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:04:14.501645 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4846c5-c870-41be-b4e8-1ecd4296c61f None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:14.510504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d92df-60a9-4c43-b707-51bb9804d0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:14.512758 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d92df-60a9-4c43-b707-51bb9804d0d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:14.513057 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d92df-60a9-4c43-b707-51bb9804d0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:14.513347 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d92df-60a9-4c43-b707-51bb9804d0d8 None admin] PATH_INFO: `/v3/projects/878eddd0b05c4cc382e41c3d429ddcee/groups/c7ba2c33e654464284d92944a04b3201/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:14.515758 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d92df-60a9-4c43-b707-51bb9804d0d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=878eddd0b05c4cc382e41c3d429ddcee, group_id=c7ba2c33e654464284d92944a04b3201, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:14.517242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d92df-60a9-4c43-b707-51bb9804d0d8 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:14.546505 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 201/411] 10.222.0.17 () {58 vars in 1442 bytes} [Tue Jul 12 13:04:14 2022] PUT /identity/v3/projects/878eddd0b05c4cc382e41c3d429ddcee/groups/c7ba2c33e654464284d92944a04b3201/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:04:14.583360 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:14.706239 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4846c5-c870-41be-b4e8-1ecd4296c61f None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:14.757497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce2d4a-767d-4453-b719-2b856051875f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:14.758323 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce2d4a-767d-4453-b719-2b856051875f None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:14.759101 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce2d4a-767d-4453-b719-2b856051875f None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:14.759379 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce2d4a-767d-4453-b719-2b856051875f None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:14.760140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce2d4a-767d-4453-b719-2b856051875f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:14.760449 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce2d4a-767d-4453-b719-2b856051875f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:14.762160 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce2d4a-767d-4453-b719-2b856051875f None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:14.771880 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 211/412] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:04:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:04:14.777623 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d92df-60a9-4c43-b707-51bb9804d0d8 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:14.874802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9818dad-a44f-45b6-88ea-d30bd5cae57a None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:14.875300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9818dad-a44f-45b6-88ea-d30bd5cae57a None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:14.875400 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9818dad-a44f-45b6-88ea-d30bd5cae57a None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:14.877628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 212/413] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:14.883244 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e65135-f359-440c-bfc9-e9d5de50f651 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:14.884077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e65135-f359-440c-bfc9-e9d5de50f651 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:14.884188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e65135-f359-440c-bfc9-e9d5de50f651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:14.901179 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d92df-60a9-4c43-b707-51bb9804d0d8 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:14.911085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-a5e65135-f359-440c-bfc9-e9d5de50f651 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:14.911864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a5e65135-f359-440c-bfc9-e9d5de50f651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:14.980931 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087a969-bab8-49f9-a1ef-17e74623945b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:14.981836 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087a969-bab8-49f9-a1ef-17e74623945b None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:14.982150 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087a969-bab8-49f9-a1ef-17e74623945b None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:14.982429 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087a969-bab8-49f9-a1ef-17e74623945b None admin] PATH_INFO: `/v3/groups/1e27ca02406e43a7858449f496d466be` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:14.983794 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087a969-bab8-49f9-a1ef-17e74623945b None admin] RBAC: Authorizing `identity:get_group(group_id=1e27ca02406e43a7858449f496d466be)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:14.985270 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087a969-bab8-49f9-a1ef-17e74623945b None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:14.991434 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 202/414] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Jul 12 13:04:14 2022] GET /identity/v3/groups/1e27ca02406e43a7858449f496d466be => generated 229 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:14.997122 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087a969-bab8-49f9-a1ef-17e74623945b None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:15.029242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:15.056781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 213/415] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:04:15.120721 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e65135-f359-440c-bfc9-e9d5de50f651 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:15.138172 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087a969-bab8-49f9-a1ef-17e74623945b None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:15.175839 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943047b-5b46-4357-8d37-a0e8e7238825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:15.176710 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943047b-5b46-4357-8d37-a0e8e7238825 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:15.176995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943047b-5b46-4357-8d37-a0e8e7238825 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:15.177271 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943047b-5b46-4357-8d37-a0e8e7238825 None admin] PATH_INFO: `/v3/projects/b00723f48e18481b8e6c727fe321edb1` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:15.178514 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943047b-5b46-4357-8d37-a0e8e7238825 None admin] RBAC: Authorizing `identity:get_project(project_id=b00723f48e18481b8e6c727fe321edb1)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:15.179969 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943047b-5b46-4357-8d37-a0e8e7238825 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:15.182054 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 203/416] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:04:14 2022] GET /identity/v3/projects/b00723f48e18481b8e6c727fe321edb1 => generated 344 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:15.187439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943047b-5b46-4357-8d37-a0e8e7238825 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:15.211420 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:15.329072 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:15.341449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943047b-5b46-4357-8d37-a0e8e7238825 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:15.354774 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e65135-f359-440c-bfc9-e9d5de50f651 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:15.380019 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6eec65-d9f8-46ec-9521-cccb5fc92d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:15.380937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6eec65-d9f8-46ec-9521-cccb5fc92d6a None admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:15.381221 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6eec65-d9f8-46ec-9521-cccb5fc92d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:15.381501 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6eec65-d9f8-46ec-9521-cccb5fc92d6a None admin] PATH_INFO: `/v3/projects/b00723f48e18481b8e6c727fe321edb1/groups/1e27ca02406e43a7858449f496d466be/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:15.383692 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6eec65-d9f8-46ec-9521-cccb5fc92d6a None admin] RBAC: Authorizing `identity:create_grant(project_id=b00723f48e18481b8e6c727fe321edb1, group_id=1e27ca02406e43a7858449f496d466be, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:15.385158 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6eec65-d9f8-46ec-9521-cccb5fc92d6a None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:15.403858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 204/417] 10.222.0.17 () {58 vars in 1442 bytes} [Tue Jul 12 13:04:15 2022] PUT /identity/v3/projects/b00723f48e18481b8e6c727fe321edb1/groups/1e27ca02406e43a7858449f496d466be/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:04:15.405371 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e661514-a9c8-45d8-8146-2b753fe7eeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:15.405792 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6790be-326b-4f25-a5cb-aa319fafcd00 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:15.406376 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6790be-326b-4f25-a5cb-aa319fafcd00 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:15.406885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6790be-326b-4f25-a5cb-aa319fafcd00 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:15.407435 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e661514-a9c8-45d8-8146-2b753fe7eeeb None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:15.407954 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e661514-a9c8-45d8-8146-2b753fe7eeeb None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:15.408446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e661514-a9c8-45d8-8146-2b753fe7eeeb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:15.409766 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 205/418] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:15.415472 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c6c74-5e81-41f0-8887-3de79d40d5f3 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:15.415751 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c6c74-5e81-41f0-8887-3de79d40d5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:15.416035 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c6c74-5e81-41f0-8887-3de79d40d5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:15.423428 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e661514-a9c8-45d8-8146-2b753fe7eeeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:15.433309 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-6e661514-a9c8-45d8-8146-2b753fe7eeeb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:04:15.433309 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:15.433309 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:15.433309 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:15.433309 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:15.433309 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:15.433309 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:15.433309 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:15.433309 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:15.433309 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:15.433309 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:15.433309 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:15.433309 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:15.433309 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:15.433309 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:15.433309 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:15.434314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:15.434314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:15.434314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:15.434314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:15.434314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:15.434314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:15.434314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:15.434314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:15.434314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:15.434314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:15.434314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:15.434314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:15.434314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:15.434314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:15.434314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:15.434314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:15.435146 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:15.435146 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:15.435146 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:15.435146 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:15.435146 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:15.435146 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:15.435146 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:15.435146 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:15.435146 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:15.435146 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:15.435146 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:04:15.435146 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:15.438329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 214/419] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:04:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:15.444715 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e661514-a9c8-45d8-8146-2b753fe7eeeb None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:15.471508 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-e60c6c74-5e81-41f0-8887-3de79d40d5f3 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:15.472510 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-e60c6c74-5e81-41f0-8887-3de79d40d5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:15.552541 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:15.566881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e661514-a9c8-45d8-8146-2b753fe7eeeb None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:15.639157 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 206/420] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:04:15.639730 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43edc8ce-9833-492c-92d9-0234636258f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:15.640426 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edc8ce-9833-492c-92d9-0234636258f1 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:15.640718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edc8ce-9833-492c-92d9-0234636258f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:15.641001 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edc8ce-9833-492c-92d9-0234636258f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:15.641767 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43edc8ce-9833-492c-92d9-0234636258f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:15.642083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43edc8ce-9833-492c-92d9-0234636258f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:15.643519 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43edc8ce-9833-492c-92d9-0234636258f1 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:15.653471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 215/421] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:04:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:15.659112 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c6c74-5e81-41f0-8887-3de79d40d5f3 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:15.667314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43edc8ce-9833-492c-92d9-0234636258f1 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:15.772935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:15.783776 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43edc8ce-9833-492c-92d9-0234636258f1 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:15.791467 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c6c74-5e81-41f0-8887-3de79d40d5f3 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:15.820394 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8c9cd-f04e-4059-9e52-3bc0f3d077d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:15.821431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8c9cd-f04e-4059-9e52-3bc0f3d077d8 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:15.821725 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8c9cd-f04e-4059-9e52-3bc0f3d077d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:15.822006 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8c9cd-f04e-4059-9e52-3bc0f3d077d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:15.833316 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8c9cd-f04e-4059-9e52-3bc0f3d077d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:15.842552 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-18b8c9cd-f04e-4059-9e52-3bc0f3d077d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:04:15.842552 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:15.842552 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:15.842552 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:15.842552 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:15.842552 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:15.842552 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:15.842552 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:15.842552 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:15.842552 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:15.842552 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:15.842552 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:15.842552 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:15.842552 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:15.842552 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:15.842552 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:15.843602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:15.843602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:15.843602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:15.843602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:15.843602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:15.843602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:15.843602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:15.843602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:15.843602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:15.843602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:15.843602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:15.843602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:15.843602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:15.843602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:15.843602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:15.843602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:15.845518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:15.845518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:15.845518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:15.845518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:15.845518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:15.845518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:15.845518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:15.845518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:15.845518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:15.845518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:15.845518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:04:15.845518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:15.845518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 216/422] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Jul 12 13:04:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:04:15.847334 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995c7f4-2520-40ae-9797-0a570261a0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:15.847334 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995c7f4-2520-40ae-9797-0a570261a0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:15.847334 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995c7f4-2520-40ae-9797-0a570261a0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:15.847334 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995c7f4-2520-40ae-9797-0a570261a0d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:15.850033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8c9cd-f04e-4059-9e52-3bc0f3d077d8 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:15.874534 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:15.971622 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995c7f4-2520-40ae-9797-0a570261a0d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:15.973963 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995c7f4-2520-40ae-9797-0a570261a0d1 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:16.065060 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8c9cd-f04e-4059-9e52-3bc0f3d077d8 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:16.138821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590adfc-1e81-43a6-82f6-edbd120b24c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:16.139843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590adfc-1e81-43a6-82f6-edbd120b24c9 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:16.140499 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590adfc-1e81-43a6-82f6-edbd120b24c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:16.141709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590adfc-1e81-43a6-82f6-edbd120b24c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:16.142904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590adfc-1e81-43a6-82f6-edbd120b24c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:16.144176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590adfc-1e81-43a6-82f6-edbd120b24c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:16.145965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590adfc-1e81-43a6-82f6-edbd120b24c9 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:16.147635 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:16.166036 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 217/423] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:04:16.173100 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590adfc-1e81-43a6-82f6-edbd120b24c9 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:16.183708 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 207/424] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:04:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:04:16.184960 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995c7f4-2520-40ae-9797-0a570261a0d1 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:16.325267 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:16.385097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995c7f4-2520-40ae-9797-0a570261a0d1 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:16.413662 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590adfc-1e81-43a6-82f6-edbd120b24c9 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:16.472283 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84de9bc-24b1-4799-b05f-78a9dd9c8839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:16.473177 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84de9bc-24b1-4799-b05f-78a9dd9c8839 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:16.473462 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84de9bc-24b1-4799-b05f-78a9dd9c8839 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:16.473739 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84de9bc-24b1-4799-b05f-78a9dd9c8839 None admin] PATH_INFO: `/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:16.475101 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84de9bc-24b1-4799-b05f-78a9dd9c8839 None admin] RBAC: Authorizing `identity:get_project(project_id=3afe0ad2d6234e83b0fd6f35ed37e7c9)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:16.476570 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84de9bc-24b1-4799-b05f-78a9dd9c8839 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:16.480009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 208/425] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:04:16 2022] GET /identity/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9 => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:16.485996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84de9bc-24b1-4799-b05f-78a9dd9c8839 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:16.504198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15479089-3644-456c-8558-9b44fa19dcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:16.504875 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15479089-3644-456c-8558-9b44fa19dcda None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:16.505166 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15479089-3644-456c-8558-9b44fa19dcda None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:16.505450 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15479089-3644-456c-8558-9b44fa19dcda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:16.593711 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:16.652924 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15479089-3644-456c-8558-9b44fa19dcda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:16.654451 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15479089-3644-456c-8558-9b44fa19dcda None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:16.702274 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84de9bc-24b1-4799-b05f-78a9dd9c8839 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:16.788407 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b87fc0-0581-437b-a6f6-c68142ce0c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:16.789297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b87fc0-0581-437b-a6f6-c68142ce0c05 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:16.790302 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b87fc0-0581-437b-a6f6-c68142ce0c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:16.790791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b87fc0-0581-437b-a6f6-c68142ce0c05 None admin] PATH_INFO: `/v3/groups/c7ba2c33e654464284d92944a04b3201` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:16.795978 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b87fc0-0581-437b-a6f6-c68142ce0c05 None admin] RBAC: Authorizing `identity:get_group(group_id=c7ba2c33e654464284d92944a04b3201)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:16.797867 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b87fc0-0581-437b-a6f6-c68142ce0c05 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:16.799857 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 209/426] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Jul 12 13:04:16 2022] GET /identity/v3/groups/c7ba2c33e654464284d92944a04b3201 => generated 226 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:16.820183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:16.822243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b87fc0-0581-437b-a6f6-c68142ce0c05 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:16.874226 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 218/427] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:04:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 701 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 13:04:16.883795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15479089-3644-456c-8558-9b44fa19dcda None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:16.996357 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b87fc0-0581-437b-a6f6-c68142ce0c05 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:17.019463 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:17.021893 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15479089-3644-456c-8558-9b44fa19dcda None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:17.035429 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71dd9d5-9662-4ce3-afba-3149e7df60c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:17.036096 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71dd9d5-9662-4ce3-afba-3149e7df60c0 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:17.036387 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71dd9d5-9662-4ce3-afba-3149e7df60c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:17.036667 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71dd9d5-9662-4ce3-afba-3149e7df60c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:17.037579 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71dd9d5-9662-4ce3-afba-3149e7df60c0 None admin] RBAC: Adding query filter params (group.id=c7ba2c33e654464284d92944a04b3201, role.id=1727bdbc17d94ff08782d404dce97d35, scope.project.id=3afe0ad2d6234e83b0fd6f35ed37e7c9) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:17.037905 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71dd9d5-9662-4ce3-afba-3149e7df60c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:17.039449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71dd9d5-9662-4ce3-afba-3149e7df60c0 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:17.046395 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 210/428] 10.222.0.17 () {56 vars in 1376 bytes} [Tue Jul 12 13:04:16 2022] GET /identity/v3/role_assignments?group.id=c7ba2c33e654464284d92944a04b3201&scope.project.id=3afe0ad2d6234e83b0fd6f35ed37e7c9&role.id=1727bdbc17d94ff08782d404dce97d35 => generated 611 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:17.054375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09611da0-28cb-4b3f-ae22-102bed1cf557 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:17.054375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09611da0-28cb-4b3f-ae22-102bed1cf557 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:17.054375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09611da0-28cb-4b3f-ae22-102bed1cf557 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:17.054375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 211/429] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:17.054375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ff6a2-2a86-4fc9-8e30-abb9d77ce58c None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:17.054375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ff6a2-2a86-4fc9-8e30-abb9d77ce58c None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:17.055518 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ff6a2-2a86-4fc9-8e30-abb9d77ce58c None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:17.055518 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 212/430] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:17.057777 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c44d6-f738-40cc-8357-8b9b4285cb3a None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:17.058352 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c44d6-f738-40cc-8357-8b9b4285cb3a None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:17.058683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c44d6-f738-40cc-8357-8b9b4285cb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:17.072547 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5dada7-0fc6-4124-8ef9-0a7dc41b5f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:17.073566 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5dada7-0fc6-4124-8ef9-0a7dc41b5f17 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:17.073878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5dada7-0fc6-4124-8ef9-0a7dc41b5f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:17.074187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5dada7-0fc6-4124-8ef9-0a7dc41b5f17 None admin] PATH_INFO: `/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:17.075520 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5dada7-0fc6-4124-8ef9-0a7dc41b5f17 None admin] RBAC: Authorizing `identity:get_project(project_id=3afe0ad2d6234e83b0fd6f35ed37e7c9)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:17.077015 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5dada7-0fc6-4124-8ef9-0a7dc41b5f17 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:17.082341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 219/431] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:04:16 2022] GET /identity/v3/projects/3afe0ad2d6234e83b0fd6f35ed37e7c9 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:17.084239 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa952cf-2e26-4204-a021-6ac80669a99c None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:17.084529 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa952cf-2e26-4204-a021-6ac80669a99c None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:17.084809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa952cf-2e26-4204-a021-6ac80669a99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:17.087489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-ee9c44d6-f738-40cc-8357-8b9b4285cb3a None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:17.089033 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-ee9c44d6-f738-40cc-8357-8b9b4285cb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:17.107260 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-2fa952cf-2e26-4204-a021-6ac80669a99c None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:17.108662 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-2fa952cf-2e26-4204-a021-6ac80669a99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:17.144454 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:17.184951 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 213/432] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:04:17.185682 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c44d6-f738-40cc-8357-8b9b4285cb3a None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:17.198637 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 220/433] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:17.219188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa952cf-2e26-4204-a021-6ac80669a99c None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:17.321262 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c44d6-f738-40cc-8357-8b9b4285cb3a None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:17.342076 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:17.363004 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa952cf-2e26-4204-a021-6ac80669a99c None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:17.375103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd96d1b-c10c-4b67-a7b8-adc3355754a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:17.376073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd96d1b-c10c-4b67-a7b8-adc3355754a2 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:17.376363 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd96d1b-c10c-4b67-a7b8-adc3355754a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:17.376664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd96d1b-c10c-4b67-a7b8-adc3355754a2 None admin] PATH_INFO: `/v3/groups/c7ba2c33e654464284d92944a04b3201` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:17.378633 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd96d1b-c10c-4b67-a7b8-adc3355754a2 None admin] RBAC: Authorizing `identity:get_group(group_id=c7ba2c33e654464284d92944a04b3201)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:17.381121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd96d1b-c10c-4b67-a7b8-adc3355754a2 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:17.384503 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 214/434] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Jul 12 13:04:17 2022] GET /identity/v3/groups/c7ba2c33e654464284d92944a04b3201 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:17.385305 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd96d1b-c10c-4b67-a7b8-adc3355754a2 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:17.409390 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92e20d-f3c2-4840-ac6e-51d2827ea412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:17.410329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92e20d-f3c2-4840-ac6e-51d2827ea412 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:17.410716 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92e20d-f3c2-4840-ac6e-51d2827ea412 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:17.411095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92e20d-f3c2-4840-ac6e-51d2827ea412 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:17.425157 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92e20d-f3c2-4840-ac6e-51d2827ea412 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:17.433845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-fe92e20d-f3c2-4840-ac6e-51d2827ea412 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:04:17.433845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:17.433845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:17.433845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:17.433845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:17.433845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:17.433845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:17.433845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:17.433845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:17.433845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:17.433845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:17.433845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:17.433845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:17.433845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:17.433845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:17.433845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:17.435372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:17.435372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:17.435372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:17.435372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:17.435372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:17.435372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:17.435372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:17.435372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:17.435372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:17.435372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:17.435372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:17.435372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:17.435372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:17.435372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:17.435372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:17.435372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:17.436172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:17.436172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:17.436172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:17.436172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:17.436172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:17.436172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:17.436172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:17.436172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:17.436172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:17.436172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:17.436172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:04:17.436172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:17.436172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 221/435] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:04:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:04:17.436823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92e20d-f3c2-4840-ac6e-51d2827ea412 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:17.484089 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:17.520107 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd96d1b-c10c-4b67-a7b8-adc3355754a2 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:17.576839 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5e504-7b85-4bb6-91fb-a0381e1c4a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:17.576839 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5e504-7b85-4bb6-91fb-a0381e1c4a8d None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:17.576839 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5e504-7b85-4bb6-91fb-a0381e1c4a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:17.576839 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5e504-7b85-4bb6-91fb-a0381e1c4a8d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:17.589282 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92e20d-f3c2-4840-ac6e-51d2827ea412 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:17.595160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5e504-7b85-4bb6-91fb-a0381e1c4a8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:17.604737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-bad5e504-7b85-4bb6-91fb-a0381e1c4a8d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:04:17.604737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:17.604737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:17.604737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:17.604737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:17.604737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:17.604737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:17.604737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:17.604737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:17.604737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:17.604737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:17.604737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:17.604737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:17.604737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:17.604737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:17.604737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:17.605737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:17.605737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:17.605737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:17.605737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:17.605737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:17.605737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:17.605737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:17.605737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:17.605737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:17.605737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:17.605737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:17.605737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:17.605737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:17.605737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:17.605737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:17.605737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:17.606625 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:17.606625 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:17.606625 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:17.606625 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:17.606625 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:17.606625 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:17.606625 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:17.606625 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:17.606625 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:17.606625 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:17.606625 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:04:17.606625 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:17.606625 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 215/436] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Jul 12 13:04:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:17.607292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5e504-7b85-4bb6-91fb-a0381e1c4a8d None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:17.641998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40205eb-c748-4415-ad10-67992e3a1d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:17.642986 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40205eb-c748-4415-ad10-67992e3a1d2e None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:17.643436 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40205eb-c748-4415-ad10-67992e3a1d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:17.643721 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40205eb-c748-4415-ad10-67992e3a1d2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:17.644565 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40205eb-c748-4415-ad10-67992e3a1d2e None admin] RBAC: Adding query filter params (group.id=c7ba2c33e654464284d92944a04b3201, role.id=4d86c48385634483af68ab63e48f9787, scope.project.id=3afe0ad2d6234e83b0fd6f35ed37e7c9) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:17.644885 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40205eb-c748-4415-ad10-67992e3a1d2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:17.646367 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40205eb-c748-4415-ad10-67992e3a1d2e None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:17.662231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 222/437] 10.222.0.17 () {56 vars in 1376 bytes} [Tue Jul 12 13:04:17 2022] GET /identity/v3/role_assignments?group.id=c7ba2c33e654464284d92944a04b3201&scope.project.id=3afe0ad2d6234e83b0fd6f35ed37e7c9&role.id=4d86c48385634483af68ab63e48f9787 => generated 611 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:17.662231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40205eb-c748-4415-ad10-67992e3a1d2e None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:17.678779 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:17.767368 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5e504-7b85-4bb6-91fb-a0381e1c4a8d None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:17.810697 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:17.828476 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5fba7-2fcf-49be-ae1b-419e8115c75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:17.828812 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40205eb-c748-4415-ad10-67992e3a1d2e None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:17.829736 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5fba7-2fcf-49be-ae1b-419e8115c75e None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:17.830273 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5fba7-2fcf-49be-ae1b-419e8115c75e None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:17.830756 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5fba7-2fcf-49be-ae1b-419e8115c75e None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:17.832112 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5fba7-2fcf-49be-ae1b-419e8115c75e None admin] RBAC: Adding query filter params (name=member) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:17.833723 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5fba7-2fcf-49be-ae1b-419e8115c75e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:17.835661 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5fba7-2fcf-49be-ae1b-419e8115c75e None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:17.847692 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 216/438] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:04:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:17.850681 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8f934-e4c2-4bfe-b3a1-aed4be2354c8 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:17.851230 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8f934-e4c2-4bfe-b3a1-aed4be2354c8 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:17.852023 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8f934-e4c2-4bfe-b3a1-aed4be2354c8 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:17.854292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 217/439] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:04:17.856415 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8f934-e4c2-4bfe-b3a1-aed4be2354c8 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:17.878598 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f83dee-0a29-4faf-84d9-f5488149ee89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:17.879296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f83dee-0a29-4faf-84d9-f5488149ee89 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:17.879599 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f83dee-0a29-4faf-84d9-f5488149ee89 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:17.879909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f83dee-0a29-4faf-84d9-f5488149ee89 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:17.880640 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f83dee-0a29-4faf-84d9-f5488149ee89 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:17.880951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f83dee-0a29-4faf-84d9-f5488149ee89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:17.882400 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f83dee-0a29-4faf-84d9-f5488149ee89 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:17.894955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 223/440] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:17.894955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e219d4-cdf3-41c4-873c-0b725d843add None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:17.894955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e219d4-cdf3-41c4-873c-0b725d843add None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:17.894955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e219d4-cdf3-41c4-873c-0b725d843add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:17.911567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-45e219d4-cdf3-41c4-873c-0b725d843add None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:17.912840 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-45e219d4-cdf3-41c4-873c-0b725d843add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:17.997436 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 224/441] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:17.998781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e219d4-cdf3-41c4-873c-0b725d843add None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:18.004563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8f934-e4c2-4bfe-b3a1-aed4be2354c8 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:18.007696 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:18.055636 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53543854-5b41-4820-9796-4cb97b16d001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:18.057058 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53543854-5b41-4820-9796-4cb97b16d001 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:18.057058 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53543854-5b41-4820-9796-4cb97b16d001 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:18.057058 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53543854-5b41-4820-9796-4cb97b16d001 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:18.104889 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:18.130095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e219d4-cdf3-41c4-873c-0b725d843add None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:18.138315 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53543854-5b41-4820-9796-4cb97b16d001 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:18.139789 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53543854-5b41-4820-9796-4cb97b16d001 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:18.172877 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d6d13-e00c-4adb-a588-8be692a4467e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:18.173455 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d6d13-e00c-4adb-a588-8be692a4467e None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:18.173743 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d6d13-e00c-4adb-a588-8be692a4467e None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:18.174022 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d6d13-e00c-4adb-a588-8be692a4467e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:18.257279 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 218/442] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:04:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 13:04:18.257475 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d6d13-e00c-4adb-a588-8be692a4467e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:18.257554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53543854-5b41-4820-9796-4cb97b16d001 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:18.257623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d6d13-e00c-4adb-a588-8be692a4467e None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:18.258242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:18.346374 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:18.363959 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 225/443] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:04:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:04:18.364492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53543854-5b41-4820-9796-4cb97b16d001 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:18.364635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d6d13-e00c-4adb-a588-8be692a4467e None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:18.410930 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d9878-77a0-4a63-b3c9-145f76b4a610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:18.411737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d9878-77a0-4a63-b3c9-145f76b4a610 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:18.412022 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d9878-77a0-4a63-b3c9-145f76b4a610 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:18.412301 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d9878-77a0-4a63-b3c9-145f76b4a610 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:18.423477 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d9878-77a0-4a63-b3c9-145f76b4a610 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:18.431730 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-ae5d9878-77a0-4a63-b3c9-145f76b4a610 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:04:18.431730 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:18.431730 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:18.431730 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:18.431730 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:18.431730 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:18.431730 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:18.431730 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:18.431730 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:18.431730 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:18.431730 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:18.431730 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:18.431730 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:18.431730 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:18.431730 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:18.431730 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:18.432743 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:18.432743 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:18.432743 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:18.432743 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:18.432743 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:18.432743 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:18.432743 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:18.432743 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:18.432743 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:18.432743 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:18.432743 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:18.432743 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:18.432743 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:18.432743 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:18.432743 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:18.432743 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:18.433539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:18.433539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:18.433539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:18.433539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:18.433539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:18.433539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:18.433539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:18.433539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:18.433539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:18.433539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:18.433539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:04:18.433539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:18.433539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 219/444] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:04:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:18.434599 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d9878-77a0-4a63-b3c9-145f76b4a610 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:18.480818 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d6d13-e00c-4adb-a588-8be692a4467e None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:18.511068 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:18.519018 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c10176-497b-4709-9cca-534443396915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:18.519902 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c10176-497b-4709-9cca-534443396915 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:18.520190 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c10176-497b-4709-9cca-534443396915 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:18.520468 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c10176-497b-4709-9cca-534443396915 None admin] PATH_INFO: `/v3/projects/878eddd0b05c4cc382e41c3d429ddcee` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:18.521669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c10176-497b-4709-9cca-534443396915 None admin] RBAC: Authorizing `identity:get_project(project_id=878eddd0b05c4cc382e41c3d429ddcee)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:18.523149 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c10176-497b-4709-9cca-534443396915 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:18.525355 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 226/445] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:04:18 2022] GET /identity/v3/projects/878eddd0b05c4cc382e41c3d429ddcee => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:18.526136 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c10176-497b-4709-9cca-534443396915 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:18.558661 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d9878-77a0-4a63-b3c9-145f76b4a610 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:18.581349 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:18.595127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e66aa-f23b-480a-81c4-8e5804352dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:18.596035 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e66aa-f23b-480a-81c4-8e5804352dae None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:18.596293 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e66aa-f23b-480a-81c4-8e5804352dae None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:18.596574 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e66aa-f23b-480a-81c4-8e5804352dae None admin] PATH_INFO: `/v3/projects/878eddd0b05c4cc382e41c3d429ddcee` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:18.597786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e66aa-f23b-480a-81c4-8e5804352dae None admin] RBAC: Authorizing `identity:get_project(project_id=878eddd0b05c4cc382e41c3d429ddcee)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:18.599270 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e66aa-f23b-480a-81c4-8e5804352dae None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:18.601005 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 220/446] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:04:18 2022] GET /identity/v3/projects/878eddd0b05c4cc382e41c3d429ddcee => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:18.606850 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e66aa-f23b-480a-81c4-8e5804352dae None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:18.630244 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c10176-497b-4709-9cca-534443396915 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:18.666938 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faca247-bef4-456d-aa78-62675f8e2659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:18.667630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faca247-bef4-456d-aa78-62675f8e2659 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:18.667918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faca247-bef4-456d-aa78-62675f8e2659 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:18.668200 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faca247-bef4-456d-aa78-62675f8e2659 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:18.668945 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faca247-bef4-456d-aa78-62675f8e2659 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:18.669260 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faca247-bef4-456d-aa78-62675f8e2659 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:18.670684 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faca247-bef4-456d-aa78-62675f8e2659 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:18.682238 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 227/447] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:04:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:18.685269 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faca247-bef4-456d-aa78-62675f8e2659 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:18.735475 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e66aa-f23b-480a-81c4-8e5804352dae None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:18.765289 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:18.775699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9d3f3-6bec-44ea-8741-bf3a811e925b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:18.776574 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9d3f3-6bec-44ea-8741-bf3a811e925b None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:18.776857 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9d3f3-6bec-44ea-8741-bf3a811e925b None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:18.777133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9d3f3-6bec-44ea-8741-bf3a811e925b None admin] PATH_INFO: `/v3/groups/c7ba2c33e654464284d92944a04b3201` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:18.778369 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de9d3f3-6bec-44ea-8741-bf3a811e925b None admin] RBAC: Authorizing `identity:get_group(group_id=c7ba2c33e654464284d92944a04b3201)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:18.779826 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de9d3f3-6bec-44ea-8741-bf3a811e925b None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:18.781454 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 221/448] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Jul 12 13:04:18 2022] GET /identity/v3/groups/c7ba2c33e654464284d92944a04b3201 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:18.782253 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9d3f3-6bec-44ea-8741-bf3a811e925b None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:18.806304 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faca247-bef4-456d-aa78-62675f8e2659 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:18.820150 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:18.843395 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff175bd7-01d8-490e-be3a-82ecc0bebd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:18.844271 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff175bd7-01d8-490e-be3a-82ecc0bebd94 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:18.844559 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff175bd7-01d8-490e-be3a-82ecc0bebd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:18.844839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff175bd7-01d8-490e-be3a-82ecc0bebd94 None admin] PATH_INFO: `/v3/groups/c7ba2c33e654464284d92944a04b3201` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:18.846032 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff175bd7-01d8-490e-be3a-82ecc0bebd94 None admin] RBAC: Authorizing `identity:get_group(group_id=c7ba2c33e654464284d92944a04b3201)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:18.847531 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff175bd7-01d8-490e-be3a-82ecc0bebd94 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:18.849170 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 228/449] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Jul 12 13:04:18 2022] GET /identity/v3/groups/c7ba2c33e654464284d92944a04b3201 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:18.849951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff175bd7-01d8-490e-be3a-82ecc0bebd94 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:18.901881 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9d3f3-6bec-44ea-8741-bf3a811e925b None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:18.940060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d6b98-3d21-4b53-8cff-31c587881999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:18.940636 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d6b98-3d21-4b53-8cff-31c587881999 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:18.940950 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d6b98-3d21-4b53-8cff-31c587881999 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:18.941234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d6b98-3d21-4b53-8cff-31c587881999 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:18.950628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff175bd7-01d8-490e-be3a-82ecc0bebd94 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:18.989853 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ee1a0-3323-4b36-bdf3-7c4af197a36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:18.990608 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ee1a0-3323-4b36-bdf3-7c4af197a36a None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:18.990833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ee1a0-3323-4b36-bdf3-7c4af197a36a None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:18.991110 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ee1a0-3323-4b36-bdf3-7c4af197a36a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:18.991946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ee1a0-3323-4b36-bdf3-7c4af197a36a None admin] RBAC: Adding query filter params (group.id=c7ba2c33e654464284d92944a04b3201, role.id=1727bdbc17d94ff08782d404dce97d35, scope.project.id=878eddd0b05c4cc382e41c3d429ddcee) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:18.992264 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ee1a0-3323-4b36-bdf3-7c4af197a36a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:18.993726 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ee1a0-3323-4b36-bdf3-7c4af197a36a None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:18.999990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 229/450] 10.222.0.17 () {56 vars in 1376 bytes} [Tue Jul 12 13:04:18 2022] GET /identity/v3/role_assignments?group.id=c7ba2c33e654464284d92944a04b3201&scope.project.id=878eddd0b05c4cc382e41c3d429ddcee&role.id=1727bdbc17d94ff08782d404dce97d35 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:19.000803 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ee1a0-3323-4b36-bdf3-7c4af197a36a None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:19.029076 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:19.032691 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d6b98-3d21-4b53-8cff-31c587881999 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:19.034327 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d6b98-3d21-4b53-8cff-31c587881999 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:19.069843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:19.144685 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ee1a0-3323-4b36-bdf3-7c4af197a36a None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:19.178465 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 222/451] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:04:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:04:19.185286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9f214-3f0d-40f5-a779-0ca946e6c636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:19.186420 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9f214-3f0d-40f5-a779-0ca946e6c636 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:19.186714 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9f214-3f0d-40f5-a779-0ca946e6c636 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:19.187162 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d6b98-3d21-4b53-8cff-31c587881999 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:19.189502 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9f214-3f0d-40f5-a779-0ca946e6c636 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:19.190628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9f214-3f0d-40f5-a779-0ca946e6c636 None admin] RBAC: Adding query filter params (group.id=c7ba2c33e654464284d92944a04b3201, role.id=4d86c48385634483af68ab63e48f9787, scope.project.id=878eddd0b05c4cc382e41c3d429ddcee) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:19.190895 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9f214-3f0d-40f5-a779-0ca946e6c636 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:19.192375 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9f214-3f0d-40f5-a779-0ca946e6c636 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:19.203408 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 230/452] 10.222.0.17 () {56 vars in 1376 bytes} [Tue Jul 12 13:04:18 2022] GET /identity/v3/role_assignments?group.id=c7ba2c33e654464284d92944a04b3201&scope.project.id=878eddd0b05c4cc382e41c3d429ddcee&role.id=4d86c48385634483af68ab63e48f9787 => generated 611 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:19.325540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:19.329006 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d6b98-3d21-4b53-8cff-31c587881999 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:19.370172 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d96e83-6b5e-4ef0-873a-70c7c21f5087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:19.371070 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d96e83-6b5e-4ef0-873a-70c7c21f5087 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:19.371349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d96e83-6b5e-4ef0-873a-70c7c21f5087 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:19.371734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d96e83-6b5e-4ef0-873a-70c7c21f5087 None admin] PATH_INFO: `/v3/projects/b00723f48e18481b8e6c727fe321edb1` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:19.374178 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d96e83-6b5e-4ef0-873a-70c7c21f5087 None admin] RBAC: Authorizing `identity:get_project(project_id=b00723f48e18481b8e6c727fe321edb1)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:19.374400 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d96e83-6b5e-4ef0-873a-70c7c21f5087 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:19.376297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 223/453] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:04:19 2022] GET /identity/v3/projects/b00723f48e18481b8e6c727fe321edb1 => generated 344 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:04:19.381738 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9f214-3f0d-40f5-a779-0ca946e6c636 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:19.507436 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9f214-3f0d-40f5-a779-0ca946e6c636 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:19.519524 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:19.547222 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361056f-b461-4de3-8e52-3242b201b0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:19.548112 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361056f-b461-4de3-8e52-3242b201b0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:19.548400 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361056f-b461-4de3-8e52-3242b201b0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:19.548689 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361056f-b461-4de3-8e52-3242b201b0f9 None admin] PATH_INFO: `/v3/groups/1e27ca02406e43a7858449f496d466be` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:19.549898 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361056f-b461-4de3-8e52-3242b201b0f9 None admin] RBAC: Authorizing `identity:get_group(group_id=1e27ca02406e43a7858449f496d466be)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:19.551398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361056f-b461-4de3-8e52-3242b201b0f9 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:19.553199 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 231/454] 10.222.0.17 () {56 vars in 1180 bytes} [Tue Jul 12 13:04:19 2022] GET /identity/v3/groups/1e27ca02406e43a7858449f496d466be => generated 229 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:19.559516 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d96e83-6b5e-4ef0-873a-70c7c21f5087 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:19.663415 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d96e83-6b5e-4ef0-873a-70c7c21f5087 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:19.698841 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3f022-1ed2-4468-a9bb-a81f13ce6477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:19.699507 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3f022-1ed2-4468-a9bb-a81f13ce6477 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:19.699793 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3f022-1ed2-4468-a9bb-a81f13ce6477 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:19.700076 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3f022-1ed2-4468-a9bb-a81f13ce6477 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:19.700908 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3f022-1ed2-4468-a9bb-a81f13ce6477 None admin] RBAC: Adding query filter params (group.id=1e27ca02406e43a7858449f496d466be, role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0, scope.project.id=b00723f48e18481b8e6c727fe321edb1) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:19.701222 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3f022-1ed2-4468-a9bb-a81f13ce6477 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:19.702719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3f022-1ed2-4468-a9bb-a81f13ce6477 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:19.709373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 224/455] 10.222.0.17 () {56 vars in 1376 bytes} [Tue Jul 12 13:04:19 2022] GET /identity/v3/role_assignments?group.id=1e27ca02406e43a7858449f496d466be&scope.project.id=b00723f48e18481b8e6c727fe321edb1&role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:22.333672 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c63c0-dc5b-4b6f-a170-2587092cdcca None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:22.334222 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c63c0-dc5b-4b6f-a170-2587092cdcca None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:22.334344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c63c0-dc5b-4b6f-a170-2587092cdcca None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:22.335939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 232/456] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:22.341636 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8df5d0-c1e4-45a5-820e-2f8325cf19f5 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:22.342101 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8df5d0-c1e4-45a5-820e-2f8325cf19f5 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:22.342327 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8df5d0-c1e4-45a5-820e-2f8325cf19f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:22.367253 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-6b8df5d0-c1e4-45a5-820e-2f8325cf19f5 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:22.369003 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-6b8df5d0-c1e4-45a5-820e-2f8325cf19f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:22.404522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:22.440583 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aebc30-5142-4069-afc1-b0694d9f9720 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:22.440583 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aebc30-5142-4069-afc1-b0694d9f9720 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:22.440583 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aebc30-5142-4069-afc1-b0694d9f9720 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:22.441214 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 233/457] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:04:22.448016 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0a480-9577-43d6-8ceb-b735110fc465 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:22.448607 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0a480-9577-43d6-8ceb-b735110fc465 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:22.449087 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0a480-9577-43d6-8ceb-b735110fc465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:22.473446 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 225/458] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:04:22.483678 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-9cb0a480-9577-43d6-8ceb-b735110fc465 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:22.484892 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-9cb0a480-9577-43d6-8ceb-b735110fc465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:22.520688 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24bd13-9122-4590-8e7c-faa30a2fde92 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:22.520993 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24bd13-9122-4590-8e7c-faa30a2fde92 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:22.521261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24bd13-9122-4590-8e7c-faa30a2fde92 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:22.522915 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 226/459] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:22.528266 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b7ed6-f35a-405c-8ca2-a1f8882f59eb None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:22.528554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b7ed6-f35a-405c-8ca2-a1f8882f59eb None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:22.528839 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b7ed6-f35a-405c-8ca2-a1f8882f59eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:22.548183 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-493b7ed6-f35a-405c-8ca2-a1f8882f59eb None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:22.549648 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-493b7ed6-f35a-405c-8ca2-a1f8882f59eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:22.580074 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 234/460] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:22.581111 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0a480-9577-43d6-8ceb-b735110fc465 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:22.632140 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 227/461] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 12 13:04:22.633833 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b7ed6-f35a-405c-8ca2-a1f8882f59eb None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:22.704485 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0a480-9577-43d6-8ceb-b735110fc465 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:22.716176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:22.745855 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4472e-2fd5-4dc0-b273-34d346cf34b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:22.746693 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:22.747962 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4472e-2fd5-4dc0-b273-34d346cf34b2 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:22.748432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4472e-2fd5-4dc0-b273-34d346cf34b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:22.748916 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4472e-2fd5-4dc0-b273-34d346cf34b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:22.756374 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b7ed6-f35a-405c-8ca2-a1f8882f59eb None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:22.762678 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec4472e-2fd5-4dc0-b273-34d346cf34b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:22.764395 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec4472e-2fd5-4dc0-b273-34d346cf34b2 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:22.786439 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-8ec4472e-2fd5-4dc0-b273-34d346cf34b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:22.786439 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:22.786439 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:22.786439 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:22.786439 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:22.786439 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:22.786439 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:22.786439 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:22.786439 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:22.786439 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:22.786439 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:22.786439 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:22.786439 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:22.786439 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:22.786439 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:22.787372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:22.787372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:22.787372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:22.787372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:22.787372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:22.787372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:22.787372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:22.787372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:22.787372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:22.787372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:22.787372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:22.787372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:22.787372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:22.787372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:22.787372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:22.787372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:22.787372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:22.788250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:22.788250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:22.788250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:22.788250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:22.796052 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 235/462] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:22.797435 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4472e-2fd5-4dc0-b273-34d346cf34b2 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:22.797802 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01578bc3-159e-43ef-9f12-906e6248f5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:22.798928 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01578bc3-159e-43ef-9f12-906e6248f5ad None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:22.799409 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01578bc3-159e-43ef-9f12-906e6248f5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:22.799868 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01578bc3-159e-43ef-9f12-906e6248f5ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:22.811811 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01578bc3-159e-43ef-9f12-906e6248f5ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:22.813513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01578bc3-159e-43ef-9f12-906e6248f5ad None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:22.832779 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-01578bc3-159e-43ef-9f12-906e6248f5ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:22.832779 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:22.832779 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:22.832779 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:22.832779 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:22.832779 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:22.832779 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:22.832779 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:22.832779 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:22.832779 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:22.832779 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:22.832779 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:22.832779 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:22.832779 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:22.832779 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:22.833706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:22.833706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:22.833706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:22.833706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:22.833706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:22.833706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:22.833706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:22.833706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:22.833706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:22.833706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:22.833706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:22.833706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:22.833706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:22.833706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:22.833706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:22.833706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:22.833706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:22.834581 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:22.834581 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:22.834581 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:22.834581 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:22.837495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 228/463] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:22.838568 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01578bc3-159e-43ef-9f12-906e6248f5ad None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:22.912750 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4472e-2fd5-4dc0-b273-34d346cf34b2 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:22.944926 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01578bc3-159e-43ef-9f12-906e6248f5ad None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:22.951891 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b9534-908f-45c3-a6a7-8f0b7760caff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:22.952952 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b9534-908f-45c3-a6a7-8f0b7760caff None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:22.953507 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b9534-908f-45c3-a6a7-8f0b7760caff None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:22.954147 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b9534-908f-45c3-a6a7-8f0b7760caff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:22.972739 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b9534-908f-45c3-a6a7-8f0b7760caff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:22.975904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b9534-908f-45c3-a6a7-8f0b7760caff None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:22.984295 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da59217-3cfa-4d5f-a456-38e2be02ddd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:22.985227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da59217-3cfa-4d5f-a456-38e2be02ddd0 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:22.985666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da59217-3cfa-4d5f-a456-38e2be02ddd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:22.986089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da59217-3cfa-4d5f-a456-38e2be02ddd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:22.986989 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da59217-3cfa-4d5f-a456-38e2be02ddd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:22.987510 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da59217-3cfa-4d5f-a456-38e2be02ddd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:22.989109 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da59217-3cfa-4d5f-a456-38e2be02ddd0 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:22.996888 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-bc2b9534-908f-45c3-a6a7-8f0b7760caff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:22.996888 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:22.996888 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:22.996888 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:22.996888 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:22.996888 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:22.996888 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:22.996888 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:22.996888 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:22.996888 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:22.996888 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:22.996888 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:22.996888 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:22.996888 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:22.996888 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:22.997780 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:22.997780 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:22.997780 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:22.997780 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:22.997780 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:22.997780 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:22.997780 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:22.997780 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:22.997780 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:22.997780 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:22.997780 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:22.997780 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:22.997780 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:22.997780 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:22.997780 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:22.997780 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:22.997780 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:22.998664 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:22.998664 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:22.998664 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:22.998664 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:23.003051 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 236/464] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:23.004110 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b9534-908f-45c3-a6a7-8f0b7760caff None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:23.005951 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 229/465] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:23.007090 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da59217-3cfa-4d5f-a456-38e2be02ddd0 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:23.016736 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:23.027415 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:23.115670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da59217-3cfa-4d5f-a456-38e2be02ddd0 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:23.126814 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b9534-908f-45c3-a6a7-8f0b7760caff None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:23.159169 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fc1f5-43e8-41d6-bdb5-f4ede0dfb34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:23.160138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fc1f5-43e8-41d6-bdb5-f4ede0dfb34e None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:23.160558 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fc1f5-43e8-41d6-bdb5-f4ede0dfb34e None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:23.161091 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fc1f5-43e8-41d6-bdb5-f4ede0dfb34e None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:23.162067 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3fc1f5-43e8-41d6-bdb5-f4ede0dfb34e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:23.162567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3fc1f5-43e8-41d6-bdb5-f4ede0dfb34e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:23.165491 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3fc1f5-43e8-41d6-bdb5-f4ede0dfb34e None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:23.169011 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76434902-40b4-4ed1-abd9-1440ce6295f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:23.169687 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76434902-40b4-4ed1-abd9-1440ce6295f1 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:23.169979 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76434902-40b4-4ed1-abd9-1440ce6295f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:23.170351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76434902-40b4-4ed1-abd9-1440ce6295f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:23.171098 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76434902-40b4-4ed1-abd9-1440ce6295f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:23.171415 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76434902-40b4-4ed1-abd9-1440ce6295f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:23.172814 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76434902-40b4-4ed1-abd9-1440ce6295f1 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:23.179733 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 230/466] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:23.180418 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fc1f5-43e8-41d6-bdb5-f4ede0dfb34e None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:23.196173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 237/467] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:23.196173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec6201-2355-4637-9f26-c1941b2c5c7c None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:23.196173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec6201-2355-4637-9f26-c1941b2c5c7c None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:23.196173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec6201-2355-4637-9f26-c1941b2c5c7c None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:23.203734 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 238/468] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:23.204487 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec6201-2355-4637-9f26-c1941b2c5c7c None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:23.270026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:23.306429 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:23.313693 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fc1f5-43e8-41d6-bdb5-f4ede0dfb34e None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:23.348686 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec6201-2355-4637-9f26-c1941b2c5c7c None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:23.355008 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc0d22-c7ad-419b-b098-25b58f62350f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:23.355685 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc0d22-c7ad-419b-b098-25b58f62350f None admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:23.356137 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc0d22-c7ad-419b-b098-25b58f62350f None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:23.356557 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc0d22-c7ad-419b-b098-25b58f62350f None admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:23.357410 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc0d22-c7ad-419b-b098-25b58f62350f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:23.359061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc0d22-c7ad-419b-b098-25b58f62350f None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:23.384893 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 231/469] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Jul 12 13:04:23 2022] POST /identity/v3/users => generated 248 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:04:23.386238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc0d22-c7ad-419b-b098-25b58f62350f None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:23.402570 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67557bb-8890-49ea-a42a-6398da527739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:23.403401 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67557bb-8890-49ea-a42a-6398da527739 None admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:23.403797 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67557bb-8890-49ea-a42a-6398da527739 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:23.404080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67557bb-8890-49ea-a42a-6398da527739 None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:23.405187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67557bb-8890-49ea-a42a-6398da527739 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:23.407090 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67557bb-8890-49ea-a42a-6398da527739 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:23.439825 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 239/470] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Jul 12 13:04:23 2022] POST /identity/v3/users => generated 248 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:04:23.441288 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad711d2-d7fe-41ae-9419-6f46bd57b0a9 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:23.441587 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad711d2-d7fe-41ae-9419-6f46bd57b0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:23.441868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad711d2-d7fe-41ae-9419-6f46bd57b0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:23.468126 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-cad711d2-d7fe-41ae-9419-6f46bd57b0a9 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:23.470293 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-cad711d2-d7fe-41ae-9419-6f46bd57b0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:23.535573 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc0d22-c7ad-419b-b098-25b58f62350f None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:23.561347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 240/471] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:23.567000 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:23.585601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410c9c7-ef4a-46c7-a855-1bad1213dea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:23.587221 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410c9c7-ef4a-46c7-a855-1bad1213dea1 None admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:23.587690 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410c9c7-ef4a-46c7-a855-1bad1213dea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:23.588397 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410c9c7-ef4a-46c7-a855-1bad1213dea1 None admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:23.589306 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410c9c7-ef4a-46c7-a855-1bad1213dea1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:23.591026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410c9c7-ef4a-46c7-a855-1bad1213dea1 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:23.598648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad711d2-d7fe-41ae-9419-6f46bd57b0a9 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:23.634967 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 232/472] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Jul 12 13:04:23 2022] POST /identity/v3/users => generated 246 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:04:23.710072 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:23.755926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad711d2-d7fe-41ae-9419-6f46bd57b0a9 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:23.798036 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc61322-065f-4464-a0db-ba409584824a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:23.798289 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b870f8-144d-48ac-a3c9-09b0c76441bb None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:23.798387 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b870f8-144d-48ac-a3c9-09b0c76441bb None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:23.798608 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b870f8-144d-48ac-a3c9-09b0c76441bb None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:23.798861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc61322-065f-4464-a0db-ba409584824a None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:23.799149 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc61322-065f-4464-a0db-ba409584824a None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:23.799435 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc61322-065f-4464-a0db-ba409584824a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:23.800297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 233/473] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:23.807350 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d862c-d848-46aa-a980-547e00f2c767 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:23.807673 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d862c-d848-46aa-a980-547e00f2c767 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:23.807930 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d862c-d848-46aa-a980-547e00f2c767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:23.811710 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc61322-065f-4464-a0db-ba409584824a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:23.813237 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc61322-065f-4464-a0db-ba409584824a None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:23.831277 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-722d862c-d848-46aa-a980-547e00f2c767 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:23.832836 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-722d862c-d848-46aa-a980-547e00f2c767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:23.835897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-cdc61322-065f-4464-a0db-ba409584824a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:23.835897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:23.835897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:23.835897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:23.835897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:23.835897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:23.835897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:23.835897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:23.835897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:23.835897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:23.835897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:23.835897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:23.835897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:23.835897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:23.835897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:23.837315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:23.837315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:23.837315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:23.837315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:23.837315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:23.837315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:23.837315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:23.837315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:23.837315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:23.837315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:23.837315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:23.837315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:23.837315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:23.837315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:23.837315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:23.837315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:23.837315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:23.838194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:23.838194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:23.838194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:23.838194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:23.838194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 241/474] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:04:23.844919 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc61322-065f-4464-a0db-ba409584824a None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:23.919668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 234/475] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:23.941473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d862c-d848-46aa-a980-547e00f2c767 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:23.981219 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc61322-065f-4464-a0db-ba409584824a None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:23.995596 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:24.029988 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcec63-66ed-4968-9f91-552f3f8cab5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:24.030700 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcec63-66ed-4968-9f91-552f3f8cab5f None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:24.030987 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcec63-66ed-4968-9f91-552f3f8cab5f None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:24.031268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcec63-66ed-4968-9f91-552f3f8cab5f None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:24.032398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddcec63-66ed-4968-9f91-552f3f8cab5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:24.032713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddcec63-66ed-4968-9f91-552f3f8cab5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:24.034992 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddcec63-66ed-4968-9f91-552f3f8cab5f None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:24.051036 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 242/476] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:04:24.056583 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcec63-66ed-4968-9f91-552f3f8cab5f None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:24.089043 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d862c-d848-46aa-a980-547e00f2c767 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:24.097439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:24.127753 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc3937-24c7-4a21-982f-ec06f73e0d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:24.128787 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc3937-24c7-4a21-982f-ec06f73e0d6d None admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:24.129298 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc3937-24c7-4a21-982f-ec06f73e0d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:24.129774 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc3937-24c7-4a21-982f-ec06f73e0d6d None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:24.130778 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc3937-24c7-4a21-982f-ec06f73e0d6d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:24.132469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc3937-24c7-4a21-982f-ec06f73e0d6d None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:24.142139 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.sql.core [None req-55dc3937-24c7-4a21-982f-ec06f73e0d6d None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 13:04:24.142139 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 12 13:04:24.142139 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [parameters: {'id': 'e87c8abca7c245c4a745b24ccefb60dc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 12 13:04:24.142139 dv-cinder-797608-55-smb devstack@keystone.service[80627]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80627) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 13:04:24.160129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-55dc3937-24c7-4a21-982f-ec06f73e0d6d None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 12 13:04:24.160129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:24.160129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 13:04:24.160129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 13:04:24.160129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 13:04:24.160129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 13:04:24.160129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 13:04:24.160129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 13:04:24.160129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 13:04:24.160129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application conn.query(q) Jul 12 13:04:24.160129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 13:04:24.160129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 13:04:24.160129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 13:04:24.160129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application result.read() Jul 12 13:04:24.160129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 13:04:24.161129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 13:04:24.161129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 13:04:24.161129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 13:04:24.161129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 13:04:24.161129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 13:04:24.161129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 13:04:24.161129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 13:04:24.161129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 13:04:24.161129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:24.161129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 13:04:24.161129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:24.161129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:24.161129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 13:04:24.161129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 13:04:24.161129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 12 13:04:24.161129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return ref.to_dict() Jul 12 13:04:24.161129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 13:04:24.161129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application next(self.gen) Jul 12 13:04:24.162046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 13:04:24.162046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application yield resource Jul 12 13:04:24.162046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 13:04:24.162046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application next(self.gen) Jul 12 13:04:24.162046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 13:04:24.162046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 13:04:24.162046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 13:04:24.162046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 13:04:24.162046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 13:04:24.162046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise self.value Jul 12 13:04:24.162046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 13:04:24.162046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 13:04:24.162046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 13:04:24.162046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application session.commit() Jul 12 13:04:24.162046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 13:04:24.162046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 13:04:24.162046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 13:04:24.162984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 13:04:24.162984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 13:04:24.162984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self.session.flush() Jul 12 13:04:24.162984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 13:04:24.162984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 13:04:24.162984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 13:04:24.162984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 13:04:24.162984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 13:04:24.162984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application compat.raise_( Jul 12 13:04:24.162984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 13:04:24.162984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception Jul 12 13:04:24.162984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 13:04:24.162984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 13:04:24.162984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 13:04:24.162984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 13:04:24.162984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 13:04:24.162984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 13:04:24.163857 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 13:04:24.163857 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 13:04:24.163857 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 12 13:04:24.163857 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 12 13:04:24.163857 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 13:04:24.163857 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 13:04:24.163857 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 13:04:24.163857 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 13:04:24.163857 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 13:04:24.163857 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 13:04:24.163857 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 13:04:24.163857 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 13:04:24.163857 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 13:04:24.163857 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 13:04:24.163857 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 13:04:24.163857 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception Jul 12 13:04:24.164953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 13:04:24.164953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 13:04:24.164953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 13:04:24.164953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 13:04:24.164953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 13:04:24.164953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 13:04:24.164953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 13:04:24.164953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application conn.query(q) Jul 12 13:04:24.164953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 13:04:24.164953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 13:04:24.164953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 13:04:24.164953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application result.read() Jul 12 13:04:24.164953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 13:04:24.164953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 13:04:24.164953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 13:04:24.164953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 13:04:24.165754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 13:04:24.165754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 13:04:24.165754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 13:04:24.165754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 13:04:24.165754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 13:04:24.165754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 12 13:04:24.165754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [parameters: {'id': 'e87c8abca7c245c4a745b24ccefb60dc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 12 13:04:24.165754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 13:04:24.165754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:24.165754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:04:24.165754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:24.165754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:24.165754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:24.165754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:24.165754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:24.165754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:24.168414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:24.168414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:24.168414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:24.168414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:24.168414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:24.168414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:24.168414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 12 13:04:24.168414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 12 13:04:24.168414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:24.168414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:24.168414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 12 13:04:24.168414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 12 13:04:24.168414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 13:04:24.168414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 13:04:24.168414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 12 13:04:24.168414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:24.170429 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcec63-66ed-4968-9f91-552f3f8cab5f None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:24.172419 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 235/477] 10.222.0.17 () {60 vars in 1131 bytes} [Tue Jul 12 13:04:23 2022] POST /identity/v3/roles => generated 144 bytes in 231 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:24.177932 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc3937-24c7-4a21-982f-ec06f73e0d6d None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:24.205674 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b952efe-5499-4374-9a2d-53ec52236cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:24.206386 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b952efe-5499-4374-9a2d-53ec52236cc3 None admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:24.206683 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b952efe-5499-4374-9a2d-53ec52236cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:24.207090 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b952efe-5499-4374-9a2d-53ec52236cc3 None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:24.207695 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b952efe-5499-4374-9a2d-53ec52236cc3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:24.209175 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b952efe-5499-4374-9a2d-53ec52236cc3 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:24.235286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 243/478] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Jul 12 13:04:24 2022] POST /identity/v3/users => generated 249 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:04:24.385123 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc3937-24c7-4a21-982f-ec06f73e0d6d None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:24.434990 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7dd80-626d-419a-add5-f9eb2fcd4f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:24.435850 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7dd80-626d-419a-add5-f9eb2fcd4f84 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:24.436159 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7dd80-626d-419a-add5-f9eb2fcd4f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:24.436441 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7dd80-626d-419a-add5-f9eb2fcd4f84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:24.448383 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7dd80-626d-419a-add5-f9eb2fcd4f84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:24.456668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-65e7dd80-626d-419a-add5-f9eb2fcd4f84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:04:24.456668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:24.456668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:24.456668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:24.456668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:24.456668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:24.456668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:24.456668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:24.456668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:24.456668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:24.456668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:24.456668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:24.456668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:24.456668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:24.456668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:24.456668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:24.457616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:24.457616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:24.457616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:24.457616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:24.457616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:24.457616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:24.457616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:24.457616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:24.457616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:24.457616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:24.457616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:24.457616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:24.457616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:24.457616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:24.457616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:24.457616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:24.458456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:24.458456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:24.458456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:24.458456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:24.458456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:24.458456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:24.458456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:24.458456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:24.458456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:24.458456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:24.458456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:04:24.458456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:24.458456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 236/479] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Jul 12 13:04:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:24.464687 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b952efe-5499-4374-9a2d-53ec52236cc3 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:24.507082 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:24.599353 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b952efe-5499-4374-9a2d-53ec52236cc3 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:24.643833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46956d69-07a0-460c-b971-19b5e0051ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:24.644537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46956d69-07a0-460c-b971-19b5e0051ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:24.644828 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46956d69-07a0-460c-b971-19b5e0051ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:24.645110 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46956d69-07a0-460c-b971-19b5e0051ac3 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:24.645886 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46956d69-07a0-460c-b971-19b5e0051ac3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:24.646220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46956d69-07a0-460c-b971-19b5e0051ac3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:24.647649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46956d69-07a0-460c-b971-19b5e0051ac3 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:24.657161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 244/480] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:25.964023 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301e7ba-0669-4065-ab7b-ea9949051315 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:25.964559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301e7ba-0669-4065-ab7b-ea9949051315 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:25.964865 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301e7ba-0669-4065-ab7b-ea9949051315 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:25.966402 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 237/481] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:25.976502 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b4bd5-c974-4ac0-a352-12df8c3c8f0d None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:25.977576 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b4bd5-c974-4ac0-a352-12df8c3c8f0d None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:25.977655 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b4bd5-c974-4ac0-a352-12df8c3c8f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:26.007246 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-910b4bd5-c974-4ac0-a352-12df8c3c8f0d None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:26.008552 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-910b4bd5-c974-4ac0-a352-12df8c3c8f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:26.123877 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 245/482] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:26.153264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301e7ba-0669-4065-ab7b-ea9949051315 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:26.202397 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:26.302191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb82797-fdbf-4bc0-a255-35262b337ee9 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:26.302595 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb82797-fdbf-4bc0-a255-35262b337ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:26.303046 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb82797-fdbf-4bc0-a255-35262b337ee9 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:26.305298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 246/483] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:26.310487 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301e7ba-0669-4065-ab7b-ea9949051315 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:26.310684 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499472f-257b-413b-98a0-730dfeb44934 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:26.311179 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499472f-257b-413b-98a0-730dfeb44934 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:26.311648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499472f-257b-413b-98a0-730dfeb44934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:26.352780 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-6499472f-257b-413b-98a0-730dfeb44934 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:26.354410 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-6499472f-257b-413b-98a0-730dfeb44934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:26.355922 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba867074-d1d7-4178-b5d5-08b36daa4f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:26.356753 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba867074-d1d7-4178-b5d5-08b36daa4f9b None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:26.357042 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba867074-d1d7-4178-b5d5-08b36daa4f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:26.357343 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba867074-d1d7-4178-b5d5-08b36daa4f9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:26.385291 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba867074-d1d7-4178-b5d5-08b36daa4f9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:26.391835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:26.394895 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-ba867074-d1d7-4178-b5d5-08b36daa4f9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:26.394895 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:26.394895 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:26.394895 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:26.394895 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:26.394895 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:26.394895 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:26.394895 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:26.394895 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:26.394895 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:26.394895 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:26.394895 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:26.394895 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:26.394895 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:26.394895 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:26.394895 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:26.395907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:26.395907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:26.395907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:26.395907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:26.395907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:26.395907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:26.395907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:26.395907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:26.395907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:26.395907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:26.395907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:26.395907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:26.395907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:26.395907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:26.395907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:26.395907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:26.396722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:26.396722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:26.396722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:26.396722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:26.396722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:26.396722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:26.396722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:26.396722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:26.396722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:26.396722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:26.396722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:26.396722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:26.401160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 238/484] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Jul 12 13:04:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:26.403330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09501c-efb1-4f6c-b88f-8178d1d3de2a None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:26.403711 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09501c-efb1-4f6c-b88f-8178d1d3de2a None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:26.403991 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09501c-efb1-4f6c-b88f-8178d1d3de2a None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:26.405949 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 239/485] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:26.407971 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09501c-efb1-4f6c-b88f-8178d1d3de2a None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:26.450644 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 247/486] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:26.451977 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb142b-ae00-4a4e-b304-808961879293 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:26.452271 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb142b-ae00-4a4e-b304-808961879293 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:26.452557 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb142b-ae00-4a4e-b304-808961879293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:26.471353 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-5aeb142b-ae00-4a4e-b304-808961879293 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:26.473019 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-5aeb142b-ae00-4a4e-b304-808961879293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:26.550548 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:26.562311 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 248/487] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:26.563124 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb142b-ae00-4a4e-b304-808961879293 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:26.573189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09501c-efb1-4f6c-b88f-8178d1d3de2a None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:26.639239 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92ce41-8e83-49f0-88d8-6ec98b8f4d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:26.640022 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92ce41-8e83-49f0-88d8-6ec98b8f4d6f None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:26.640310 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92ce41-8e83-49f0-88d8-6ec98b8f4d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:26.640587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92ce41-8e83-49f0-88d8-6ec98b8f4d6f None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:26.641373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc92ce41-8e83-49f0-88d8-6ec98b8f4d6f None admin] RBAC: Adding query filter params (name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:26.641729 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc92ce41-8e83-49f0-88d8-6ec98b8f4d6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:26.644206 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc92ce41-8e83-49f0-88d8-6ec98b8f4d6f None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:26.654158 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:26.661050 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 240/488] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Jul 12 13:04:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:26.663281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92ce41-8e83-49f0-88d8-6ec98b8f4d6f None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:26.680351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb142b-ae00-4a4e-b304-808961879293 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:26.729243 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c76fc-cdee-4c7d-b9a0-68595c94a7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:26.730198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c76fc-cdee-4c7d-b9a0-68595c94a7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:26.730486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c76fc-cdee-4c7d-b9a0-68595c94a7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:26.730765 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c76fc-cdee-4c7d-b9a0-68595c94a7e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:26.743861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c76fc-cdee-4c7d-b9a0-68595c94a7e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:26.753193 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-965c76fc-cdee-4c7d-b9a0-68595c94a7e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:26.753193 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:26.753193 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:26.753193 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:26.753193 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:26.753193 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:26.753193 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:26.753193 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:26.753193 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:26.753193 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:26.753193 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:26.753193 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:26.753193 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:26.753193 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:26.753193 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:26.753193 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:26.754187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:26.754187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:26.754187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:26.754187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:26.754187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:26.754187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:26.754187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:26.754187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:26.754187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:26.754187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:26.754187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:26.754187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:26.754187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:26.754187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:26.754187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:26.754187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:26.754990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:26.754990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:26.754990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:26.754990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:26.754990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:26.754990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:26.754990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:26.754990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:26.754990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:26.754990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:26.754990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:26.754990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:26.762304 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 249/489] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Jul 12 13:04:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:26.763425 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c76fc-cdee-4c7d-b9a0-68595c94a7e2 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:26.803031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92ce41-8e83-49f0-88d8-6ec98b8f4d6f None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:26.849457 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c8d01-fe2d-4304-8daf-50e984093b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:26.850923 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c8d01-fe2d-4304-8daf-50e984093b87 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:26.851218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c8d01-fe2d-4304-8daf-50e984093b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:26.851503 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c8d01-fe2d-4304-8daf-50e984093b87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:26.866959 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c8d01-fe2d-4304-8daf-50e984093b87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:26.878344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-770c8d01-fe2d-4304-8daf-50e984093b87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:26.878344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:26.878344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:26.878344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:26.878344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:26.878344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:26.878344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:26.878344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:26.878344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:26.878344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:26.878344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:26.878344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:26.878344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:26.878344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:26.878344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:26.878344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:26.880158 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:26.880158 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:26.880158 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:26.880158 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:26.880158 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:26.880158 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:26.880158 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:26.880158 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:26.880158 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:26.880158 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:26.880158 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:26.880158 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:26.880158 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:26.880158 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:26.880158 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:26.880158 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:26.881791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:26.881791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:26.881791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:26.881791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:26.881791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:26.881791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:26.881791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:26.881791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:26.881791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:26.881791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:26.881791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:26.881791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:26.881791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 241/490] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Jul 12 13:04:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:26.881791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c8d01-fe2d-4304-8daf-50e984093b87 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:26.900908 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:26.908785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c76fc-cdee-4c7d-b9a0-68595c94a7e2 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:26.948490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd6c7b-985f-43e1-be58-1fcd42ea247c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:26.949460 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd6c7b-985f-43e1-be58-1fcd42ea247c None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:26.949751 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd6c7b-985f-43e1-be58-1fcd42ea247c None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:26.950029 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd6c7b-985f-43e1-be58-1fcd42ea247c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:26.958078 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:26.967348 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd6c7b-985f-43e1-be58-1fcd42ea247c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:26.968954 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd6c7b-985f-43e1-be58-1fcd42ea247c None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:26.995820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-10cd6c7b-985f-43e1-be58-1fcd42ea247c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:26.995820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:26.995820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:26.995820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:26.995820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:26.995820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:26.995820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:26.995820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:26.995820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:26.995820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:26.995820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:26.995820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:26.995820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:26.995820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:26.995820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:26.998175 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:26.998175 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:26.998175 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:26.998175 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:26.998175 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:26.998175 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:26.998175 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:26.998175 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:26.998175 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:26.998175 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:26.998175 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:26.998175 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:26.998175 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:26.998175 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:26.998175 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:26.998175 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:26.998175 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:27.000269 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:27.000269 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:27.000269 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:27.000269 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:27.003115 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 250/491] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:27.003115 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd6c7b-985f-43e1-be58-1fcd42ea247c None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:27.020453 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c8d01-fe2d-4304-8daf-50e984093b87 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:27.057034 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de66b1-518a-4c9b-b122-8b6f7620a6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:27.058086 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de66b1-518a-4c9b-b122-8b6f7620a6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:27.058643 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de66b1-518a-4c9b-b122-8b6f7620a6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:27.059124 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de66b1-518a-4c9b-b122-8b6f7620a6e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:27.060143 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de66b1-518a-4c9b-b122-8b6f7620a6e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:27.060659 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de66b1-518a-4c9b-b122-8b6f7620a6e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:27.062334 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de66b1-518a-4c9b-b122-8b6f7620a6e8 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:27.071354 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 242/492] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Jul 12 13:04:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:27.072416 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de66b1-518a-4c9b-b122-8b6f7620a6e8 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:27.121066 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd6c7b-985f-43e1-be58-1fcd42ea247c None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:27.154639 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:27.160819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351d527-6034-4ccb-9302-b8a15fecece7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:27.161562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351d527-6034-4ccb-9302-b8a15fecece7 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:27.161918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351d527-6034-4ccb-9302-b8a15fecece7 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:27.162249 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351d527-6034-4ccb-9302-b8a15fecece7 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:27.163005 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351d527-6034-4ccb-9302-b8a15fecece7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:27.163314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351d527-6034-4ccb-9302-b8a15fecece7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:27.165570 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351d527-6034-4ccb-9302-b8a15fecece7 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:27.180413 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 251/493] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Jul 12 13:04:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:27.181537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351d527-6034-4ccb-9302-b8a15fecece7 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:27.185879 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de66b1-518a-4c9b-b122-8b6f7620a6e8 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:27.227156 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2741a69-4999-444a-8752-491b9d50e7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:27.228410 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2741a69-4999-444a-8752-491b9d50e7ec None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:27.232626 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2741a69-4999-444a-8752-491b9d50e7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:27.233361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2741a69-4999-444a-8752-491b9d50e7ec None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:27.234428 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2741a69-4999-444a-8752-491b9d50e7ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:27.241535 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2741a69-4999-444a-8752-491b9d50e7ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:27.243095 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2741a69-4999-444a-8752-491b9d50e7ec None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:27.247702 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:27.262813 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 243/494] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:27.263937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2741a69-4999-444a-8752-491b9d50e7ec None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:27.317162 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351d527-6034-4ccb-9302-b8a15fecece7 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:27.358224 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c9610-95f9-43bb-a92a-e8eea99cdb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:27.359039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c9610-95f9-43bb-a92a-e8eea99cdb08 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:27.359331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c9610-95f9-43bb-a92a-e8eea99cdb08 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:27.359610 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c9610-95f9-43bb-a92a-e8eea99cdb08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:27.371252 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c9610-95f9-43bb-a92a-e8eea99cdb08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:27.372939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c9610-95f9-43bb-a92a-e8eea99cdb08 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:27.382360 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2741a69-4999-444a-8752-491b9d50e7ec None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:27.390911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-a11c9610-95f9-43bb-a92a-e8eea99cdb08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:27.390911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:27.390911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:27.390911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:27.390911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:27.390911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:27.390911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:27.390911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:27.390911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:27.390911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:27.390911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:27.390911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:27.390911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:27.390911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:27.390911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:27.391936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:27.391936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:27.391936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:27.391936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:27.391936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:27.391936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:27.391936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:27.391936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:27.391936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:27.391936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:27.391936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:27.391936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:27.391936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:27.391936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:27.391936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:27.391936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:27.391936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:27.393230 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:27.393230 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:27.393230 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:27.393230 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:27.393230 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 252/495] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:27.393687 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f302ff0-cbfc-4c86-a9f3-23f1a478045e None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:27.393979 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f302ff0-cbfc-4c86-a9f3-23f1a478045e None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:27.394285 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f302ff0-cbfc-4c86-a9f3-23f1a478045e None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:27.395699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 253/496] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:27.397264 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f302ff0-cbfc-4c86-a9f3-23f1a478045e None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:27.421008 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0769f-78d7-443b-8e61-907c096bab64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:27.421812 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0769f-78d7-443b-8e61-907c096bab64 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:27.422108 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0769f-78d7-443b-8e61-907c096bab64 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:27.422420 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0769f-78d7-443b-8e61-907c096bab64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:27.424373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:27.434180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0769f-78d7-443b-8e61-907c096bab64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:27.435637 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0769f-78d7-443b-8e61-907c096bab64 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:27.453192 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-e0b0769f-78d7-443b-8e61-907c096bab64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:27.453192 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:27.453192 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:27.453192 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:27.453192 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:27.453192 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:27.453192 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:27.453192 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:27.453192 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:27.453192 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:27.453192 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:27.453192 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:27.453192 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:27.453192 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:27.453192 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:27.454154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:27.454154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:27.454154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:27.454154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:27.454154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:27.454154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:27.454154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:27.454154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:27.454154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:27.454154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:27.454154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:27.454154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:27.454154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:27.454154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:27.454154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:27.454154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:27.454154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:27.455006 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:27.455006 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:27.455006 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:27.455006 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:27.455006 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 244/497] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:27.455712 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15110a-9502-4936-b95c-d7f059656ec2 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:27.455927 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15110a-9502-4936-b95c-d7f059656ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:27.456200 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15110a-9502-4936-b95c-d7f059656ec2 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:27.457578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 245/498] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:27.458145 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15110a-9502-4936-b95c-d7f059656ec2 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:27.506444 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f302ff0-cbfc-4c86-a9f3-23f1a478045e None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:27.508737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:27.541477 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e96f1f-a6f8-4e87-9776-bdac9fd1052f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:27.542315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e96f1f-a6f8-4e87-9776-bdac9fd1052f None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:27.542601 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e96f1f-a6f8-4e87-9776-bdac9fd1052f None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:27.542881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e96f1f-a6f8-4e87-9776-bdac9fd1052f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:27.550654 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e96f1f-a6f8-4e87-9776-bdac9fd1052f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:27.552108 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e96f1f-a6f8-4e87-9776-bdac9fd1052f None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:27.563136 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15110a-9502-4936-b95c-d7f059656ec2 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:27.567461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-16e96f1f-a6f8-4e87-9776-bdac9fd1052f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 13:04:27.567461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:27.567461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:27.567461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:27.567461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:27.567461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:27.567461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:27.567461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:27.567461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:27.567461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:27.567461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:27.567461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:27.567461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:04:27.567461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:04:27.567461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:04:27.567461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:04:27.568585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:27.568585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:27.568585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:04:27.568585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:27.568585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:04:27.568585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:27.568585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:27.568585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:27.568585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:27.568585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:27.568585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:27.568585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:27.568585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:27.568585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:27.568585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:27.568585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:27.568585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:27.568585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:27.569526 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:27.569526 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:27.569526 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:04:27.569526 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:04:27.569526 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:04:27.569526 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:04:27.569526 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:04:27.569526 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:04:27.569526 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 13:04:27.569526 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:27.569526 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 254/499] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:04:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:27.570294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c7275-ce46-4673-aee4-9a96599b7dea None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:27.570294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c7275-ce46-4673-aee4-9a96599b7dea None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:27.570485 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c7275-ce46-4673-aee4-9a96599b7dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:27.587713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-b66c7275-ce46-4673-aee4-9a96599b7dea None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:27.588925 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-b66c7275-ce46-4673-aee4-9a96599b7dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:27.603052 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb85a9-58fa-4167-9e4a-58ecf86667aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:27.603724 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb85a9-58fa-4167-9e4a-58ecf86667aa None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:27.604015 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb85a9-58fa-4167-9e4a-58ecf86667aa None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:27.604298 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb85a9-58fa-4167-9e4a-58ecf86667aa None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:27.605018 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb85a9-58fa-4167-9e4a-58ecf86667aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:27.605333 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb85a9-58fa-4167-9e4a-58ecf86667aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:27.606745 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb85a9-58fa-4167-9e4a-58ecf86667aa None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:27.618643 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 246/500] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:27.619453 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb85a9-58fa-4167-9e4a-58ecf86667aa None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:27.655899 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 255/501] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:27.657194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a6236-3bad-4e6b-b4af-b33880c5474d None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:27.657484 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a6236-3bad-4e6b-b4af-b33880c5474d None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:27.657761 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a6236-3bad-4e6b-b4af-b33880c5474d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:27.670090 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:27.677294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-a76a6236-3bad-4e6b-b4af-b33880c5474d None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:27.678696 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a76a6236-3bad-4e6b-b4af-b33880c5474d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:27.731239 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb85a9-58fa-4167-9e4a-58ecf86667aa None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:27.748218 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 256/502] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:27.749076 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a6236-3bad-4e6b-b4af-b33880c5474d None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:27.766479 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f17b6-fbd8-4ec1-8567-0c5c2a9e5c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:27.767164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f17b6-fbd8-4ec1-8567-0c5c2a9e5c22 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:27.767444 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f17b6-fbd8-4ec1-8567-0c5c2a9e5c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:27.767729 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f17b6-fbd8-4ec1-8567-0c5c2a9e5c22 None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:27.768454 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f17b6-fbd8-4ec1-8567-0c5c2a9e5c22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:27.768770 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f17b6-fbd8-4ec1-8567-0c5c2a9e5c22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:27.770213 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f17b6-fbd8-4ec1-8567-0c5c2a9e5c22 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:27.782714 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 247/503] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:27.783560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f17b6-fbd8-4ec1-8567-0c5c2a9e5c22 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:27.788663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:27.865275 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a6236-3bad-4e6b-b4af-b33880c5474d None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:27.886063 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f17b6-fbd8-4ec1-8567-0c5c2a9e5c22 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:27.893754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:27.899674 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2386c-6a3f-4ca2-8814-2b6384134573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:27.900353 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2386c-6a3f-4ca2-8814-2b6384134573 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:27.900649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2386c-6a3f-4ca2-8814-2b6384134573 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:27.900905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2386c-6a3f-4ca2-8814-2b6384134573 None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:27.901756 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2386c-6a3f-4ca2-8814-2b6384134573 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:27.902063 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2386c-6a3f-4ca2-8814-2b6384134573 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:27.903533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2386c-6a3f-4ca2-8814-2b6384134573 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:27.922634 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac261177-6324-43af-b860-bd34cb993e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:27.923357 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac261177-6324-43af-b860-bd34cb993e16 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:27.923646 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac261177-6324-43af-b860-bd34cb993e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:27.923926 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac261177-6324-43af-b860-bd34cb993e16 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:27.931905 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac261177-6324-43af-b860-bd34cb993e16 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:27.933388 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac261177-6324-43af-b860-bd34cb993e16 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:27.941381 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 257/504] 10.222.0.17 () {56 vars in 1137 bytes} [Tue Jul 12 13:04:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:27.942245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2386c-6a3f-4ca2-8814-2b6384134573 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:27.950292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-ac261177-6324-43af-b860-bd34cb993e16 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:04:27.950292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:27.950292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:27.950292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:27.950292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:27.950292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:27.950292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:27.950292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:27.950292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:27.950292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:27.950292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:27.950292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:27.950292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:04:27.950292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:04:27.950292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:04:27.950292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:04:27.951502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:27.951502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:27.951502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:04:27.951502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:27.951502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:04:27.951502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:27.951502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:27.951502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:27.951502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:27.951502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:27.951502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:27.951502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:27.951502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:27.951502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:27.951502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:27.951502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:27.951502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:27.951502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:27.952635 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:27.952635 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:27.952635 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:04:27.952635 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:04:27.952635 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:04:27.952635 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:04:27.952635 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:04:27.952635 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:04:27.952635 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:04:27.952635 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:27.952635 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 248/505] 10.222.0.17 () {56 vars in 1093 bytes} [Tue Jul 12 13:04:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:27.953347 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac261177-6324-43af-b860-bd34cb993e16 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:28.028747 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:28.049105 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2386c-6a3f-4ca2-8814-2b6384134573 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:28.060268 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac261177-6324-43af-b860-bd34cb993e16 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:28.084510 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f23a6f-7df5-4d3f-b7e7-9005cd769ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:28.085336 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f23a6f-7df5-4d3f-b7e7-9005cd769ded None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:28.085630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f23a6f-7df5-4d3f-b7e7-9005cd769ded None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:28.085917 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f23a6f-7df5-4d3f-b7e7-9005cd769ded None admin] PATH_INFO: `/v3/roles/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:28.096118 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41797c1f-bdbc-49f8-ba03-c553411975ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:28.096925 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41797c1f-bdbc-49f8-ba03-c553411975ea None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:28.097086 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f23a6f-7df5-4d3f-b7e7-9005cd769ded None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:28.097210 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41797c1f-bdbc-49f8-ba03-c553411975ea None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:28.097487 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41797c1f-bdbc-49f8-ba03-c553411975ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:28.105649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-73f23a6f-7df5-4d3f-b7e7-9005cd769ded None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:28.105649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:28.105649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:28.105649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:28.105649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:28.105649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:28.105649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:28.105649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:28.105649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:28.105649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:28.105649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:28.105649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:28.105649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:28.105649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:28.105649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:28.105649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:28.106779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:28.106779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:28.106779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:28.106779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:28.106779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:28.106779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:28.106779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:28.106779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:28.106779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:28.106779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:28.106779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:28.106779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:28.106779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:28.106779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:28.106779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:28.106779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:28.107627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:28.107627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:28.107627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:28.107627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:28.107627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:28.107627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:28.107627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:28.107627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:28.107627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:28.107627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:28.107627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:28.107627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:28.107627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 258/506] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Jul 12 13:04:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:28.108289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f23a6f-7df5-4d3f-b7e7-9005cd769ded None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:28.110670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41797c1f-bdbc-49f8-ba03-c553411975ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:28.112147 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41797c1f-bdbc-49f8-ba03-c553411975ea None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:28.131754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-41797c1f-bdbc-49f8-ba03-c553411975ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:28.131754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:28.131754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:28.131754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:28.131754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:28.131754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:28.131754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:28.131754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:28.131754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:28.131754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:28.131754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:28.131754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:28.131754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:28.131754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:28.131754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:28.132679 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:28.132679 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:28.132679 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:28.132679 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:28.132679 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:28.132679 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:28.132679 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:28.132679 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:28.132679 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:28.132679 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:28.132679 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:28.132679 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:28.132679 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:28.132679 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:28.132679 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:28.132679 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:28.132679 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:28.134164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:28.134164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:28.134164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:28.134164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:28.134164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 249/507] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:28.134430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41797c1f-bdbc-49f8-ba03-c553411975ea None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:28.155244 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:28.220970 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f23a6f-7df5-4d3f-b7e7-9005cd769ded None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:28.239504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41797c1f-bdbc-49f8-ba03-c553411975ea None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:28.256383 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc042303-0578-43f1-8137-74a2db90bbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:28.257205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc042303-0578-43f1-8137-74a2db90bbb5 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:28.257496 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc042303-0578-43f1-8137-74a2db90bbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:28.257837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc042303-0578-43f1-8137-74a2db90bbb5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:28.266737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc042303-0578-43f1-8137-74a2db90bbb5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:28.268271 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc042303-0578-43f1-8137-74a2db90bbb5 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:28.275427 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac8d03-ef6d-465f-baa4-9389ba689543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:28.276087 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac8d03-ef6d-465f-baa4-9389ba689543 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:28.276375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac8d03-ef6d-465f-baa4-9389ba689543 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:28.276655 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac8d03-ef6d-465f-baa4-9389ba689543 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:28.282665 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-bc042303-0578-43f1-8137-74a2db90bbb5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 13:04:28.282665 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:28.282665 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:28.282665 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:28.282665 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:28.282665 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:28.282665 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:28.282665 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:28.282665 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:28.282665 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:28.282665 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:28.282665 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:28.282665 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:04:28.282665 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:04:28.282665 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:04:28.282665 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:04:28.283706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:28.283706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:28.283706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:04:28.283706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:28.283706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:04:28.283706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:28.283706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:28.283706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:28.283706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:28.283706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:28.283706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:28.283706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:28.283706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:28.283706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:28.283706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:28.283706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:28.283706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:28.283706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:28.284630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:28.284630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:28.284630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:04:28.284630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:04:28.284630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:04:28.284630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:04:28.284630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:04:28.284630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:04:28.284630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 13:04:28.284630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:28.284630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 259/508] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:04:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:28.285183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc042303-0578-43f1-8137-74a2db90bbb5 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:28.288022 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:28.345865 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac8d03-ef6d-465f-baa4-9389ba689543 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:28.347401 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac8d03-ef6d-465f-baa4-9389ba689543 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:28.366072 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:28.391207 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc042303-0578-43f1-8137-74a2db90bbb5 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:28.424770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8f3b2-1289-47a9-8c71-2f9d4a6120df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:28.425445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8f3b2-1289-47a9-8c71-2f9d4a6120df None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:28.425736 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8f3b2-1289-47a9-8c71-2f9d4a6120df None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:28.426013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8f3b2-1289-47a9-8c71-2f9d4a6120df None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:28.426873 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8f3b2-1289-47a9-8c71-2f9d4a6120df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:28.427189 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8f3b2-1289-47a9-8c71-2f9d4a6120df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:28.428625 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8f3b2-1289-47a9-8c71-2f9d4a6120df None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:28.446943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 260/509] 10.222.0.17 () {56 vars in 1133 bytes} [Tue Jul 12 13:04:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:28.447780 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8f3b2-1289-47a9-8c71-2f9d4a6120df None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:28.450996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 250/510] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:04:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:04:28.452049 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac8d03-ef6d-465f-baa4-9389ba689543 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:28.507455 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:28.550441 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8f3b2-1289-47a9-8c71-2f9d4a6120df None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:28.552455 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac8d03-ef6d-465f-baa4-9389ba689543 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:28.570943 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:28.586507 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe62ade-4c1b-46f9-b95d-05dac97e96f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:28.587362 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe62ade-4c1b-46f9-b95d-05dac97e96f4 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:28.587629 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3e172-32a9-4f49-bda9-b9ea00eecda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:28.587844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe62ade-4c1b-46f9-b95d-05dac97e96f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:28.588222 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe62ade-4c1b-46f9-b95d-05dac97e96f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:28.588321 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3e172-32a9-4f49-bda9-b9ea00eecda1 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:28.588564 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3e172-32a9-4f49-bda9-b9ea00eecda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:28.588843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3e172-32a9-4f49-bda9-b9ea00eecda1 None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:28.589313 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe62ade-4c1b-46f9-b95d-05dac97e96f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:28.589560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3e172-32a9-4f49-bda9-b9ea00eecda1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:28.589823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe62ade-4c1b-46f9-b95d-05dac97e96f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:28.589910 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3e172-32a9-4f49-bda9-b9ea00eecda1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:28.591275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3e172-32a9-4f49-bda9-b9ea00eecda1 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:28.591388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe62ade-4c1b-46f9-b95d-05dac97e96f4 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:28.599885 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 261/511] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Jul 12 13:04:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:28.600713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe62ade-4c1b-46f9-b95d-05dac97e96f4 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:28.609302 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 251/512] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:28.609302 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3e172-32a9-4f49-bda9-b9ea00eecda1 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:28.709922 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3e172-32a9-4f49-bda9-b9ea00eecda1 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:28.714126 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe62ade-4c1b-46f9-b95d-05dac97e96f4 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:28.736019 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:28.744633 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bda94-94f3-4f68-8fb2-8a9f6e002e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:28.745294 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bda94-94f3-4f68-8fb2-8a9f6e002e1e None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:28.745585 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bda94-94f3-4f68-8fb2-8a9f6e002e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:28.745866 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bda94-94f3-4f68-8fb2-8a9f6e002e1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:28.748218 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f34ae-2e85-4a86-8e96-b9ab9650b663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:28.748944 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f34ae-2e85-4a86-8e96-b9ab9650b663 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:28.749239 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f34ae-2e85-4a86-8e96-b9ab9650b663 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:28.749525 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f34ae-2e85-4a86-8e96-b9ab9650b663 None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:28.750405 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f34ae-2e85-4a86-8e96-b9ab9650b663 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:28.750723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f34ae-2e85-4a86-8e96-b9ab9650b663 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:28.752178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f34ae-2e85-4a86-8e96-b9ab9650b663 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:28.770661 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 262/513] 10.222.0.17 () {56 vars in 1137 bytes} [Tue Jul 12 13:04:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:28.771276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f34ae-2e85-4a86-8e96-b9ab9650b663 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:28.793245 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:28.815052 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bda94-94f3-4f68-8fb2-8a9f6e002e1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:28.816525 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bda94-94f3-4f68-8fb2-8a9f6e002e1e None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:28.872567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f34ae-2e85-4a86-8e96-b9ab9650b663 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:28.907557 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacab00-b16f-49bf-9fe8-0702cc4fdd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:28.908369 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacab00-b16f-49bf-9fe8-0702cc4fdd47 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:28.908663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacab00-b16f-49bf-9fe8-0702cc4fdd47 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:28.908945 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacab00-b16f-49bf-9fe8-0702cc4fdd47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:28.917063 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 252/514] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:04:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:04:28.917912 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bda94-94f3-4f68-8fb2-8a9f6e002e1e None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:28.923838 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aacab00-b16f-49bf-9fe8-0702cc4fdd47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:28.925333 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aacab00-b16f-49bf-9fe8-0702cc4fdd47 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:28.943965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-8aacab00-b16f-49bf-9fe8-0702cc4fdd47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:28.943965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:28.943965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:28.943965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:28.943965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:28.943965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:28.943965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:28.943965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:28.943965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:28.943965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:28.943965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:28.943965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:28.943965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:28.943965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:28.943965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:28.944885 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:28.944885 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:28.944885 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:28.944885 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:28.944885 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:28.944885 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:28.944885 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:28.944885 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:28.944885 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:28.944885 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:28.944885 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:28.944885 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:28.944885 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:28.944885 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:28.944885 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:28.944885 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:28.944885 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:28.945771 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:28.945771 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:28.945771 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:28.945771 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:28.945771 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 263/515] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:28.946035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacab00-b16f-49bf-9fe8-0702cc4fdd47 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:28.981384 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:29.000620 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:29.023232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bda94-94f3-4f68-8fb2-8a9f6e002e1e None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:29.050975 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacab00-b16f-49bf-9fe8-0702cc4fdd47 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:29.070132 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03524867-88da-483c-8201-2ca4420b7b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:29.070955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03524867-88da-483c-8201-2ca4420b7b02 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:29.071239 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03524867-88da-483c-8201-2ca4420b7b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:29.071514 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03524867-88da-483c-8201-2ca4420b7b02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:29.081538 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03524867-88da-483c-8201-2ca4420b7b02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:29.083007 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03524867-88da-483c-8201-2ca4420b7b02 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:29.083900 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb91b7-fa1f-4e2d-baa0-1aa1a33927b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:29.084593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb91b7-fa1f-4e2d-baa0-1aa1a33927b9 None admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:29.084883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb91b7-fa1f-4e2d-baa0-1aa1a33927b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:29.085164 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb91b7-fa1f-4e2d-baa0-1aa1a33927b9 None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:29.086418 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb91b7-fa1f-4e2d-baa0-1aa1a33927b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:29.087856 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb91b7-fa1f-4e2d-baa0-1aa1a33927b9 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:29.101163 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-03524867-88da-483c-8201-2ca4420b7b02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:29.101163 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:29.101163 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:29.101163 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:29.101163 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:29.101163 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:29.101163 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:29.101163 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:29.101163 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:29.101163 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:29.101163 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:29.101163 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:29.101163 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:29.101163 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:29.101163 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:29.102982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:29.102982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:29.102982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:29.102982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:29.102982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:29.102982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:29.102982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:29.102982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:29.102982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:29.102982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:29.102982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:29.102982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:29.102982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:29.102982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:29.102982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:29.102982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:29.102982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:29.103845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:29.103845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:29.103845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:29.103845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:29.103845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 253/516] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:29.103845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03524867-88da-483c-8201-2ca4420b7b02 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:29.112211 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 264/517] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Jul 12 13:04:28 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:04:29.112916 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb91b7-fa1f-4e2d-baa0-1aa1a33927b9 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:29.219423 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03524867-88da-483c-8201-2ca4420b7b02 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:29.233491 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:29.249622 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb91b7-fa1f-4e2d-baa0-1aa1a33927b9 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:29.253500 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:29.259950 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2328ea5-dc98-4a75-bac5-b3d34113beaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:29.261343 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2328ea5-dc98-4a75-bac5-b3d34113beaf None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:29.261634 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2328ea5-dc98-4a75-bac5-b3d34113beaf None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:29.261912 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2328ea5-dc98-4a75-bac5-b3d34113beaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:29.293139 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfab0e-dac9-4eed-9394-d3f050a51d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:29.293881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfab0e-dac9-4eed-9394-d3f050a51d18 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:29.294223 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfab0e-dac9-4eed-9394-d3f050a51d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:29.294504 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfab0e-dac9-4eed-9394-d3f050a51d18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:29.306851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfab0e-dac9-4eed-9394-d3f050a51d18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:29.308322 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfab0e-dac9-4eed-9394-d3f050a51d18 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:29.327781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-04bfab0e-dac9-4eed-9394-d3f050a51d18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:29.327781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:29.327781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:29.327781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:29.327781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:29.327781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:29.327781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:29.327781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:29.327781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:29.327781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:29.327781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:29.327781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:29.327781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:29.327781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:29.327781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:29.328868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:29.328868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:29.328868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:29.328868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:29.328868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:29.328868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:29.328868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:29.328868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:29.328868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:29.328868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:29.328868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:29.328868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:29.328868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:29.328868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:29.328868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:29.328868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:29.328868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:29.329960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:29.329960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:29.329960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:29.329960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:29.329960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 265/518] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:29.330365 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfab0e-dac9-4eed-9394-d3f050a51d18 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:29.347590 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2328ea5-dc98-4a75-bac5-b3d34113beaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:29.349330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2328ea5-dc98-4a75-bac5-b3d34113beaf None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:29.441926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfab0e-dac9-4eed-9394-d3f050a51d18 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:29.467182 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 254/519] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:04:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:04:29.468052 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2328ea5-dc98-4a75-bac5-b3d34113beaf None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:29.484292 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7379cb-6b1b-430c-a85d-db2135e066b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:29.484292 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7379cb-6b1b-430c-a85d-db2135e066b2 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:29.484292 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7379cb-6b1b-430c-a85d-db2135e066b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:29.484292 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7379cb-6b1b-430c-a85d-db2135e066b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:29.484724 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7379cb-6b1b-430c-a85d-db2135e066b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:29.484724 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7379cb-6b1b-430c-a85d-db2135e066b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:29.485729 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7379cb-6b1b-430c-a85d-db2135e066b2 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:29.496684 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:29.505121 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 266/520] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:29.506061 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7379cb-6b1b-430c-a85d-db2135e066b2 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:29.512048 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:29.595539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2328ea5-dc98-4a75-bac5-b3d34113beaf None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:29.623794 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7379cb-6b1b-430c-a85d-db2135e066b2 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:29.634300 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d2e1a-8a39-41e4-8e47-3a31399dfe4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:29.635242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d2e1a-8a39-41e4-8e47-3a31399dfe4c None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:29.635538 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d2e1a-8a39-41e4-8e47-3a31399dfe4c None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:29.636077 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d2e1a-8a39-41e4-8e47-3a31399dfe4c None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:29.636816 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d2e1a-8a39-41e4-8e47-3a31399dfe4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:29.637129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d2e1a-8a39-41e4-8e47-3a31399dfe4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:29.638599 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d2e1a-8a39-41e4-8e47-3a31399dfe4c None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:29.652390 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 255/521] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:29.653240 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d2e1a-8a39-41e4-8e47-3a31399dfe4c None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:29.664426 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0643415-d2b2-437a-a8d2-2fe57c30df95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:29.665102 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0643415-d2b2-437a-a8d2-2fe57c30df95 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:29.665384 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0643415-d2b2-437a-a8d2-2fe57c30df95 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:29.665915 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0643415-d2b2-437a-a8d2-2fe57c30df95 None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:29.666435 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0643415-d2b2-437a-a8d2-2fe57c30df95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:29.666741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0643415-d2b2-437a-a8d2-2fe57c30df95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:29.668147 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0643415-d2b2-437a-a8d2-2fe57c30df95 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:29.686291 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 267/522] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:29.687221 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0643415-d2b2-437a-a8d2-2fe57c30df95 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:29.750144 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:29.763797 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:29.774910 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d2e1a-8a39-41e4-8e47-3a31399dfe4c None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:29.795693 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0643415-d2b2-437a-a8d2-2fe57c30df95 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:29.811007 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b943b-0be5-4806-846c-9a255ff1fb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:29.811810 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b943b-0be5-4806-846c-9a255ff1fb5e None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:29.812095 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b943b-0be5-4806-846c-9a255ff1fb5e None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:29.812364 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b943b-0be5-4806-846c-9a255ff1fb5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:29.824047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b943b-0be5-4806-846c-9a255ff1fb5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:29.825526 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b943b-0be5-4806-846c-9a255ff1fb5e None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:29.835678 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ae8b2-21ca-4fcb-ba3d-ad509b45ed41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:29.836773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ae8b2-21ca-4fcb-ba3d-ad509b45ed41 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:29.837270 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ae8b2-21ca-4fcb-ba3d-ad509b45ed41 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:29.837731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ae8b2-21ca-4fcb-ba3d-ad509b45ed41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:29.842957 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-ec0b943b-0be5-4806-846c-9a255ff1fb5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:29.842957 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:29.842957 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:29.842957 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:29.842957 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:29.842957 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:29.842957 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:29.842957 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:29.842957 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:29.842957 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:29.842957 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:29.842957 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:29.842957 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:29.842957 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:29.842957 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:29.843799 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:29.843799 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:29.843799 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:29.843799 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:29.843799 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:29.843799 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:29.843799 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:29.843799 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:29.843799 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:29.843799 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:29.843799 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:29.843799 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:29.843799 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:29.843799 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:29.843799 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:29.843799 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:29.843799 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:29.849320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:29.849320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:29.849320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:29.849320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:29.849320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 256/523] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:29.849320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b943b-0be5-4806-846c-9a255ff1fb5e None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:29.849796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ae8b2-21ca-4fcb-ba3d-ad509b45ed41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:29.849796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ae8b2-21ca-4fcb-ba3d-ad509b45ed41 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:29.865785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-c29ae8b2-21ca-4fcb-ba3d-ad509b45ed41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:29.865785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:29.865785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:29.865785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:29.865785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:29.865785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:29.865785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:29.865785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:29.865785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:29.865785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:29.865785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:29.865785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:29.865785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:04:29.865785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:04:29.865785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:04:29.866809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:04:29.866809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:29.866809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:29.866809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:29.866809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:29.866809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:29.866809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:29.866809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:29.866809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:29.866809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:29.866809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:29.866809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:29.866809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:29.866809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:29.866809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:29.866809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:29.866809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:29.868262 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:04:29.868262 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:04:29.868262 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:04:29.868262 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:04:29.868262 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:04:29.868262 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:04:29.868262 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:29.868262 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:29.868262 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 268/524] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:29.868745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ae8b2-21ca-4fcb-ba3d-ad509b45ed41 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:29.962494 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b943b-0be5-4806-846c-9a255ff1fb5e None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:29.978361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ae8b2-21ca-4fcb-ba3d-ad509b45ed41 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:29.998705 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:30.000300 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de788f0c-949e-48c6-9dfd-333c799bb284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:30.001205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de788f0c-949e-48c6-9dfd-333c799bb284 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:30.001521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de788f0c-949e-48c6-9dfd-333c799bb284 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:30.001774 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de788f0c-949e-48c6-9dfd-333c799bb284 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:30.011767 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de788f0c-949e-48c6-9dfd-333c799bb284 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:30.013224 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de788f0c-949e-48c6-9dfd-333c799bb284 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:30.014106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dfe3e-3bcc-4400-be15-002d1bb68930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:30.014981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dfe3e-3bcc-4400-be15-002d1bb68930 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:30.015270 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dfe3e-3bcc-4400-be15-002d1bb68930 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:30.015554 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dfe3e-3bcc-4400-be15-002d1bb68930 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:30.022356 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439dfe3e-3bcc-4400-be15-002d1bb68930 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:30.023838 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439dfe3e-3bcc-4400-be15-002d1bb68930 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:30.029037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-de788f0c-949e-48c6-9dfd-333c799bb284 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 13:04:30.029037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:30.029037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:30.029037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:30.029037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:30.029037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:30.029037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:30.029037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:30.029037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:30.029037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:30.029037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:30.029037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:30.029037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:04:30.029037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:04:30.029037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:04:30.029037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:04:30.030127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:30.030127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:30.030127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:04:30.030127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:30.030127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:04:30.030127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:30.030127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:30.030127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:30.030127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:30.030127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:30.030127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:30.030127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:30.030127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:30.030127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:30.030127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:30.030127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:30.030127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:30.030127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:30.031047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:30.031047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:30.031047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:04:30.031047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:04:30.031047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:04:30.031047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:04:30.031047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:04:30.031047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:04:30.031047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 13:04:30.031047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:30.031553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 257/525] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Jul 12 13:04:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:30.032245 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de788f0c-949e-48c6-9dfd-333c799bb284 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:30.035034 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:30.044926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-439dfe3e-3bcc-4400-be15-002d1bb68930 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:30.044926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:30.044926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:30.044926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:30.044926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:30.044926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:30.044926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:30.044926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:30.044926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:30.044926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:30.044926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:30.044926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:30.044926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:04:30.044926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:04:30.044926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:04:30.045835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:04:30.045835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:30.045835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:30.045835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:30.045835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:30.045835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:30.045835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:30.045835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:30.045835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:30.045835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:30.045835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:30.045835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:30.045835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:30.045835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:30.045835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:30.045835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:30.045835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:30.047106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:04:30.047106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:04:30.047106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:04:30.047106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:04:30.047106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:04:30.047106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:04:30.047106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:30.047106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:30.047106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 269/526] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:30.047106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dfe3e-3bcc-4400-be15-002d1bb68930 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:30.158249 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de788f0c-949e-48c6-9dfd-333c799bb284 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:30.163769 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dfe3e-3bcc-4400-be15-002d1bb68930 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:30.196359 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e17eb-0dbe-432d-8b18-b400296a09d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:30.197429 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e17eb-0dbe-432d-8b18-b400296a09d1 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:30.197972 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e17eb-0dbe-432d-8b18-b400296a09d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:30.198307 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e17eb-0dbe-432d-8b18-b400296a09d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:30.199032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e17eb-0dbe-432d-8b18-b400296a09d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:30.199376 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e17eb-0dbe-432d-8b18-b400296a09d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:30.200719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e17eb-0dbe-432d-8b18-b400296a09d1 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:30.201717 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06beea4f-b25b-4cf6-8614-0262597666b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:30.202418 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06beea4f-b25b-4cf6-8614-0262597666b5 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:30.202702 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06beea4f-b25b-4cf6-8614-0262597666b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:30.202978 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06beea4f-b25b-4cf6-8614-0262597666b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:30.203765 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06beea4f-b25b-4cf6-8614-0262597666b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:30.204076 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06beea4f-b25b-4cf6-8614-0262597666b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:30.205526 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06beea4f-b25b-4cf6-8614-0262597666b5 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:30.218596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 258/527] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:30.218596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e17eb-0dbe-432d-8b18-b400296a09d1 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:30.224329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 270/528] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:04:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:30.229749 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06beea4f-b25b-4cf6-8614-0262597666b5 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:30.273960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:30.292028 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:30.335397 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e17eb-0dbe-432d-8b18-b400296a09d1 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:30.339772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06beea4f-b25b-4cf6-8614-0262597666b5 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:30.375373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5f5d8-5363-48cf-ab88-21df86846697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:30.376060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5f5d8-5363-48cf-ab88-21df86846697 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:30.376349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5f5d8-5363-48cf-ab88-21df86846697 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:30.376628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5f5d8-5363-48cf-ab88-21df86846697 None admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:30.376917 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af7197-dbee-45f3-a708-530e4a6fc544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:30.377479 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5f5d8-5363-48cf-ab88-21df86846697 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:30.377657 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af7197-dbee-45f3-a708-530e4a6fc544 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:30.377814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5f5d8-5363-48cf-ab88-21df86846697 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:30.377904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af7197-dbee-45f3-a708-530e4a6fc544 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:30.378209 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af7197-dbee-45f3-a708-530e4a6fc544 None admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:30.378999 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af7197-dbee-45f3-a708-530e4a6fc544 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:30.379262 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5f5d8-5363-48cf-ab88-21df86846697 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:30.379356 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af7197-dbee-45f3-a708-530e4a6fc544 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:30.380737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af7197-dbee-45f3-a708-530e4a6fc544 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:30.397840 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 271/529] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:04:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:30.397840 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af7197-dbee-45f3-a708-530e4a6fc544 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:30.425177 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 259/530] 10.222.0.17 () {56 vars in 1139 bytes} [Tue Jul 12 13:04:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:30.425177 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5f5d8-5363-48cf-ab88-21df86846697 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:30.518009 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:30.521476 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af7197-dbee-45f3-a708-530e4a6fc544 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:30.543051 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5f5d8-5363-48cf-ab88-21df86846697 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:30.561024 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266e1f7-6358-4ff1-8f4e-8a0548a63faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:30.562104 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266e1f7-6358-4ff1-8f4e-8a0548a63faf None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:30.562423 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266e1f7-6358-4ff1-8f4e-8a0548a63faf None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:30.562703 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266e1f7-6358-4ff1-8f4e-8a0548a63faf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:30.565515 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:30.570245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266e1f7-6358-4ff1-8f4e-8a0548a63faf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:30.571747 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266e1f7-6358-4ff1-8f4e-8a0548a63faf None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:30.584154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d919c-c1c6-472b-926c-f529c51d88ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:30.584868 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d919c-c1c6-472b-926c-f529c51d88ad None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:30.585163 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d919c-c1c6-472b-926c-f529c51d88ad None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:30.585447 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d919c-c1c6-472b-926c-f529c51d88ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:30.586851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d919c-c1c6-472b-926c-f529c51d88ad None admin] RBAC: Adding query filter params (role.id=88426002bf1b40c0b59071eaaba38530, scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2, user.id=e8b89afc60864451ba7b5a0a6d190628) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:30.587169 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d919c-c1c6-472b-926c-f529c51d88ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:30.588473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-d266e1f7-6358-4ff1-8f4e-8a0548a63faf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:30.588473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:30.588473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:30.588473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:30.588473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:30.588473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:30.588473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:30.588473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:30.588473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:30.588473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:30.588473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:30.588473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:30.588473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:04:30.588473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:04:30.588473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:04:30.589778 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:04:30.589778 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:30.589778 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:30.589778 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:30.589778 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:30.589778 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:30.589778 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:30.589778 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:30.589778 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:30.589778 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:30.589778 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:30.589778 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:30.589778 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:30.589778 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:30.589778 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:30.589778 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:30.589778 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:30.591801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:04:30.591801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:04:30.591801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:04:30.591801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:04:30.591801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:04:30.591801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:04:30.591801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:30.591801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:30.592519 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d919c-c1c6-472b-926c-f529c51d88ad None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:30.592644 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 272/531] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:30.592644 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266e1f7-6358-4ff1-8f4e-8a0548a63faf None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:30.606497 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 260/532] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:04:30 2022] GET /identity/v3/role_assignments?user.id=e8b89afc60864451ba7b5a0a6d190628&scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2&role.id=88426002bf1b40c0b59071eaaba38530 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:30.607381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d919c-c1c6-472b-926c-f529c51d88ad None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:30.754566 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266e1f7-6358-4ff1-8f4e-8a0548a63faf None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:30.760201 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d919c-c1c6-472b-926c-f529c51d88ad None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:30.798874 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2556e-7040-4143-98e1-89d64092bccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:30.799619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2556e-7040-4143-98e1-89d64092bccb None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:30.800007 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2556e-7040-4143-98e1-89d64092bccb None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:30.800287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2556e-7040-4143-98e1-89d64092bccb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:30.808425 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe917cc-7330-4184-913e-fb646c87af27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:30.809161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe917cc-7330-4184-913e-fb646c87af27 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:30.809451 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe917cc-7330-4184-913e-fb646c87af27 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:30.809731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe917cc-7330-4184-913e-fb646c87af27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:30.810606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe917cc-7330-4184-913e-fb646c87af27 None admin] RBAC: Adding query filter params (role.id=88426002bf1b40c0b59071eaaba38530, scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2, user.id=e52dfce1b06346bfbde6ee33e7f6f249) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:30.810920 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe917cc-7330-4184-913e-fb646c87af27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:30.812897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe917cc-7330-4184-913e-fb646c87af27 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:30.821811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 273/533] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:04:30 2022] GET /identity/v3/role_assignments?user.id=e52dfce1b06346bfbde6ee33e7f6f249&scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2&role.id=88426002bf1b40c0b59071eaaba38530 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:30.822805 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe917cc-7330-4184-913e-fb646c87af27 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:30.886710 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:30.910530 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:30.951835 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2556e-7040-4143-98e1-89d64092bccb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:30.953413 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2556e-7040-4143-98e1-89d64092bccb None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:31.039906 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe917cc-7330-4184-913e-fb646c87af27 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:31.080712 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10040380-904c-4e7a-9fbc-27336674e551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:31.081393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10040380-904c-4e7a-9fbc-27336674e551 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:31.081683 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10040380-904c-4e7a-9fbc-27336674e551 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:31.081969 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10040380-904c-4e7a-9fbc-27336674e551 None admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:31.082800 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10040380-904c-4e7a-9fbc-27336674e551 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:31.083630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10040380-904c-4e7a-9fbc-27336674e551 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:31.085168 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10040380-904c-4e7a-9fbc-27336674e551 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:31.106159 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 274/534] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:04:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:31.107340 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10040380-904c-4e7a-9fbc-27336674e551 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:31.149974 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 261/535] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:04:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:04:31.155875 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2556e-7040-4143-98e1-89d64092bccb None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:31.259573 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:31.291843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2556e-7040-4143-98e1-89d64092bccb None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:31.338812 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7a5ad-e249-48ad-b1af-1b89ba1470ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:31.339992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7a5ad-e249-48ad-b1af-1b89ba1470ac None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:31.340279 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7a5ad-e249-48ad-b1af-1b89ba1470ac None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:31.340557 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7a5ad-e249-48ad-b1af-1b89ba1470ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:31.352169 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7a5ad-e249-48ad-b1af-1b89ba1470ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:31.352726 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:31.353657 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7a5ad-e249-48ad-b1af-1b89ba1470ac None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:31.359065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10040380-904c-4e7a-9fbc-27336674e551 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:31.375670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-ebb7a5ad-e249-48ad-b1af-1b89ba1470ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:31.375670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:31.375670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:31.375670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:31.375670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:31.375670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:31.375670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:31.375670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:31.375670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:31.375670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:31.375670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:31.375670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:31.375670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:31.375670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:31.375670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:31.376605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:31.376605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:31.376605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:31.376605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:31.376605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:31.376605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:31.376605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:31.376605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:31.376605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:31.376605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:31.376605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:31.376605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:31.376605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:31.376605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:31.376605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:31.376605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:31.376605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:31.377462 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:31.377462 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:31.377462 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:31.377462 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:31.377462 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 262/536] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:31.382592 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd09b3e-3bbd-4864-89bd-f44a322cc140 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:31.382592 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd09b3e-3bbd-4864-89bd-f44a322cc140 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:31.382592 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd09b3e-3bbd-4864-89bd-f44a322cc140 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:31.385350 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 263/537] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:31.386545 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd09b3e-3bbd-4864-89bd-f44a322cc140 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:31.423574 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35abc4-ae13-4214-a820-4468cde96612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:31.424256 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35abc4-ae13-4214-a820-4468cde96612 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:31.424546 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35abc4-ae13-4214-a820-4468cde96612 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:31.424831 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35abc4-ae13-4214-a820-4468cde96612 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:31.425681 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35abc4-ae13-4214-a820-4468cde96612 None admin] RBAC: Adding query filter params (role.id=88426002bf1b40c0b59071eaaba38530, scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2, user.id=f7af0259f7f24dfdafbdfc1f613ebb42) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:31.426000 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35abc4-ae13-4214-a820-4468cde96612 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:31.427517 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35abc4-ae13-4214-a820-4468cde96612 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:31.436520 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 275/538] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:04:31 2022] GET /identity/v3/role_assignments?user.id=f7af0259f7f24dfdafbdfc1f613ebb42&scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2&role.id=88426002bf1b40c0b59071eaaba38530 => generated 259 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:31.437876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec35cf7-a279-4f2b-8ad0-10b829ec6dd4 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:31.438199 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec35cf7-a279-4f2b-8ad0-10b829ec6dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:31.438488 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec35cf7-a279-4f2b-8ad0-10b829ec6dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:31.456400 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-eec35cf7-a279-4f2b-8ad0-10b829ec6dd4 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:31.457624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-eec35cf7-a279-4f2b-8ad0-10b829ec6dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:31.529761 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd09b3e-3bbd-4864-89bd-f44a322cc140 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:31.591765 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55506ecd-9eb7-4704-b3c7-0081eeaf4ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:31.592458 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55506ecd-9eb7-4704-b3c7-0081eeaf4ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:31.592849 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55506ecd-9eb7-4704-b3c7-0081eeaf4ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:31.593299 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55506ecd-9eb7-4704-b3c7-0081eeaf4ca4 None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:31.594617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55506ecd-9eb7-4704-b3c7-0081eeaf4ca4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:31.595096 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55506ecd-9eb7-4704-b3c7-0081eeaf4ca4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:31.597361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55506ecd-9eb7-4704-b3c7-0081eeaf4ca4 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:31.601918 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:31.622605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 264/539] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:31.626080 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55506ecd-9eb7-4704-b3c7-0081eeaf4ca4 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:31.661299 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 276/540] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:31.691083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec35cf7-a279-4f2b-8ad0-10b829ec6dd4 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:31.747759 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55506ecd-9eb7-4704-b3c7-0081eeaf4ca4 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:31.785223 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6715691-05af-4043-900a-686be1b6298f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:31.785968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6715691-05af-4043-900a-686be1b6298f None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:31.786295 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6715691-05af-4043-900a-686be1b6298f None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:31.786699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6715691-05af-4043-900a-686be1b6298f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:31.794833 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6715691-05af-4043-900a-686be1b6298f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:31.796441 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6715691-05af-4043-900a-686be1b6298f None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:31.813009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-b6715691-05af-4043-900a-686be1b6298f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:31.813009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:31.813009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:31.813009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:31.813009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:31.813009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:31.813009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:31.813009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:31.813009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:31.813009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:31.813009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:31.813009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:31.813009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:04:31.813009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:04:31.813009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:04:31.814099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:04:31.814099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:31.814099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:31.814099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:31.814099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:31.814099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:31.814099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:31.814099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:31.814099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:31.814099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:31.814099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:31.814099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:31.814099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:31.814099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:31.814099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:31.814099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:31.814099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:31.815196 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:04:31.815196 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:04:31.815196 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:04:31.815196 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:04:31.815196 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:04:31.815196 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:04:31.815196 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:31.815196 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:31.815196 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 265/541] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:04:31.825255 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6715691-05af-4043-900a-686be1b6298f None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:31.867798 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:31.899179 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:31.943361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6715691-05af-4043-900a-686be1b6298f None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:31.944272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec35cf7-a279-4f2b-8ad0-10b829ec6dd4 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:32.020979 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878aaae-3a93-45ba-8055-f4b7b19a1e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:32.022215 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878aaae-3a93-45ba-8055-f4b7b19a1e43 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:32.022648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878aaae-3a93-45ba-8055-f4b7b19a1e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:32.023063 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878aaae-3a93-45ba-8055-f4b7b19a1e43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:32.034862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe6841-c34d-4837-a26a-0bbc62380f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:32.035908 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe6841-c34d-4837-a26a-0bbc62380f18 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:32.036281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe6841-c34d-4837-a26a-0bbc62380f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:32.036702 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe6841-c34d-4837-a26a-0bbc62380f18 None admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:32.037946 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe6841-c34d-4837-a26a-0bbc62380f18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:32.038511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe6841-c34d-4837-a26a-0bbc62380f18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:32.040315 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe6841-c34d-4837-a26a-0bbc62380f18 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:32.053587 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878aaae-3a93-45ba-8055-f4b7b19a1e43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:32.062338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-5878aaae-3a93-45ba-8055-f4b7b19a1e43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:32.062338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:32.062338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:32.062338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:32.062338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:32.062338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:32.062338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:32.062338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:32.062338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:32.062338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:32.062338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:32.062338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:32.062338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:32.062338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:32.062338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:32.062338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:32.063290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:32.063290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:32.063290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:32.063290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:32.063290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:32.063290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:32.063290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:32.063290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:32.063290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:32.063290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:32.063290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:32.063290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:32.063290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:32.063290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:32.063290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:32.063290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:32.064087 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:32.064087 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:32.064087 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:32.064087 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:32.064087 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:32.064087 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:32.064087 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:32.064087 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:32.064087 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:32.064087 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:32.064087 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:32.064087 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:32.064087 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 277/542] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Jul 12 13:04:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:32.069871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878aaae-3a93-45ba-8055-f4b7b19a1e43 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:32.079995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 266/543] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:04:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:04:32.087310 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe6841-c34d-4837-a26a-0bbc62380f18 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:32.198163 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878aaae-3a93-45ba-8055-f4b7b19a1e43 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:32.233999 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e853013-4284-44bb-ae6f-d60e352f2c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:32.234716 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e853013-4284-44bb-ae6f-d60e352f2c86 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:32.234999 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e853013-4284-44bb-ae6f-d60e352f2c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:32.235273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e853013-4284-44bb-ae6f-d60e352f2c86 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:32.236022 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e853013-4284-44bb-ae6f-d60e352f2c86 None admin] RBAC: Adding query filter params (name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:32.236326 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e853013-4284-44bb-ae6f-d60e352f2c86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:32.237709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e853013-4284-44bb-ae6f-d60e352f2c86 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:32.246660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 278/544] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Jul 12 13:04:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:32.246982 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:32.253206 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e853013-4284-44bb-ae6f-d60e352f2c86 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:32.339427 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe6841-c34d-4837-a26a-0bbc62380f18 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:32.378531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:32.408850 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa508d93-c778-4c42-9d59-64276cd15332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:32.409522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa508d93-c778-4c42-9d59-64276cd15332 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:32.409812 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa508d93-c778-4c42-9d59-64276cd15332 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:32.410089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa508d93-c778-4c42-9d59-64276cd15332 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:32.410958 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa508d93-c778-4c42-9d59-64276cd15332 None admin] RBAC: Adding query filter params (role.id=88426002bf1b40c0b59071eaaba38530, scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2, user.id=0f39694be5f447f9a25dacf7e4c99a4d) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:32.411276 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa508d93-c778-4c42-9d59-64276cd15332 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:32.412740 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa508d93-c778-4c42-9d59-64276cd15332 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:32.428714 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 267/545] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:04:32 2022] GET /identity/v3/role_assignments?user.id=0f39694be5f447f9a25dacf7e4c99a4d&scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2&role.id=88426002bf1b40c0b59071eaaba38530 => generated 259 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:32.470777 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e853013-4284-44bb-ae6f-d60e352f2c86 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:32.522470 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfda71-95a7-47b9-b180-47744d013bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:32.523331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfda71-95a7-47b9-b180-47744d013bab None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:32.523619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfda71-95a7-47b9-b180-47744d013bab None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:32.523892 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfda71-95a7-47b9-b180-47744d013bab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:32.547354 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edfda71-95a7-47b9-b180-47744d013bab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:32.548851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edfda71-95a7-47b9-b180-47744d013bab None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:32.572452 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-6edfda71-95a7-47b9-b180-47744d013bab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:32.572452 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:32.572452 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:32.572452 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:32.572452 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:32.572452 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:32.572452 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:32.572452 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:32.572452 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:32.572452 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:32.572452 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:32.572452 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:32.572452 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:32.572452 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:32.572452 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:32.573572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:32.573572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:32.573572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:32.573572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:32.573572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:32.573572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:32.573572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:32.573572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:32.573572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:32.573572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:32.573572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:32.573572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:32.573572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:32.573572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:32.573572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:32.573572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:32.573572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:32.574641 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:32.574641 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:32.574641 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:32.574641 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:32.574641 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 279/546] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:32.579565 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa508d93-c778-4c42-9d59-64276cd15332 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:32.726935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa508d93-c778-4c42-9d59-64276cd15332 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:32.774217 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb07045-56d5-436a-b440-f5b33f22427e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:32.774899 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb07045-56d5-436a-b440-f5b33f22427e None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:32.775189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb07045-56d5-436a-b440-f5b33f22427e None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:32.775470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb07045-56d5-436a-b440-f5b33f22427e None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:32.776202 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb07045-56d5-436a-b440-f5b33f22427e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:32.776512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb07045-56d5-436a-b440-f5b33f22427e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:32.777895 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb07045-56d5-436a-b440-f5b33f22427e None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:32.792275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 268/547] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:32.803241 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfda71-95a7-47b9-b180-47744d013bab None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:32.902657 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:32.939707 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f67785-bd07-40af-b6f4-f0bb209f29dd None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:32.939993 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f67785-bd07-40af-b6f4-f0bb209f29dd None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:32.940189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f67785-bd07-40af-b6f4-f0bb209f29dd None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:32.941806 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 269/548] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:32.948659 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c91266-de37-4607-896a-9891ca986968 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:32.948952 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c91266-de37-4607-896a-9891ca986968 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:32.949238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c91266-de37-4607-896a-9891ca986968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:32.970030 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-23c91266-de37-4607-896a-9891ca986968 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:32.973406 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-23c91266-de37-4607-896a-9891ca986968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:33.017186 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:33.029150 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfda71-95a7-47b9-b180-47744d013bab None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:33.079983 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6accc-556a-42e3-af3b-b8b4cf5828be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:33.080802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6accc-556a-42e3-af3b-b8b4cf5828be None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:33.081089 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6accc-556a-42e3-af3b-b8b4cf5828be None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:33.081364 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6accc-556a-42e3-af3b-b8b4cf5828be None admin] PATH_INFO: `/v3/users/swift` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:33.095111 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 270/549] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:04:33.100451 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6accc-556a-42e3-af3b-b8b4cf5828be None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:33.102592 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6accc-556a-42e3-af3b-b8b4cf5828be None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:33.120932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-65f6accc-556a-42e3-af3b-b8b4cf5828be None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 13:04:33.120932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:33.120932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:33.120932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:33.120932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:33.120932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:33.120932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:33.120932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:33.120932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:33.120932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:33.120932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:33.120932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:33.120932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:04:33.120932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:04:33.120932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:04:33.120932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:04:33.122427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:33.122427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:33.122427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:04:33.122427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:33.122427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:04:33.122427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:33.122427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:33.122427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:33.122427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:33.122427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:33.122427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:33.122427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:33.122427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:33.122427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:33.122427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:33.122427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:33.122427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:33.122427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:33.123478 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:33.123478 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:33.123478 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:04:33.123478 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:04:33.123478 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:04:33.123478 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:04:33.123478 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:04:33.123478 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:04:33.123478 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 13:04:33.123478 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:33.126572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 280/550] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:04:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:33.131957 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c91266-de37-4607-896a-9891ca986968 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:33.150389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6accc-556a-42e3-af3b-b8b4cf5828be None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:33.268230 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c91266-de37-4607-896a-9891ca986968 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:33.279908 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6accc-556a-42e3-af3b-b8b4cf5828be None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:33.293877 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:33.304160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a86797-5cc2-4d84-bed0-b3e32b874777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:33.305396 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a86797-5cc2-4d84-bed0-b3e32b874777 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:33.305691 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a86797-5cc2-4d84-bed0-b3e32b874777 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:33.305974 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a86797-5cc2-4d84-bed0-b3e32b874777 None admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:33.306859 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a86797-5cc2-4d84-bed0-b3e32b874777 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:33.307176 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a86797-5cc2-4d84-bed0-b3e32b874777 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:33.308636 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a86797-5cc2-4d84-bed0-b3e32b874777 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:33.323046 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45764fe8-449e-45f8-b420-295caa52a91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:33.324421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45764fe8-449e-45f8-b420-295caa52a91e None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:33.324887 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45764fe8-449e-45f8-b420-295caa52a91e None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:33.325174 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45764fe8-449e-45f8-b420-295caa52a91e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:33.328081 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 271/551] 10.222.0.17 () {56 vars in 1135 bytes} [Tue Jul 12 13:04:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:33.329501 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7760a-0901-4f1e-be27-0c7c1f45c0d7 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:33.329796 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7760a-0901-4f1e-be27-0c7c1f45c0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:33.330072 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7760a-0901-4f1e-be27-0c7c1f45c0d7 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:33.331604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 272/552] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:33.333456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7760a-0901-4f1e-be27-0c7c1f45c0d7 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:33.341853 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45764fe8-449e-45f8-b420-295caa52a91e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:33.349754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-45764fe8-449e-45f8-b420-295caa52a91e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:33.349754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:33.349754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:33.349754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:33.349754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:33.349754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:33.349754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:33.349754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:33.349754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:33.349754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:33.349754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:33.349754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:33.349754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:33.349754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:33.349754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:33.349754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:33.350821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:33.350821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:33.350821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:33.350821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:33.350821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:33.350821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:33.350821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:33.350821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:33.350821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:33.350821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:33.350821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:33.350821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:33.350821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:33.350821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:33.350821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:33.350821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:33.352277 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:33.352277 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:33.352277 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:33.352277 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:33.352277 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:33.352277 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:33.352277 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:33.352277 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:33.352277 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:33.352277 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:33.352277 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:33.352277 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:33.356472 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 281/553] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Jul 12 13:04:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:33.358037 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706b555-6ad7-4e8f-8a33-ce4aa61a34f4 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:33.358355 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706b555-6ad7-4e8f-8a33-ce4aa61a34f4 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:33.358633 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706b555-6ad7-4e8f-8a33-ce4aa61a34f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:33.368682 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:33.377837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-8706b555-6ad7-4e8f-8a33-ce4aa61a34f4 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:33.379076 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-8706b555-6ad7-4e8f-8a33-ce4aa61a34f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:33.455123 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 282/554] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:33.456042 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706b555-6ad7-4e8f-8a33-ce4aa61a34f4 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:33.456153 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7760a-0901-4f1e-be27-0c7c1f45c0d7 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:33.503672 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6c57f-1d60-4d2b-8d0a-d47d6670223f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:33.504332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6c57f-1d60-4d2b-8d0a-d47d6670223f None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:33.504616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6c57f-1d60-4d2b-8d0a-d47d6670223f None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:33.504890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6c57f-1d60-4d2b-8d0a-d47d6670223f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:33.587445 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6c57f-1d60-4d2b-8d0a-d47d6670223f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:33.588851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6c57f-1d60-4d2b-8d0a-d47d6670223f None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:33.597930 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706b555-6ad7-4e8f-8a33-ce4aa61a34f4 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:33.600138 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:33.623997 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:33.649166 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413506b-8ade-4e17-8cc8-aab445b0ea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:33.650397 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413506b-8ade-4e17-8cc8-aab445b0ea0e None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:33.651257 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413506b-8ade-4e17-8cc8-aab445b0ea0e None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:33.651690 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413506b-8ade-4e17-8cc8-aab445b0ea0e None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:33.652603 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413506b-8ade-4e17-8cc8-aab445b0ea0e None admin] RBAC: Adding query filter params (name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:33.653062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413506b-8ade-4e17-8cc8-aab445b0ea0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:33.655332 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413506b-8ade-4e17-8cc8-aab445b0ea0e None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:33.668478 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 283/555] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Jul 12 13:04:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:33.669636 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413506b-8ade-4e17-8cc8-aab445b0ea0e None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:33.719922 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 273/556] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:04:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:04:33.720993 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6c57f-1d60-4d2b-8d0a-d47d6670223f None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:33.799761 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413506b-8ade-4e17-8cc8-aab445b0ea0e None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:33.847523 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353e2b1-28ec-4ecd-9802-64c24916df87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:33.848285 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353e2b1-28ec-4ecd-9802-64c24916df87 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:33.848577 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353e2b1-28ec-4ecd-9802-64c24916df87 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:33.848860 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353e2b1-28ec-4ecd-9802-64c24916df87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:33.854776 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6c57f-1d60-4d2b-8d0a-d47d6670223f None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:33.867529 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353e2b1-28ec-4ecd-9802-64c24916df87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:33.877745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-f353e2b1-28ec-4ecd-9802-64c24916df87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:33.877745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:33.877745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:33.877745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:33.877745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:33.877745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:33.877745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:33.877745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:33.877745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:33.877745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:33.877745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:33.877745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:33.877745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:33.877745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:33.877745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:33.877745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:33.878724 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:33.878724 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:33.878724 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:33.878724 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:33.878724 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:33.878724 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:33.878724 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:33.878724 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:33.878724 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:33.878724 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:33.878724 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:33.878724 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:33.878724 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:33.878724 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:33.878724 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:33.878724 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:33.879537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:33.879537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:33.879537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:33.879537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:33.879537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:33.879537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:33.879537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:33.879537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:33.879537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:33.879537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:33.879537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:33.879537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:33.882187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 284/557] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Jul 12 13:04:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:33.883775 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353e2b1-28ec-4ecd-9802-64c24916df87 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:33.893589 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:33.905886 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7fee3-ca99-47fa-9527-fb8c87febcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:33.907018 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7fee3-ca99-47fa-9527-fb8c87febcbb None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:33.907303 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7fee3-ca99-47fa-9527-fb8c87febcbb None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:33.907580 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7fee3-ca99-47fa-9527-fb8c87febcbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:33.916023 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:33.923503 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a7fee3-ca99-47fa-9527-fb8c87febcbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:33.925719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a7fee3-ca99-47fa-9527-fb8c87febcbb None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:33.949906 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-e3a7fee3-ca99-47fa-9527-fb8c87febcbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:33.949906 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:33.949906 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:33.949906 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:33.949906 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:33.949906 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:33.949906 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:33.949906 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:33.949906 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:33.949906 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:33.949906 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:33.949906 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:33.949906 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:33.949906 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:33.949906 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:33.951366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:33.951366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:33.951366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:33.951366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:33.951366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:33.951366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:33.951366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:33.951366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:33.951366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:33.951366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:33.951366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:33.951366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:33.951366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:33.951366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:33.951366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:33.951366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:33.951366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:33.952792 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:33.952792 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:33.952792 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:33.952792 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:33.952792 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 274/558] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:33.953079 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7fee3-ca99-47fa-9527-fb8c87febcbb None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:34.005613 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353e2b1-28ec-4ecd-9802-64c24916df87 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:34.061803 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fffab-ade2-495c-93d6-7bc798e52e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:34.063189 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fffab-ade2-495c-93d6-7bc798e52e45 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:34.063372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7fee3-ca99-47fa-9527-fb8c87febcbb None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:34.063702 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fffab-ade2-495c-93d6-7bc798e52e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:34.064188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fffab-ade2-495c-93d6-7bc798e52e45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:34.081603 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86fffab-ade2-495c-93d6-7bc798e52e45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:34.084764 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86fffab-ade2-495c-93d6-7bc798e52e45 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:34.099337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec67a0-e344-4ce3-bb69-e047badcac21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:34.100001 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec67a0-e344-4ce3-bb69-e047badcac21 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:34.100284 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec67a0-e344-4ce3-bb69-e047badcac21 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:34.100597 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec67a0-e344-4ce3-bb69-e047badcac21 None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:34.101376 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec67a0-e344-4ce3-bb69-e047badcac21 None admin] RBAC: Adding query filter params (name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:34.101834 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec67a0-e344-4ce3-bb69-e047badcac21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:34.103508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-f86fffab-ade2-495c-93d6-7bc798e52e45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:34.103508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:34.103508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:34.103508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:34.103508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:34.103508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:34.103508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:34.103508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:34.103508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:34.103508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:34.103508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:34.103508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:34.103508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:34.103508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:34.103508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:34.104446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:34.104446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:34.104446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:34.104446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:34.104446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:34.104446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:34.104446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:34.104446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:34.104446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:34.104446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:34.104446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:34.104446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:34.104446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:34.104446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:34.104446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:34.104446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:34.104446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:34.105341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:34.105341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:34.105341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:34.105341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:34.105574 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec67a0-e344-4ce3-bb69-e047badcac21 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:34.109323 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 285/559] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:34.110524 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5c51d-9a96-4cef-8eee-8b0b31d8187a None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:34.110816 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5c51d-9a96-4cef-8eee-8b0b31d8187a None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:34.111101 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5c51d-9a96-4cef-8eee-8b0b31d8187a None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:34.112693 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 286/560] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:34.113415 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5c51d-9a96-4cef-8eee-8b0b31d8187a None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:34.119625 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 275/561] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Jul 12 13:04:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:34.119625 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec67a0-e344-4ce3-bb69-e047badcac21 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:34.171266 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:34.206088 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:34.231616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec67a0-e344-4ce3-bb69-e047badcac21 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:34.234689 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5c51d-9a96-4cef-8eee-8b0b31d8187a None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:34.267024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ff664-a75d-4203-b091-e5344fb44bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:34.267705 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ff664-a75d-4203-b091-e5344fb44bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:34.267994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ff664-a75d-4203-b091-e5344fb44bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:34.268306 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ff664-a75d-4203-b091-e5344fb44bf9 None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:34.269039 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ff664-a75d-4203-b091-e5344fb44bf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:34.269357 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ff664-a75d-4203-b091-e5344fb44bf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:34.270792 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ff664-a75d-4203-b091-e5344fb44bf9 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:34.273951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840f9e6-6077-447f-9799-b30aa18bd8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:34.274677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840f9e6-6077-447f-9799-b30aa18bd8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:34.274962 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840f9e6-6077-447f-9799-b30aa18bd8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:34.275239 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840f9e6-6077-447f-9799-b30aa18bd8f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:34.275966 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840f9e6-6077-447f-9799-b30aa18bd8f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:34.276277 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840f9e6-6077-447f-9799-b30aa18bd8f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:34.277662 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840f9e6-6077-447f-9799-b30aa18bd8f3 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:34.288159 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 276/562] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:34.288159 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0c33b-9d69-4ccf-9ceb-c38b0bb65d07 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:34.288159 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0c33b-9d69-4ccf-9ceb-c38b0bb65d07 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:34.288159 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0c33b-9d69-4ccf-9ceb-c38b0bb65d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:34.300462 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 287/563] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:34.300462 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840f9e6-6077-447f-9799-b30aa18bd8f3 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:34.307511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-f3d0c33b-9d69-4ccf-9ceb-c38b0bb65d07 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:34.308805 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-f3d0c33b-9d69-4ccf-9ceb-c38b0bb65d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:34.386230 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 277/564] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:34.386230 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0c33b-9d69-4ccf-9ceb-c38b0bb65d07 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:34.416367 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840f9e6-6077-447f-9799-b30aa18bd8f3 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:34.423832 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:34.453571 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95e9cc-a544-4b75-aadf-afecf5312d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:34.454417 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95e9cc-a544-4b75-aadf-afecf5312d6f None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:34.454721 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95e9cc-a544-4b75-aadf-afecf5312d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:34.454973 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95e9cc-a544-4b75-aadf-afecf5312d6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:34.458272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:34.467704 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95e9cc-a544-4b75-aadf-afecf5312d6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:34.469482 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95e9cc-a544-4b75-aadf-afecf5312d6f None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:34.488917 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-db95e9cc-a544-4b75-aadf-afecf5312d6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:34.488917 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:34.488917 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:34.488917 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:34.488917 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:34.488917 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:34.488917 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:34.488917 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:34.488917 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:34.488917 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:34.488917 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:34.488917 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:34.488917 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:34.488917 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:34.488917 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:34.489896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:34.489896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:34.489896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:34.489896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:34.489896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:34.489896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:34.489896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:34.489896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:34.489896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:34.489896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:34.489896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:34.489896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:34.489896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:34.489896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:34.489896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:34.489896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:34.489896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:34.490843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:34.490843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:34.490843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:34.490843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:34.490843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 288/565] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:34.491116 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95e9cc-a544-4b75-aadf-afecf5312d6f None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:34.503593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0c33b-9d69-4ccf-9ceb-c38b0bb65d07 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:34.540604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836a057-3851-42f3-ad7f-abe00a1d9995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:34.541870 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836a057-3851-42f3-ad7f-abe00a1d9995 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:34.541870 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836a057-3851-42f3-ad7f-abe00a1d9995 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:34.542078 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836a057-3851-42f3-ad7f-abe00a1d9995 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:34.549119 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836a057-3851-42f3-ad7f-abe00a1d9995 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:34.550613 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836a057-3851-42f3-ad7f-abe00a1d9995 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:34.564647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-4836a057-3851-42f3-ad7f-abe00a1d9995 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:34.564647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:34.564647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:34.564647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:34.564647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:34.564647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:34.564647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:34.564647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:34.564647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:34.564647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:34.564647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:34.564647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:34.564647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:04:34.564647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:04:34.564647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:04:34.565593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:04:34.565593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:34.565593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:34.565593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:34.565593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:34.565593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:34.565593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:34.565593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:34.565593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:34.565593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:34.565593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:34.565593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:34.565593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:34.565593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:34.565593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:34.565593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:34.565593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:34.567026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:04:34.567026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:04:34.567026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:04:34.567026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:04:34.567026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:04:34.567026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:04:34.567026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:34.567026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:34.567026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 278/566] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:34.567026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836a057-3851-42f3-ad7f-abe00a1d9995 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:34.630681 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95e9cc-a544-4b75-aadf-afecf5312d6f None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:34.673694 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edb3cc-aadf-427c-9200-c483e33d18cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:34.674473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edb3cc-aadf-427c-9200-c483e33d18cb None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:34.674759 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edb3cc-aadf-427c-9200-c483e33d18cb None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:34.675035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edb3cc-aadf-427c-9200-c483e33d18cb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:34.679879 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:34.683771 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46edb3cc-aadf-427c-9200-c483e33d18cb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:34.684986 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46edb3cc-aadf-427c-9200-c483e33d18cb None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:34.688938 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836a057-3851-42f3-ad7f-abe00a1d9995 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:34.700343 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-46edb3cc-aadf-427c-9200-c483e33d18cb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 13:04:34.700343 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:34.700343 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:34.700343 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:34.700343 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:34.700343 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:34.700343 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:34.700343 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:34.700343 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:34.700343 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:34.700343 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:34.700343 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:34.700343 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:04:34.700343 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:04:34.700343 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:04:34.700343 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:04:34.701351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:34.701351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:34.701351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:04:34.701351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:34.701351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:04:34.701351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:34.701351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:34.701351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:34.701351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:34.701351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:34.701351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:34.701351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:34.701351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:34.701351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:34.701351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:34.701351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:34.701351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:34.701351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:34.702320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:34.702320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:34.702320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:04:34.702320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:04:34.702320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:04:34.702320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:04:34.702320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:04:34.702320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:04:34.702320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 13:04:34.702320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:34.702320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 289/567] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:04:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:34.702917 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edb3cc-aadf-427c-9200-c483e33d18cb None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:34.732052 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b899323-8ab3-42a5-a242-9543dd9240a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:34.732965 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b899323-8ab3-42a5-a242-9543dd9240a3 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:34.733151 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b899323-8ab3-42a5-a242-9543dd9240a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:34.733429 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b899323-8ab3-42a5-a242-9543dd9240a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:34.744439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b899323-8ab3-42a5-a242-9543dd9240a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:34.752264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-3b899323-8ab3-42a5-a242-9543dd9240a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:34.752264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:34.752264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:34.752264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:34.752264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:34.752264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:34.752264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:34.752264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:34.752264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:34.752264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:34.752264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:34.752264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:34.752264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:34.752264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:34.752264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:34.752264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:34.753403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:34.753403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:34.753403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:34.753403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:34.753403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:34.753403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:34.753403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:34.753403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:34.753403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:34.753403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:34.753403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:34.753403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:34.753403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:34.753403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:34.753403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:34.753403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:34.754456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:34.754456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:34.754456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:34.754456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:34.754456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:34.754456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:34.754456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:34.754456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:34.754456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:34.754456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:34.754456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:34.754456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:34.754456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 279/568] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Jul 12 13:04:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:34.754456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b899323-8ab3-42a5-a242-9543dd9240a3 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:34.759646 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:34.810842 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edb3cc-aadf-427c-9200-c483e33d18cb None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:34.844632 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a9842-e5e5-4261-9aca-66d37aa8f933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:34.845305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a9842-e5e5-4261-9aca-66d37aa8f933 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:34.845591 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a9842-e5e5-4261-9aca-66d37aa8f933 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:34.845864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a9842-e5e5-4261-9aca-66d37aa8f933 None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:34.846614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a9842-e5e5-4261-9aca-66d37aa8f933 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:34.846921 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a9842-e5e5-4261-9aca-66d37aa8f933 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:34.848284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a9842-e5e5-4261-9aca-66d37aa8f933 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:34.857502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b899323-8ab3-42a5-a242-9543dd9240a3 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:34.860057 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 290/569] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:34.860877 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a9842-e5e5-4261-9aca-66d37aa8f933 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:34.892143 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6bd65-af81-4848-895d-2768790a5e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:34.892816 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6bd65-af81-4848-895d-2768790a5e2d None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:34.893100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6bd65-af81-4848-895d-2768790a5e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:34.893377 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6bd65-af81-4848-895d-2768790a5e2d None admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:34.894210 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6bd65-af81-4848-895d-2768790a5e2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:34.894529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6bd65-af81-4848-895d-2768790a5e2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:34.895979 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6bd65-af81-4848-895d-2768790a5e2d None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:34.909146 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 280/570] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:04:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:34.910489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e991ff-a278-41b5-bbf2-fada7fccc0be None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:34.910780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e991ff-a278-41b5-bbf2-fada7fccc0be None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:34.911058 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e991ff-a278-41b5-bbf2-fada7fccc0be None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:34.912283 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 281/571] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:34.912965 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e991ff-a278-41b5-bbf2-fada7fccc0be None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:34.927723 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:34.965191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a9842-e5e5-4261-9aca-66d37aa8f933 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:34.974557 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:34.999768 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96a529-6fca-4148-9e5b-30952086d78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:35.000444 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96a529-6fca-4148-9e5b-30952086d78c None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:35.000736 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96a529-6fca-4148-9e5b-30952086d78c None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:35.001011 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96a529-6fca-4148-9e5b-30952086d78c None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:35.001839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96a529-6fca-4148-9e5b-30952086d78c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:35.002173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96a529-6fca-4148-9e5b-30952086d78c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:35.003610 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96a529-6fca-4148-9e5b-30952086d78c None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:35.021859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 291/572] 10.222.0.17 () {56 vars in 1137 bytes} [Tue Jul 12 13:04:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:35.022739 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96a529-6fca-4148-9e5b-30952086d78c None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:35.022975 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e991ff-a278-41b5-bbf2-fada7fccc0be None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:35.059275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f0511-4122-4331-8ef6-09e6894c074e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:35.059946 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f0511-4122-4331-8ef6-09e6894c074e None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:35.060235 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f0511-4122-4331-8ef6-09e6894c074e None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:35.060516 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f0511-4122-4331-8ef6-09e6894c074e None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:35.061262 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f0511-4122-4331-8ef6-09e6894c074e None admin] RBAC: Adding query filter params (name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:35.061573 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f0511-4122-4331-8ef6-09e6894c074e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:35.062988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f0511-4122-4331-8ef6-09e6894c074e None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:35.071725 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 282/573] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Jul 12 13:04:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:35.072985 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424dd8b-a509-4db7-bd74-4c1f8c6d9f82 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:35.073278 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424dd8b-a509-4db7-bd74-4c1f8c6d9f82 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:35.073558 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424dd8b-a509-4db7-bd74-4c1f8c6d9f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:35.089651 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-b424dd8b-a509-4db7-bd74-4c1f8c6d9f82 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:35.090878 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-b424dd8b-a509-4db7-bd74-4c1f8c6d9f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:35.126729 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96a529-6fca-4148-9e5b-30952086d78c None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:35.159054 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 283/574] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:35.159907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424dd8b-a509-4db7-bd74-4c1f8c6d9f82 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:35.166958 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a86f5-8ee7-482c-8226-47a9a6b9ce2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:35.167781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a86f5-8ee7-482c-8226-47a9a6b9ce2b None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:35.168070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a86f5-8ee7-482c-8226-47a9a6b9ce2b None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:35.168348 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a86f5-8ee7-482c-8226-47a9a6b9ce2b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:35.175563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:35.176632 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a86f5-8ee7-482c-8226-47a9a6b9ce2b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:35.178208 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a86f5-8ee7-482c-8226-47a9a6b9ce2b None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:35.194896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-112a86f5-8ee7-482c-8226-47a9a6b9ce2b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:04:35.194896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:35.194896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:35.194896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:35.194896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:35.194896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:35.194896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:35.194896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:35.194896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:35.194896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:35.194896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:35.194896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:35.194896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:04:35.194896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:04:35.194896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:04:35.194896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:04:35.196550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:35.196550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:35.196550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:04:35.196550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:35.196550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:04:35.196550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:35.196550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:35.196550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:35.196550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:35.196550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:35.196550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:35.196550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:35.196550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:35.196550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:35.196550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:35.196550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:35.196550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:35.196550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:35.197553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:35.197553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:35.197553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:04:35.197553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:04:35.197553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:04:35.197553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:04:35.197553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:04:35.197553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:04:35.197553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:04:35.197553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:35.197553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 292/575] 10.222.0.17 () {56 vars in 1093 bytes} [Tue Jul 12 13:04:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:35.198178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a86f5-8ee7-482c-8226-47a9a6b9ce2b None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:35.225682 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:35.278024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424dd8b-a509-4db7-bd74-4c1f8c6d9f82 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:35.300299 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a86f5-8ee7-482c-8226-47a9a6b9ce2b None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:35.312201 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787924f-94d5-4b2b-a39f-1e32bc12cd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:35.312864 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787924f-94d5-4b2b-a39f-1e32bc12cd4d None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:35.313148 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787924f-94d5-4b2b-a39f-1e32bc12cd4d None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:35.313426 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787924f-94d5-4b2b-a39f-1e32bc12cd4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:35.314280 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787924f-94d5-4b2b-a39f-1e32bc12cd4d None admin] RBAC: Adding query filter params (role.id=88426002bf1b40c0b59071eaaba38530, scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2, user.id=fe10f0f42b8247c99ed5f88eff5065e3) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:35.314598 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787924f-94d5-4b2b-a39f-1e32bc12cd4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:35.316022 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787924f-94d5-4b2b-a39f-1e32bc12cd4d None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:35.322005 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 284/576] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:04:35 2022] GET /identity/v3/role_assignments?user.id=fe10f0f42b8247c99ed5f88eff5065e3&scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2&role.id=88426002bf1b40c0b59071eaaba38530 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:35.322852 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787924f-94d5-4b2b-a39f-1e32bc12cd4d None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:35.340628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f61a6-858d-4815-b8b6-14d21c6fef85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:35.341517 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f61a6-858d-4815-b8b6-14d21c6fef85 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:35.341960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f61a6-858d-4815-b8b6-14d21c6fef85 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:35.342556 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f61a6-858d-4815-b8b6-14d21c6fef85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:35.360633 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f61a6-858d-4815-b8b6-14d21c6fef85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:35.362141 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f61a6-858d-4815-b8b6-14d21c6fef85 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:35.383812 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-de5f61a6-858d-4815-b8b6-14d21c6fef85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:35.383812 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:35.383812 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:35.383812 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:35.383812 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:35.383812 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:35.383812 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:35.383812 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:35.383812 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:35.383812 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:35.383812 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:35.383812 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:35.383812 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:35.383812 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:35.383812 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:35.384810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:35.384810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:35.384810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:35.384810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:35.384810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:35.384810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:35.384810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:35.384810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:35.384810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:35.384810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:35.384810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:35.384810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:35.384810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:35.384810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:35.384810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:35.384810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:35.384810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:35.385958 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:35.385958 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:35.385958 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:35.385958 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:35.385958 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 293/577] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:35.387018 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f61a6-858d-4815-b8b6-14d21c6fef85 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:35.416506 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:35.459746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787924f-94d5-4b2b-a39f-1e32bc12cd4d None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:35.484560 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:35.509780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bbdf2-6fb2-4341-8a47-151e620fb494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:35.510632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bbdf2-6fb2-4341-8a47-151e620fb494 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:35.511172 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bbdf2-6fb2-4341-8a47-151e620fb494 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:35.511452 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bbdf2-6fb2-4341-8a47-151e620fb494 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:35.513615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f61a6-858d-4815-b8b6-14d21c6fef85 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:35.523192 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bbdf2-6fb2-4341-8a47-151e620fb494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:35.524681 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bbdf2-6fb2-4341-8a47-151e620fb494 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:35.544365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-4d2bbdf2-6fb2-4341-8a47-151e620fb494 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:35.544365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:35.544365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:35.544365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:35.544365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:35.544365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:35.544365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:35.544365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:35.544365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:35.544365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:35.544365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:35.544365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:35.544365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:35.544365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:35.544365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:35.545344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:35.545344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:35.545344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:35.545344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:35.545344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:35.545344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:35.545344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:35.545344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:35.545344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:35.545344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:35.545344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:35.545344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:35.545344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:35.545344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:35.545344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:35.545344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:35.545344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:35.546315 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:35.546315 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:35.546315 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:35.546315 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:35.546315 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 285/578] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:35.546605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bbdf2-6fb2-4341-8a47-151e620fb494 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:35.552753 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e74811-9cf6-4677-8ec9-a20008861de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:35.553578 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e74811-9cf6-4677-8ec9-a20008861de9 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:35.553862 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e74811-9cf6-4677-8ec9-a20008861de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:35.554179 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e74811-9cf6-4677-8ec9-a20008861de9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:35.565951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e74811-9cf6-4677-8ec9-a20008861de9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:35.574194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-49e74811-9cf6-4677-8ec9-a20008861de9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:35.574194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:35.574194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:35.574194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:35.574194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:35.574194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:35.574194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:35.574194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:35.574194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:35.574194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:35.574194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:35.574194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:35.574194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:35.574194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:35.574194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:35.574194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:35.575178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:35.575178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:35.575178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:35.575178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:35.575178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:35.575178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:35.575178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:35.575178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:35.575178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:35.575178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:35.575178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:35.575178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:35.575178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:35.575178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:35.575178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:35.575178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:35.576054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:35.576054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:35.576054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:35.576054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:35.576054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:35.576054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:35.576054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:35.576054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:35.576054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:35.576054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:35.576054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:35.576054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:35.576054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 294/579] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Jul 12 13:04:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:35.576761 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e74811-9cf6-4677-8ec9-a20008861de9 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:35.661158 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bbdf2-6fb2-4341-8a47-151e620fb494 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:35.691664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:35.699530 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e74811-9cf6-4677-8ec9-a20008861de9 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:35.709891 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9deba2-337a-42b5-95fe-bca04c85caa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:35.711486 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9deba2-337a-42b5-95fe-bca04c85caa8 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:35.711779 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9deba2-337a-42b5-95fe-bca04c85caa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:35.712223 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9deba2-337a-42b5-95fe-bca04c85caa8 None admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:35.713062 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9deba2-337a-42b5-95fe-bca04c85caa8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:35.713381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9deba2-337a-42b5-95fe-bca04c85caa8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:35.714850 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9deba2-337a-42b5-95fe-bca04c85caa8 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:35.738732 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 286/580] 10.222.0.17 () {56 vars in 1133 bytes} [Tue Jul 12 13:04:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:35.739581 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9deba2-337a-42b5-95fe-bca04c85caa8 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:35.746084 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6367a9-66ec-4923-ad94-df56947213f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:35.747141 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6367a9-66ec-4923-ad94-df56947213f1 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:35.747609 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6367a9-66ec-4923-ad94-df56947213f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:35.748066 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6367a9-66ec-4923-ad94-df56947213f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:35.748974 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6367a9-66ec-4923-ad94-df56947213f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:35.749467 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6367a9-66ec-4923-ad94-df56947213f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:35.751499 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6367a9-66ec-4923-ad94-df56947213f1 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:35.762255 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:35.772862 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 295/581] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:35.772862 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6367a9-66ec-4923-ad94-df56947213f1 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:35.849534 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9deba2-337a-42b5-95fe-bca04c85caa8 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:35.887960 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae05c2f-cd90-4e21-8a4d-073647f412ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:35.888460 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6367a9-66ec-4923-ad94-df56947213f1 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:35.888639 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae05c2f-cd90-4e21-8a4d-073647f412ae None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:35.888925 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae05c2f-cd90-4e21-8a4d-073647f412ae None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:35.889208 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae05c2f-cd90-4e21-8a4d-073647f412ae None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:35.889952 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae05c2f-cd90-4e21-8a4d-073647f412ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:35.890298 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae05c2f-cd90-4e21-8a4d-073647f412ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:35.891691 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae05c2f-cd90-4e21-8a4d-073647f412ae None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:35.903578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 287/582] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:35.904405 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae05c2f-cd90-4e21-8a4d-073647f412ae None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:35.931482 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc75fa3-87c6-404a-89bc-1ffa572ca7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:35.932259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc75fa3-87c6-404a-89bc-1ffa572ca7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:35.932548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc75fa3-87c6-404a-89bc-1ffa572ca7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:35.932831 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc75fa3-87c6-404a-89bc-1ffa572ca7e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:35.933578 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc75fa3-87c6-404a-89bc-1ffa572ca7e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:35.933887 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc75fa3-87c6-404a-89bc-1ffa572ca7e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:35.935312 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc75fa3-87c6-404a-89bc-1ffa572ca7e0 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:35.949722 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 296/583] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Jul 12 13:04:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:35.949722 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc75fa3-87c6-404a-89bc-1ffa572ca7e0 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:35.950724 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:36.013374 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:36.040346 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae05c2f-cd90-4e21-8a4d-073647f412ae None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:36.057640 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc75fa3-87c6-404a-89bc-1ffa572ca7e0 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:36.093165 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab420a1-f279-49e8-83b6-b752984ebc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:36.093390 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a8c19-0bff-40fd-b556-c03dc203f5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:36.093975 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab420a1-f279-49e8-83b6-b752984ebc58 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:36.094198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a8c19-0bff-40fd-b556-c03dc203f5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:36.094314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab420a1-f279-49e8-83b6-b752984ebc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:36.094464 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a8c19-0bff-40fd-b556-c03dc203f5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:36.094556 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab420a1-f279-49e8-83b6-b752984ebc58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:36.094742 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a8c19-0bff-40fd-b556-c03dc203f5f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:36.102462 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a8c19-0bff-40fd-b556-c03dc203f5f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:36.103917 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a8c19-0bff-40fd-b556-c03dc203f5f9 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:36.107979 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab420a1-f279-49e8-83b6-b752984ebc58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:36.109441 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab420a1-f279-49e8-83b6-b752984ebc58 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:36.118861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-763a8c19-0bff-40fd-b556-c03dc203f5f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:36.118861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:36.118861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:36.118861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:36.118861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:36.118861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:36.118861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:36.118861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:36.118861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:36.118861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:36.118861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:36.118861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:36.118861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:04:36.118861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:04:36.118861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:04:36.119766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:04:36.119766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:36.119766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:36.119766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:36.119766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:36.119766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:36.119766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:36.119766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:36.119766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:36.119766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:36.119766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:36.119766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:36.119766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:36.119766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:36.119766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:36.119766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:36.119766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:36.120673 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:04:36.120673 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:04:36.120673 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:04:36.120673 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:04:36.120673 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:04:36.120673 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:04:36.120673 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:36.120673 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:36.120673 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 297/584] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:36.121149 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a8c19-0bff-40fd-b556-c03dc203f5f9 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:36.133225 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-7ab420a1-f279-49e8-83b6-b752984ebc58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:36.133225 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:36.133225 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:36.133225 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:36.133225 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:36.133225 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:36.133225 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:36.133225 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:36.133225 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:36.133225 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:36.133225 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:36.133225 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:36.133225 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:36.133225 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:36.133225 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:36.134167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:36.134167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:36.134167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:36.134167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:36.134167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:36.134167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:36.134167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:36.134167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:36.134167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:36.134167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:36.134167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:36.134167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:36.134167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:36.134167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:36.134167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:36.134167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:36.134167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:36.135074 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:36.135074 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:36.135074 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:36.135074 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:36.135074 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 288/585] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:36.136418 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab420a1-f279-49e8-83b6-b752984ebc58 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:36.242984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a8c19-0bff-40fd-b556-c03dc203f5f9 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:36.247909 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:36.260019 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab420a1-f279-49e8-83b6-b752984ebc58 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:36.269387 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:36.285337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b362213-7f75-4f0a-a850-9d2c77e3a3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:36.286467 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b362213-7f75-4f0a-a850-9d2c77e3a3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:36.286945 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b362213-7f75-4f0a-a850-9d2c77e3a3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:36.287219 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b362213-7f75-4f0a-a850-9d2c77e3a3f6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:36.295748 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fefc5c-da50-4b3b-b3f6-66c8e0f583c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:36.295959 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b362213-7f75-4f0a-a850-9d2c77e3a3f6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:36.296565 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fefc5c-da50-4b3b-b3f6-66c8e0f583c4 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:36.296857 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fefc5c-da50-4b3b-b3f6-66c8e0f583c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:36.297140 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fefc5c-da50-4b3b-b3f6-66c8e0f583c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:36.297378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b362213-7f75-4f0a-a850-9d2c77e3a3f6 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:36.309412 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fefc5c-da50-4b3b-b3f6-66c8e0f583c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:36.310891 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fefc5c-da50-4b3b-b3f6-66c8e0f583c4 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:36.312896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-4b362213-7f75-4f0a-a850-9d2c77e3a3f6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 13:04:36.312896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:36.312896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:36.312896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:36.312896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:36.312896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:36.312896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:36.312896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:36.312896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:36.312896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:36.312896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:36.312896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:36.312896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:04:36.312896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:04:36.312896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:04:36.312896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:04:36.313817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:36.313817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:36.313817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:04:36.313817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:36.313817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:04:36.313817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:36.313817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:36.313817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:36.313817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:36.313817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:36.313817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:36.313817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:36.313817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:36.313817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:36.313817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:36.313817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:36.313817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:36.313817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:36.315449 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:36.315449 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:36.315449 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:04:36.315449 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:04:36.315449 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:04:36.315449 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:04:36.315449 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:04:36.315449 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:04:36.315449 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 13:04:36.315449 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:36.315449 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 298/586] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:04:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:36.315449 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b362213-7f75-4f0a-a850-9d2c77e3a3f6 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:36.334797 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-f8fefc5c-da50-4b3b-b3f6-66c8e0f583c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:36.334797 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:36.334797 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:36.334797 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:36.334797 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:36.334797 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:36.334797 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:36.334797 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:36.334797 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:36.334797 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:36.334797 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:36.334797 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:36.334797 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:36.334797 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:36.334797 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:36.335942 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:36.335942 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:36.335942 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:36.335942 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:36.335942 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:36.335942 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:36.335942 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:36.335942 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:36.335942 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:36.335942 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:36.335942 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:36.335942 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:36.335942 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:36.335942 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:36.335942 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:36.335942 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:36.335942 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:36.336859 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:36.336859 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:36.336859 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:36.336859 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:36.336859 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 289/587] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:36.337286 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fefc5c-da50-4b3b-b3f6-66c8e0f583c4 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:36.429150 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b362213-7f75-4f0a-a850-9d2c77e3a3f6 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:36.450355 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fefc5c-da50-4b3b-b3f6-66c8e0f583c4 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:36.467415 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17782e31-7996-4495-9ec3-4e81f817179d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:36.468197 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17782e31-7996-4495-9ec3-4e81f817179d None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:36.468481 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17782e31-7996-4495-9ec3-4e81f817179d None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:36.468867 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17782e31-7996-4495-9ec3-4e81f817179d None admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:36.469660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17782e31-7996-4495-9ec3-4e81f817179d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:36.469970 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17782e31-7996-4495-9ec3-4e81f817179d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:36.471430 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17782e31-7996-4495-9ec3-4e81f817179d None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:36.484568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 299/588] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:04:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:36.485428 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17782e31-7996-4495-9ec3-4e81f817179d None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:36.486894 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457236f-de5b-4c2a-9ec9-ed5f07c49f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:36.487645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457236f-de5b-4c2a-9ec9-ed5f07c49f88 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:36.488003 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457236f-de5b-4c2a-9ec9-ed5f07c49f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:36.488385 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457236f-de5b-4c2a-9ec9-ed5f07c49f88 None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:36.489273 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457236f-de5b-4c2a-9ec9-ed5f07c49f88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:36.489521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457236f-de5b-4c2a-9ec9-ed5f07c49f88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:36.491049 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457236f-de5b-4c2a-9ec9-ed5f07c49f88 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:36.509100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 290/589] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:36.509100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457236f-de5b-4c2a-9ec9-ed5f07c49f88 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:36.509100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:36.538323 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:36.607894 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17782e31-7996-4495-9ec3-4e81f817179d None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:36.612955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457236f-de5b-4c2a-9ec9-ed5f07c49f88 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:36.648310 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838826af-f7ee-4e54-964b-31f19bbfe706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:36.648985 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838826af-f7ee-4e54-964b-31f19bbfe706 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:36.649270 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838826af-f7ee-4e54-964b-31f19bbfe706 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:36.649543 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838826af-f7ee-4e54-964b-31f19bbfe706 None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:36.650135 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c03c7c-18a3-4fe7-b8d1-cc876a05e260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:36.650476 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838826af-f7ee-4e54-964b-31f19bbfe706 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:36.650788 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838826af-f7ee-4e54-964b-31f19bbfe706 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:36.650885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c03c7c-18a3-4fe7-b8d1-cc876a05e260 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:36.651117 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c03c7c-18a3-4fe7-b8d1-cc876a05e260 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:36.651393 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c03c7c-18a3-4fe7-b8d1-cc876a05e260 None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:36.652115 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c03c7c-18a3-4fe7-b8d1-cc876a05e260 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:36.652220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838826af-f7ee-4e54-964b-31f19bbfe706 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:36.652425 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c03c7c-18a3-4fe7-b8d1-cc876a05e260 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:36.653781 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c03c7c-18a3-4fe7-b8d1-cc876a05e260 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:36.666817 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 291/590] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:36.667483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c03c7c-18a3-4fe7-b8d1-cc876a05e260 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:36.680717 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 300/591] 10.222.0.17 () {56 vars in 1137 bytes} [Tue Jul 12 13:04:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:36.681699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838826af-f7ee-4e54-964b-31f19bbfe706 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:36.741382 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:36.781926 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c03c7c-18a3-4fe7-b8d1-cc876a05e260 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:36.808444 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:36.813298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838826af-f7ee-4e54-964b-31f19bbfe706 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:36.821004 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeabb3f-ba6e-4d78-a734-8d0672fc403b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:36.822543 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeabb3f-ba6e-4d78-a734-8d0672fc403b None admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:36.823500 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeabb3f-ba6e-4d78-a734-8d0672fc403b None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:36.823971 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeabb3f-ba6e-4d78-a734-8d0672fc403b None admin] PATH_INFO: `/v3/projects/cd70432d4e5a4e25a4a6def32ffc6ee2/users/e8b89afc60864451ba7b5a0a6d190628/roles/88426002bf1b40c0b59071eaaba38530` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:36.844477 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeabb3f-ba6e-4d78-a734-8d0672fc403b None admin] RBAC: Authorizing `identity:create_grant(project_id=cd70432d4e5a4e25a4a6def32ffc6ee2, user_id=e8b89afc60864451ba7b5a0a6d190628, role_id=88426002bf1b40c0b59071eaaba38530)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:36.845916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeabb3f-ba6e-4d78-a734-8d0672fc403b None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:36.852379 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1db388-f7c7-45d6-b94f-60d101196247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:36.853312 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1db388-f7c7-45d6-b94f-60d101196247 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:36.853601 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1db388-f7c7-45d6-b94f-60d101196247 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:36.853916 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1db388-f7c7-45d6-b94f-60d101196247 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:36.870152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 292/592] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Jul 12 13:04:36 2022] PUT /identity/v3/projects/cd70432d4e5a4e25a4a6def32ffc6ee2/users/e8b89afc60864451ba7b5a0a6d190628/roles/88426002bf1b40c0b59071eaaba38530 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:04:36.870374 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1db388-f7c7-45d6-b94f-60d101196247 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:36.870469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeabb3f-ba6e-4d78-a734-8d0672fc403b None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:36.870593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1db388-f7c7-45d6-b94f-60d101196247 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:36.886486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-ea1db388-f7c7-45d6-b94f-60d101196247 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:36.886486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:36.886486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:36.886486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:36.886486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:36.886486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:36.886486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:36.886486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:36.886486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:36.886486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:36.886486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:36.886486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:36.886486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:04:36.886486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:04:36.886486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:04:36.887628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:04:36.887628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:36.887628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:36.887628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:36.887628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:36.887628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:36.887628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:36.887628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:36.887628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:36.887628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:36.887628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:36.887628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:36.887628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:36.887628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:36.887628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:36.887628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:36.887628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:36.888679 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:04:36.888679 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:04:36.888679 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:04:36.888679 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:04:36.888679 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:04:36.888679 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:04:36.888679 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:36.888679 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:36.888679 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 301/593] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:36.889918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1db388-f7c7-45d6-b94f-60d101196247 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:37.010606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1db388-f7c7-45d6-b94f-60d101196247 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:37.021844 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeabb3f-ba6e-4d78-a734-8d0672fc403b None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:37.041593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:37.051069 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78dea6f-8abd-4826-b37b-064cbdec0165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:37.052275 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78dea6f-8abd-4826-b37b-064cbdec0165 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:37.052776 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78dea6f-8abd-4826-b37b-064cbdec0165 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:37.053565 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78dea6f-8abd-4826-b37b-064cbdec0165 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:37.065971 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78dea6f-8abd-4826-b37b-064cbdec0165 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:37.067690 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78dea6f-8abd-4826-b37b-064cbdec0165 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:37.068313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9767e3-1534-44e9-90d2-8418ccfceef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:37.069132 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9767e3-1534-44e9-90d2-8418ccfceef6 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:37.069604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9767e3-1534-44e9-90d2-8418ccfceef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:37.069887 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9767e3-1534-44e9-90d2-8418ccfceef6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:37.079454 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9767e3-1534-44e9-90d2-8418ccfceef6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:37.080905 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9767e3-1534-44e9-90d2-8418ccfceef6 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:37.088183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-a78dea6f-8abd-4826-b37b-064cbdec0165 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:37.088183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:37.088183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:37.088183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:37.088183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:37.088183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:37.088183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:37.088183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:37.088183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:37.088183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:37.088183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:37.088183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:37.088183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:37.088183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:37.088183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:37.089286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:37.089286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:37.089286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:37.089286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:37.089286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:37.089286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:37.089286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:37.089286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:37.089286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:37.089286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:37.089286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:37.089286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:37.089286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:37.089286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:37.089286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:37.089286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:37.089286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:37.090417 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:37.090417 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:37.090417 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:37.090417 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:37.090417 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 302/594] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:37.094646 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78dea6f-8abd-4826-b37b-064cbdec0165 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:37.100164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-1f9767e3-1534-44e9-90d2-8418ccfceef6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 13:04:37.100164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:37.100164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:37.100164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:37.100164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:37.100164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:37.100164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:37.100164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:37.100164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:37.100164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:37.100164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:37.100164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:37.100164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:04:37.100164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:04:37.100164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:04:37.100164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:04:37.101345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:37.101345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:37.101345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:04:37.101345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:37.101345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:04:37.101345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:37.101345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:37.101345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:37.101345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:37.101345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:37.101345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:37.101345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:37.101345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:37.101345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:37.101345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:37.101345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:37.101345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:37.101345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:37.102513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:37.102513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:37.102513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:04:37.102513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:04:37.102513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:04:37.102513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:04:37.102513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:04:37.102513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:04:37.102513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 13:04:37.102513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:37.105024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 293/595] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Jul 12 13:04:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:37.106411 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9767e3-1534-44e9-90d2-8418ccfceef6 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:37.114491 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:37.213603 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78dea6f-8abd-4826-b37b-064cbdec0165 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:37.233052 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9767e3-1534-44e9-90d2-8418ccfceef6 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:37.251432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25124e-27f7-4b3d-aa70-724fec054fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:37.252437 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25124e-27f7-4b3d-aa70-724fec054fab None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:37.252640 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25124e-27f7-4b3d-aa70-724fec054fab None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:37.253025 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25124e-27f7-4b3d-aa70-724fec054fab None admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:37.253922 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d25124e-27f7-4b3d-aa70-724fec054fab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:37.254327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d25124e-27f7-4b3d-aa70-724fec054fab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:37.255949 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d25124e-27f7-4b3d-aa70-724fec054fab None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:37.269613 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 303/596] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:04:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:37.270556 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25124e-27f7-4b3d-aa70-724fec054fab None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:37.283311 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bb41e-bdac-45e4-8383-226687d6575b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:37.284139 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bb41e-bdac-45e4-8383-226687d6575b None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:37.284495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bb41e-bdac-45e4-8383-226687d6575b None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:37.284840 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bb41e-bdac-45e4-8383-226687d6575b None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:37.285646 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488bb41e-bdac-45e4-8383-226687d6575b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:37.286023 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488bb41e-bdac-45e4-8383-226687d6575b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:37.287627 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488bb41e-bdac-45e4-8383-226687d6575b None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:37.304999 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 294/597] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:37.305985 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bb41e-bdac-45e4-8383-226687d6575b None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:37.342609 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:37.351744 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:37.389171 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25124e-27f7-4b3d-aa70-724fec054fab None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:37.415126 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bb41e-bdac-45e4-8383-226687d6575b None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:37.424470 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03d076-6ee0-40f4-9c9e-e4c35df373da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:37.425157 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03d076-6ee0-40f4-9c9e-e4c35df373da None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:37.425449 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03d076-6ee0-40f4-9c9e-e4c35df373da None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:37.425783 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03d076-6ee0-40f4-9c9e-e4c35df373da None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:37.427057 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03d076-6ee0-40f4-9c9e-e4c35df373da None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:37.427057 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03d076-6ee0-40f4-9c9e-e4c35df373da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:37.428541 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03d076-6ee0-40f4-9c9e-e4c35df373da None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:37.448352 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 304/598] 10.222.0.17 () {56 vars in 1139 bytes} [Tue Jul 12 13:04:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:37.449007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03d076-6ee0-40f4-9c9e-e4c35df373da None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:37.458250 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f775f-cb67-429a-857c-0ec8beebbfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:37.459142 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f775f-cb67-429a-857c-0ec8beebbfbe None admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:37.459427 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f775f-cb67-429a-857c-0ec8beebbfbe None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:37.459928 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f775f-cb67-429a-857c-0ec8beebbfbe None admin] PATH_INFO: `/v3/projects/cd70432d4e5a4e25a4a6def32ffc6ee2/users/e52dfce1b06346bfbde6ee33e7f6f249/roles/88426002bf1b40c0b59071eaaba38530` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:37.475703 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f775f-cb67-429a-857c-0ec8beebbfbe None admin] RBAC: Authorizing `identity:create_grant(project_id=cd70432d4e5a4e25a4a6def32ffc6ee2, user_id=e52dfce1b06346bfbde6ee33e7f6f249, role_id=88426002bf1b40c0b59071eaaba38530)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:37.477396 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f775f-cb67-429a-857c-0ec8beebbfbe None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:37.496719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 295/599] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Jul 12 13:04:37 2022] PUT /identity/v3/projects/cd70432d4e5a4e25a4a6def32ffc6ee2/users/e52dfce1b06346bfbde6ee33e7f6f249/roles/88426002bf1b40c0b59071eaaba38530 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:04:37.496719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7bb62-6c04-411f-be04-4bfc0346343b None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:37.496719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7bb62-6c04-411f-be04-4bfc0346343b None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:37.496719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7bb62-6c04-411f-be04-4bfc0346343b None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:37.496719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 296/600] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:37.496719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7bb62-6c04-411f-be04-4bfc0346343b None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:37.576727 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03d076-6ee0-40f4-9c9e-e4c35df373da None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:37.611731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:37.623004 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674cac3-a99f-4ddc-af44-bc767143e9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:37.623846 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674cac3-a99f-4ddc-af44-bc767143e9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:37.624134 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674cac3-a99f-4ddc-af44-bc767143e9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:37.624412 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674cac3-a99f-4ddc-af44-bc767143e9e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:37.633313 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674cac3-a99f-4ddc-af44-bc767143e9e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:37.634461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:37.636542 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674cac3-a99f-4ddc-af44-bc767143e9e5 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:37.653521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-0674cac3-a99f-4ddc-af44-bc767143e9e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:37.653521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:37.653521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:37.653521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:37.653521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:37.653521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:37.653521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:37.653521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:37.653521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:37.653521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:37.653521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:37.653521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:37.653521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:04:37.653521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:04:37.653521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:04:37.654550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:04:37.654550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:37.654550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:37.654550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:37.654550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:37.654550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:37.654550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:37.654550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:37.654550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:37.654550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:37.654550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:37.654550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:37.654550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:37.654550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:37.654550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:37.654550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:37.654550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:37.655457 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:04:37.655457 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:04:37.655457 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:04:37.655457 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:04:37.655457 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:04:37.655457 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:04:37.655457 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:37.655457 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:37.660621 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 305/601] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:37.661189 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0030194-025e-42ee-ba76-48984482f04b None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:37.661479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0030194-025e-42ee-ba76-48984482f04b None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:37.661762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0030194-025e-42ee-ba76-48984482f04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:37.663427 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7bb62-6c04-411f-be04-4bfc0346343b None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:37.689962 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-c0030194-025e-42ee-ba76-48984482f04b None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:37.690514 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-c0030194-025e-42ee-ba76-48984482f04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:37.729250 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97aa83c-c3b3-43ea-b835-690e8c727fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:37.730097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97aa83c-c3b3-43ea-b835-690e8c727fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:37.730414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97aa83c-c3b3-43ea-b835-690e8c727fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:37.730715 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97aa83c-c3b3-43ea-b835-690e8c727fa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:37.742985 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97aa83c-c3b3-43ea-b835-690e8c727fa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:37.744459 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97aa83c-c3b3-43ea-b835-690e8c727fa3 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:37.764577 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-a97aa83c-c3b3-43ea-b835-690e8c727fa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:37.764577 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:37.764577 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:37.764577 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:37.764577 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:37.764577 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:37.764577 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:37.764577 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:37.764577 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:37.764577 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:37.764577 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:37.764577 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:37.764577 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:37.764577 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:37.764577 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:37.765596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:37.765596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:37.765596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:37.765596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:37.765596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:37.765596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:37.765596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:37.765596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:37.765596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:37.765596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:37.765596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:37.765596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:37.765596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:37.765596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:37.765596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:37.765596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:37.765596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:37.766554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:37.766554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:37.766554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:37.766554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:37.770282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 297/602] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:37.771321 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97aa83c-c3b3-43ea-b835-690e8c727fa3 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:37.782243 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 306/603] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:37.783460 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0030194-025e-42ee-ba76-48984482f04b None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:37.905854 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0030194-025e-42ee-ba76-48984482f04b None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:37.924339 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97aa83c-c3b3-43ea-b835-690e8c727fa3 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:37.925389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:37.954459 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d5430-1a6a-4fcf-9e06-631635a45e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:37.955927 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d5430-1a6a-4fcf-9e06-631635a45e45 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:37.956720 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d5430-1a6a-4fcf-9e06-631635a45e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:37.957707 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d5430-1a6a-4fcf-9e06-631635a45e45 None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:37.958989 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d5430-1a6a-4fcf-9e06-631635a45e45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:37.959760 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d5430-1a6a-4fcf-9e06-631635a45e45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:37.962906 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d5430-1a6a-4fcf-9e06-631635a45e45 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:37.966186 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684d359-d227-4622-95e6-8cc01f07209f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:37.967064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684d359-d227-4622-95e6-8cc01f07209f None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:37.967179 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684d359-d227-4622-95e6-8cc01f07209f None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:37.967444 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684d359-d227-4622-95e6-8cc01f07209f None admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:37.968404 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684d359-d227-4622-95e6-8cc01f07209f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:37.968723 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684d359-d227-4622-95e6-8cc01f07209f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:37.970194 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684d359-d227-4622-95e6-8cc01f07209f None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:37.972332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:37.980730 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 307/604] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:37.981936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d5430-1a6a-4fcf-9e06-631635a45e45 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:37.991579 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 298/605] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:04:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:37.993364 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684d359-d227-4622-95e6-8cc01f07209f None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:38.100134 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d5430-1a6a-4fcf-9e06-631635a45e45 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:38.108999 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684d359-d227-4622-95e6-8cc01f07209f None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:38.146820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3812b76-b163-4bee-bad5-e0f04c68d566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:38.147643 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3812b76-b163-4bee-bad5-e0f04c68d566 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:38.147925 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3812b76-b163-4bee-bad5-e0f04c68d566 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:38.148334 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3812b76-b163-4bee-bad5-e0f04c68d566 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:38.156924 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095032b-65ef-4737-93b5-842a1c02526e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:38.157969 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095032b-65ef-4737-93b5-842a1c02526e None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:38.158303 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095032b-65ef-4737-93b5-842a1c02526e None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:38.158585 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095032b-65ef-4737-93b5-842a1c02526e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:38.160954 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3812b76-b163-4bee-bad5-e0f04c68d566 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:38.166209 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095032b-65ef-4737-93b5-842a1c02526e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:38.167667 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095032b-65ef-4737-93b5-842a1c02526e None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:38.169445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-b3812b76-b163-4bee-bad5-e0f04c68d566 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:38.169445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:38.169445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:38.169445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:38.169445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:38.169445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:38.169445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:38.169445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:38.169445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:38.169445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:38.169445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:38.169445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:38.169445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:38.169445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:38.169445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:38.169445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:38.170575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:38.170575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:38.170575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:38.170575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:38.170575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:38.170575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:38.170575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:38.170575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:38.170575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:38.170575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:38.170575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:38.170575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:38.170575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:38.170575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:38.170575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:38.170575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:38.171465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:38.171465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:38.171465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:38.171465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:38.171465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:38.171465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:38.171465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:38.171465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:38.171465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:38.171465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:38.171465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:38.171465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:38.172389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 308/606] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Jul 12 13:04:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:38.176734 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3812b76-b163-4bee-bad5-e0f04c68d566 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:38.183771 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-c095032b-65ef-4737-93b5-842a1c02526e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:38.183771 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:38.183771 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:38.183771 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:38.183771 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:38.183771 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:38.183771 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:38.183771 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:38.183771 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:38.183771 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:38.183771 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:38.183771 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:38.183771 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:04:38.183771 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:04:38.183771 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:04:38.185824 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:04:38.185824 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:38.185824 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:38.185824 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:38.185824 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:38.185824 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:38.185824 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:38.185824 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:38.185824 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:38.185824 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:38.185824 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:38.185824 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:38.185824 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:38.185824 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:38.185824 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:38.185824 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:38.185824 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:38.188055 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:04:38.188055 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:04:38.188055 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:04:38.188055 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:04:38.188055 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:04:38.188055 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:04:38.188055 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:38.188055 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:38.188055 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 299/607] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:38.188055 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095032b-65ef-4737-93b5-842a1c02526e None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:38.227386 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:38.261995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:38.307783 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3812b76-b163-4bee-bad5-e0f04c68d566 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:38.317666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095032b-65ef-4737-93b5-842a1c02526e None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:38.346015 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58860a7-9ed9-4ce9-9f3c-cf632e2dc478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:38.347046 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58860a7-9ed9-4ce9-9f3c-cf632e2dc478 None admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:38.347338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58860a7-9ed9-4ce9-9f3c-cf632e2dc478 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:38.347617 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58860a7-9ed9-4ce9-9f3c-cf632e2dc478 None admin] PATH_INFO: `/v3/projects/cd70432d4e5a4e25a4a6def32ffc6ee2/users/f7af0259f7f24dfdafbdfc1f613ebb42/roles/88426002bf1b40c0b59071eaaba38530` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:38.353165 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8b156-0919-4e3b-9378-5a5facb3706d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:38.353844 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8b156-0919-4e3b-9378-5a5facb3706d None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:38.354149 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8b156-0919-4e3b-9378-5a5facb3706d None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:38.354455 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8b156-0919-4e3b-9378-5a5facb3706d None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:38.355280 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8b156-0919-4e3b-9378-5a5facb3706d None admin] RBAC: Adding query filter params (name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:38.355589 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8b156-0919-4e3b-9378-5a5facb3706d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:38.357073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8b156-0919-4e3b-9378-5a5facb3706d None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:38.364600 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58860a7-9ed9-4ce9-9f3c-cf632e2dc478 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd70432d4e5a4e25a4a6def32ffc6ee2, user_id=f7af0259f7f24dfdafbdfc1f613ebb42, role_id=88426002bf1b40c0b59071eaaba38530)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:38.366067 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58860a7-9ed9-4ce9-9f3c-cf632e2dc478 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:38.366494 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 300/608] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Jul 12 13:04:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:38.367983 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8b156-0919-4e3b-9378-5a5facb3706d None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:38.384111 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 309/609] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Jul 12 13:04:38 2022] PUT /identity/v3/projects/cd70432d4e5a4e25a4a6def32ffc6ee2/users/f7af0259f7f24dfdafbdfc1f613ebb42/roles/88426002bf1b40c0b59071eaaba38530 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:04:38.385248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58860a7-9ed9-4ce9-9f3c-cf632e2dc478 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:38.481560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8b156-0919-4e3b-9378-5a5facb3706d None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:38.487631 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:38.502603 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58860a7-9ed9-4ce9-9f3c-cf632e2dc478 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:38.504013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:38.530188 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ba5a5-3f02-400c-a50c-0160ebd2b268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:38.530902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ba5a5-3f02-400c-a50c-0160ebd2b268 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:38.531185 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ba5a5-3f02-400c-a50c-0160ebd2b268 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:38.531464 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ba5a5-3f02-400c-a50c-0160ebd2b268 None admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:38.532373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ba5a5-3f02-400c-a50c-0160ebd2b268 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:38.532690 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ba5a5-3f02-400c-a50c-0160ebd2b268 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:38.534329 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ba5a5-3f02-400c-a50c-0160ebd2b268 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:38.545473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15824a1-c2be-4dbc-a94e-0523f0206fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:38.546326 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15824a1-c2be-4dbc-a94e-0523f0206fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:38.546615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15824a1-c2be-4dbc-a94e-0523f0206fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:38.546893 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15824a1-c2be-4dbc-a94e-0523f0206fd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:38.548922 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 301/610] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:04:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:38.557889 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ba5a5-3f02-400c-a50c-0160ebd2b268 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:38.559222 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15824a1-c2be-4dbc-a94e-0523f0206fd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:38.560754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15824a1-c2be-4dbc-a94e-0523f0206fd2 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:38.581263 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-f15824a1-c2be-4dbc-a94e-0523f0206fd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:38.581263 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:38.581263 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:38.581263 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:38.581263 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:38.581263 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:38.581263 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:38.581263 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:38.581263 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:38.581263 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:38.581263 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:38.581263 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:38.581263 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:38.581263 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:38.581263 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:38.583406 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:38.583406 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:38.583406 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:38.583406 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:38.583406 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:38.583406 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:38.583406 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:38.583406 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:38.583406 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:38.583406 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:38.583406 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:38.583406 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:38.583406 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:38.583406 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:38.583406 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:38.583406 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:38.583406 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:38.585018 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:38.585018 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:38.585018 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:38.585018 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:38.585018 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 310/611] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:38.591411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15824a1-c2be-4dbc-a94e-0523f0206fd2 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:38.733961 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ba5a5-3f02-400c-a50c-0160ebd2b268 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:38.748564 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15824a1-c2be-4dbc-a94e-0523f0206fd2 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:38.792027 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d88f3-2b48-4f66-938d-249e5662fe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:38.792959 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d88f3-2b48-4f66-938d-249e5662fe36 None admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:38.793248 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d88f3-2b48-4f66-938d-249e5662fe36 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:38.793531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d88f3-2b48-4f66-938d-249e5662fe36 None admin] PATH_INFO: `/v3/projects/cd70432d4e5a4e25a4a6def32ffc6ee2/users/0f39694be5f447f9a25dacf7e4c99a4d/roles/88426002bf1b40c0b59071eaaba38530` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:38.806154 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d258a89-40ba-4c06-8e4e-62c0ccfe4d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:38.806857 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d258a89-40ba-4c06-8e4e-62c0ccfe4d8d None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:38.807140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d258a89-40ba-4c06-8e4e-62c0ccfe4d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:38.807414 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d258a89-40ba-4c06-8e4e-62c0ccfe4d8d None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:38.808161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d258a89-40ba-4c06-8e4e-62c0ccfe4d8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:38.808472 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d258a89-40ba-4c06-8e4e-62c0ccfe4d8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:38.809879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d258a89-40ba-4c06-8e4e-62c0ccfe4d8d None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:38.820149 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:38.821073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d88f3-2b48-4f66-938d-249e5662fe36 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd70432d4e5a4e25a4a6def32ffc6ee2, user_id=0f39694be5f447f9a25dacf7e4c99a4d, role_id=88426002bf1b40c0b59071eaaba38530)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:38.822772 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d88f3-2b48-4f66-938d-249e5662fe36 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:38.824168 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 311/612] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:38.830912 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d258a89-40ba-4c06-8e4e-62c0ccfe4d8d None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:38.848450 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 302/613] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Jul 12 13:04:38 2022] PUT /identity/v3/projects/cd70432d4e5a4e25a4a6def32ffc6ee2/users/0f39694be5f447f9a25dacf7e4c99a4d/roles/88426002bf1b40c0b59071eaaba38530 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:04:38.954096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d258a89-40ba-4c06-8e4e-62c0ccfe4d8d None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:38.993614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d63f3-9fbb-4ac8-ab10-b9ebe92b1adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:38.994397 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d63f3-9fbb-4ac8-ab10-b9ebe92b1adb None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:38.994687 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d63f3-9fbb-4ac8-ab10-b9ebe92b1adb None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:38.994965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d63f3-9fbb-4ac8-ab10-b9ebe92b1adb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:39.003287 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d63f3-9fbb-4ac8-ab10-b9ebe92b1adb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:39.004762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d63f3-9fbb-4ac8-ab10-b9ebe92b1adb None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:39.022709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-7f4d63f3-9fbb-4ac8-ab10-b9ebe92b1adb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 13:04:39.022709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:39.022709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:39.022709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:39.022709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:39.022709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:39.022709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:39.022709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:39.022709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:39.022709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:39.022709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:39.022709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:39.022709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:04:39.022709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:04:39.022709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:04:39.022709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:04:39.023859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:39.023859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:39.023859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:04:39.023859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:39.023859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:04:39.023859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:39.023859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:39.023859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:39.023859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:39.023859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:39.023859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:39.023859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:39.023859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:39.023859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:39.023859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:39.023859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:39.023859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:39.023859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:39.024867 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:39.024867 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:39.024867 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:04:39.024867 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:04:39.024867 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:04:39.024867 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:04:39.024867 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:04:39.024867 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:04:39.024867 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 13:04:39.024867 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:39.024867 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 312/614] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:04:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:39.035575 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d88f3-2b48-4f66-938d-249e5662fe36 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:39.077530 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:39.174793 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d88f3-2b48-4f66-938d-249e5662fe36 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:39.211639 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6890ee6-387a-4758-a944-e2dc4a6cb10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:39.212325 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6890ee6-387a-4758-a944-e2dc4a6cb10e None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:39.212608 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6890ee6-387a-4758-a944-e2dc4a6cb10e None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:39.212885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6890ee6-387a-4758-a944-e2dc4a6cb10e None admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:39.213728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6890ee6-387a-4758-a944-e2dc4a6cb10e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:39.214033 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6890ee6-387a-4758-a944-e2dc4a6cb10e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:39.215514 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6890ee6-387a-4758-a944-e2dc4a6cb10e None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:39.236365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 303/615] 10.222.0.17 () {56 vars in 1135 bytes} [Tue Jul 12 13:04:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:39.241815 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d63f3-9fbb-4ac8-ab10-b9ebe92b1adb None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:39.251324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33deeb1-4b0b-41cf-ac86-c2f1be1a7566 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:39.251604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33deeb1-4b0b-41cf-ac86-c2f1be1a7566 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:39.251817 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33deeb1-4b0b-41cf-ac86-c2f1be1a7566 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:39.253463 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 304/616] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:39.258698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb385d19-1ef8-4316-9a29-4a04eed8eeb0 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:39.258994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb385d19-1ef8-4316-9a29-4a04eed8eeb0 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:39.259281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb385d19-1ef8-4316-9a29-4a04eed8eeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:39.276660 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-cb385d19-1ef8-4316-9a29-4a04eed8eeb0 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:39.277875 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-cb385d19-1ef8-4316-9a29-4a04eed8eeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:39.354438 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:39.407655 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d63f3-9fbb-4ac8-ab10-b9ebe92b1adb None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:39.447173 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 305/617] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:04:39.448528 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db07f1-9fa5-4a2f-b9d6-af9bdefc6eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:39.449347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db07f1-9fa5-4a2f-b9d6-af9bdefc6eea None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:39.449631 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db07f1-9fa5-4a2f-b9d6-af9bdefc6eea None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:39.449911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db07f1-9fa5-4a2f-b9d6-af9bdefc6eea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:39.470525 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb385d19-1ef8-4316-9a29-4a04eed8eeb0 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:39.474424 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db07f1-9fa5-4a2f-b9d6-af9bdefc6eea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:39.475901 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db07f1-9fa5-4a2f-b9d6-af9bdefc6eea None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:39.487266 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:39.508156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-44db07f1-9fa5-4a2f-b9d6-af9bdefc6eea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:39.508156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:39.508156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:39.508156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:39.508156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:39.508156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:39.508156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:39.508156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:39.508156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:39.508156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:39.508156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:39.508156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:39.508156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:39.508156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:39.508156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:39.509106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:39.509106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:39.509106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:39.509106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:39.509106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:39.509106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:39.509106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:39.509106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:39.509106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:39.509106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:39.509106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:39.509106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:39.509106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:39.509106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:39.509106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:39.509106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:39.509106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:39.510012 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:39.510012 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:39.510012 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:39.510012 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:39.518737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 313/618] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:39.525865 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db07f1-9fa5-4a2f-b9d6-af9bdefc6eea None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:39.587349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb385d19-1ef8-4316-9a29-4a04eed8eeb0 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:39.626049 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03814d03-d617-458c-ade7-6a97f147b1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:39.626959 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03814d03-d617-458c-ade7-6a97f147b1bd None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:39.627251 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03814d03-d617-458c-ade7-6a97f147b1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:39.627533 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03814d03-d617-458c-ade7-6a97f147b1bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:39.644168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03814d03-d617-458c-ade7-6a97f147b1bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:39.660554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-03814d03-d617-458c-ade7-6a97f147b1bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:39.660554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:39.660554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:39.660554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:39.660554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:39.660554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:39.660554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:39.660554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:39.660554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:39.660554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:39.660554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:39.660554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:39.660554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:39.660554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:39.660554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:39.660554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:39.661560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:39.661560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:39.661560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:39.661560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:39.661560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:39.661560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:39.661560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:39.661560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:39.661560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:39.661560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:39.661560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:39.661560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:39.661560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:39.661560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:39.661560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:39.661560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:39.663000 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:39.663000 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:39.663000 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:39.663000 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:39.663000 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:39.663000 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:39.663000 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:39.663000 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:39.663000 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:39.663000 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:39.663000 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:39.663000 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:39.663000 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 306/619] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Jul 12 13:04:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:04:39.673987 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03814d03-d617-458c-ade7-6a97f147b1bd None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:39.756370 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db07f1-9fa5-4a2f-b9d6-af9bdefc6eea None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:39.767166 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:39.784605 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:39.798771 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03814d03-d617-458c-ade7-6a97f147b1bd None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:39.821839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e44acd-78ab-492c-b5dd-0228e1736de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:39.822566 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e44acd-78ab-492c-b5dd-0228e1736de3 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:39.822851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e44acd-78ab-492c-b5dd-0228e1736de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:39.823629 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e44acd-78ab-492c-b5dd-0228e1736de3 None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:39.823877 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e44acd-78ab-492c-b5dd-0228e1736de3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:39.824190 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e44acd-78ab-492c-b5dd-0228e1736de3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:39.825603 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e44acd-78ab-492c-b5dd-0228e1736de3 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:39.840508 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51437398-eebf-495b-9db7-2b5096338b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:39.841702 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51437398-eebf-495b-9db7-2b5096338b46 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:39.842241 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51437398-eebf-495b-9db7-2b5096338b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:39.842744 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51437398-eebf-495b-9db7-2b5096338b46 None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:39.843785 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51437398-eebf-495b-9db7-2b5096338b46 None admin] RBAC: Adding query filter params (name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:39.844341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51437398-eebf-495b-9db7-2b5096338b46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:39.845946 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51437398-eebf-495b-9db7-2b5096338b46 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:39.853351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 314/620] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:04:39.861410 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 307/621] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Jul 12 13:04:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:04:39.862695 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e44acd-78ab-492c-b5dd-0228e1736de3 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:39.867356 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51437398-eebf-495b-9db7-2b5096338b46 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:39.975829 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51437398-eebf-495b-9db7-2b5096338b46 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:39.981418 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e44acd-78ab-492c-b5dd-0228e1736de3 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:40.014073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba6ec9-d053-4aaf-ac9b-331959660516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:40.015383 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba6ec9-d053-4aaf-ac9b-331959660516 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:40.015924 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba6ec9-d053-4aaf-ac9b-331959660516 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:40.016426 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba6ec9-d053-4aaf-ac9b-331959660516 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:40.020139 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:40.021864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ae3b7-9b79-4792-9d69-06a8f3ac4526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:40.022737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ae3b7-9b79-4792-9d69-06a8f3ac4526 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:40.023775 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ae3b7-9b79-4792-9d69-06a8f3ac4526 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:40.024144 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ae3b7-9b79-4792-9d69-06a8f3ac4526 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:40.031484 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba6ec9-d053-4aaf-ac9b-331959660516 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:40.032580 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ae3b7-9b79-4792-9d69-06a8f3ac4526 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:40.033515 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba6ec9-d053-4aaf-ac9b-331959660516 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:40.034040 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ae3b7-9b79-4792-9d69-06a8f3ac4526 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:40.049434 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-630ae3b7-9b79-4792-9d69-06a8f3ac4526 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:40.049434 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:40.049434 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:40.049434 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:40.049434 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:40.049434 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:40.049434 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:40.049434 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:40.049434 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:40.049434 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:40.049434 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:40.049434 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:40.049434 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:04:40.049434 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:04:40.049434 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:04:40.050732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:04:40.050732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:40.050732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:40.050732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:40.050732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:40.050732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:40.050732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:40.050732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:40.050732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:40.050732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:40.050732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:40.050732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:40.050732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:40.050732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:40.050732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:40.050732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:40.050732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:40.051646 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:04:40.051646 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:04:40.051646 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:04:40.051646 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:04:40.051646 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:04:40.051646 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:04:40.051646 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:40.051646 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:40.055693 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 315/622] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:04:40.055988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-b1ba6ec9-d053-4aaf-ac9b-331959660516 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:40.055988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:40.055988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:40.055988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:40.055988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:40.055988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:40.055988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:40.055988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:40.055988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:40.055988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:40.055988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:40.055988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:40.055988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:40.055988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:40.055988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:40.056854 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:40.056854 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:40.056854 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:40.056854 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:40.056854 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:40.056854 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:40.056854 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:40.056854 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:40.056854 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:40.056854 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:40.056854 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:40.056854 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:40.056854 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:40.056854 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:40.056854 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:40.056854 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:40.056854 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:40.057777 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:40.057777 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:40.057777 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:40.057777 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:40.058012 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228694a1-a954-440e-bc23-5e9b395418d4 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:40.058012 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228694a1-a954-440e-bc23-5e9b395418d4 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:40.058012 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228694a1-a954-440e-bc23-5e9b395418d4 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:40.059166 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 316/623] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:40.059867 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228694a1-a954-440e-bc23-5e9b395418d4 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:40.060629 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 308/624] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:04:40.066489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d54917-615f-4035-8530-252a7fad8709 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:40.067066 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d54917-615f-4035-8530-252a7fad8709 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:40.067619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d54917-615f-4035-8530-252a7fad8709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:40.087313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-c1d54917-615f-4035-8530-252a7fad8709 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:40.088926 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-c1d54917-615f-4035-8530-252a7fad8709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:40.098256 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:40.168261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 309/625] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:40.169558 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d54917-615f-4035-8530-252a7fad8709 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:40.207837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228694a1-a954-440e-bc23-5e9b395418d4 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:40.251358 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8155f-6233-425b-aa20-be816396a131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:40.252098 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8155f-6233-425b-aa20-be816396a131 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:40.252391 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8155f-6233-425b-aa20-be816396a131 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:40.252675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8155f-6233-425b-aa20-be816396a131 None admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:40.253473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8155f-6233-425b-aa20-be816396a131 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:40.253790 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8155f-6233-425b-aa20-be816396a131 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:40.255284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8155f-6233-425b-aa20-be816396a131 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:40.274370 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 317/626] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:04:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:40.275305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8155f-6233-425b-aa20-be816396a131 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:40.285944 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d54917-615f-4035-8530-252a7fad8709 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:40.306820 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:40.329969 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc68927-643a-45b5-baaf-f3398dda21d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:40.331142 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc68927-643a-45b5-baaf-f3398dda21d7 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:40.332015 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc68927-643a-45b5-baaf-f3398dda21d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:40.332608 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc68927-643a-45b5-baaf-f3398dda21d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:40.333630 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc68927-643a-45b5-baaf-f3398dda21d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:40.334286 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc68927-643a-45b5-baaf-f3398dda21d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:40.336234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc68927-643a-45b5-baaf-f3398dda21d7 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:40.352785 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 310/627] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:40.353891 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc68927-643a-45b5-baaf-f3398dda21d7 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:40.400788 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:40.414388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8155f-6233-425b-aa20-be816396a131 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:40.465020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9efca4-45e2-4bff-a356-d4bcd4a05f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:40.466837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9efca4-45e2-4bff-a356-d4bcd4a05f1c None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:40.467390 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9efca4-45e2-4bff-a356-d4bcd4a05f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:40.467843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9efca4-45e2-4bff-a356-d4bcd4a05f1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:40.475630 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc68927-643a-45b5-baaf-f3398dda21d7 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:40.483382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9efca4-45e2-4bff-a356-d4bcd4a05f1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:40.496319 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-be9efca4-45e2-4bff-a356-d4bcd4a05f1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:40.496319 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:40.496319 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:40.496319 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:40.496319 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:40.496319 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:40.496319 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:40.496319 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:40.496319 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:40.496319 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:40.496319 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:40.496319 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:40.496319 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:40.496319 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:40.496319 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:40.496319 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:40.497562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:40.497562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:40.497562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:40.497562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:40.497562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:40.497562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:40.497562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:40.497562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:40.497562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:40.497562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:40.497562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:40.497562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:40.497562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:40.497562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:40.497562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:40.497562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:40.498629 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:40.498629 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:40.498629 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:40.498629 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:40.498629 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:40.498629 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:40.498629 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:40.498629 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:40.498629 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:40.498629 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:40.498629 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:40.498629 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:40.501708 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 318/628] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Jul 12 13:04:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:40.502849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9efca4-45e2-4bff-a356-d4bcd4a05f1c None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:40.527070 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6dd3c-f06c-4512-bfa3-03b0004ec53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:40.528041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6dd3c-f06c-4512-bfa3-03b0004ec53c None admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:40.528577 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6dd3c-f06c-4512-bfa3-03b0004ec53c None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:40.528897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6dd3c-f06c-4512-bfa3-03b0004ec53c None admin] PATH_INFO: `/v3/projects/cd70432d4e5a4e25a4a6def32ffc6ee2/users/fe10f0f42b8247c99ed5f88eff5065e3/roles/88426002bf1b40c0b59071eaaba38530` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:40.544908 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6dd3c-f06c-4512-bfa3-03b0004ec53c None admin] RBAC: Authorizing `identity:create_grant(project_id=cd70432d4e5a4e25a4a6def32ffc6ee2, user_id=fe10f0f42b8247c99ed5f88eff5065e3, role_id=88426002bf1b40c0b59071eaaba38530)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:40.546634 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6dd3c-f06c-4512-bfa3-03b0004ec53c None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:40.568600 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 311/629] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Jul 12 13:04:40 2022] PUT /identity/v3/projects/cd70432d4e5a4e25a4a6def32ffc6ee2/users/fe10f0f42b8247c99ed5f88eff5065e3/roles/88426002bf1b40c0b59071eaaba38530 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:04:40.569928 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6dd3c-f06c-4512-bfa3-03b0004ec53c None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:40.607753 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:40.695654 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9efca4-45e2-4bff-a356-d4bcd4a05f1c None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:40.721981 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6dd3c-f06c-4512-bfa3-03b0004ec53c None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:40.762365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d5f69-3882-45f9-a433-6e121dffe275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:40.763484 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d5f69-3882-45f9-a433-6e121dffe275 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:40.763925 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d5f69-3882-45f9-a433-6e121dffe275 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:40.764373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d5f69-3882-45f9-a433-6e121dffe275 None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:40.765298 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d5f69-3882-45f9-a433-6e121dffe275 None admin] RBAC: Adding query filter params (name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:40.765773 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d5f69-3882-45f9-a433-6e121dffe275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:40.767394 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d5f69-3882-45f9-a433-6e121dffe275 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:40.777924 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 312/630] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Jul 12 13:04:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:40.783027 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d5f69-3882-45f9-a433-6e121dffe275 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:40.788447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c0a41-fb4b-450b-9b30-648e10b70699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:40.789694 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c0a41-fb4b-450b-9b30-648e10b70699 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:40.789981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c0a41-fb4b-450b-9b30-648e10b70699 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:40.790293 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c0a41-fb4b-450b-9b30-648e10b70699 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:40.800585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c0a41-fb4b-450b-9b30-648e10b70699 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:40.803213 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c0a41-fb4b-450b-9b30-648e10b70699 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:40.822980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-d61c0a41-fb4b-450b-9b30-648e10b70699 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 13:04:40.822980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:40.822980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:40.822980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:40.822980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:40.822980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:40.822980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:40.822980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:40.822980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:40.822980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:40.822980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:40.822980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:40.822980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:04:40.822980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:04:40.822980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:04:40.822980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:04:40.824042 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:40.824042 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:40.824042 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:04:40.824042 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:40.824042 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:04:40.824042 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:40.824042 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:40.824042 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:40.824042 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:40.824042 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:40.824042 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:40.824042 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:40.824042 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:40.824042 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:40.824042 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:40.824042 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:40.824042 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:40.824042 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:40.824981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:40.824981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:40.824981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:04:40.824981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:04:40.824981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:04:40.824981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:04:40.824981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:04:40.824981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:04:40.824981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 13:04:40.824981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:40.824981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 319/631] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:04:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:40.830163 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c0a41-fb4b-450b-9b30-648e10b70699 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:40.852421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:40.934478 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:40.951880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d5f69-3882-45f9-a433-6e121dffe275 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:40.983733 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c0a41-fb4b-450b-9b30-648e10b70699 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:40.993485 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b112b-2599-435a-9bd0-01bb66d1049e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:40.994433 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b112b-2599-435a-9bd0-01bb66d1049e None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:40.994727 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b112b-2599-435a-9bd0-01bb66d1049e None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:40.995008 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b112b-2599-435a-9bd0-01bb66d1049e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:41.006753 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b112b-2599-435a-9bd0-01bb66d1049e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:41.008329 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b112b-2599-435a-9bd0-01bb66d1049e None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:41.022816 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748e63f-2ceb-4e3e-814b-fbf07fbfcc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:41.024024 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748e63f-2ceb-4e3e-814b-fbf07fbfcc5e None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:41.024312 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748e63f-2ceb-4e3e-814b-fbf07fbfcc5e None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:41.024588 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748e63f-2ceb-4e3e-814b-fbf07fbfcc5e None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:41.025428 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2748e63f-2ceb-4e3e-814b-fbf07fbfcc5e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:41.025741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2748e63f-2ceb-4e3e-814b-fbf07fbfcc5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:41.027220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2748e63f-2ceb-4e3e-814b-fbf07fbfcc5e None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:41.027449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-074b112b-2599-435a-9bd0-01bb66d1049e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:41.027449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:41.027449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:41.027449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:41.027449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:41.027449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:41.027449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:41.027449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:41.027449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:41.027449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:41.027449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:41.027449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:41.027449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:41.027449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:41.027449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:41.028351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:41.028351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:41.028351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:41.028351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:41.028351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:41.028351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:41.028351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:41.028351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:41.028351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:41.028351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:41.028351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:41.028351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:41.028351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:41.028351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:41.028351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:41.028351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:41.028351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:41.029245 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:41.029245 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:41.029245 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:41.029245 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:41.029245 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 313/632] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:41.034839 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6245555-ab8e-483e-87a2-c1c50afd632c None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:41.035130 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6245555-ab8e-483e-87a2-c1c50afd632c None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:41.035414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6245555-ab8e-483e-87a2-c1c50afd632c None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:41.037058 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 314/633] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:41.037822 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6245555-ab8e-483e-87a2-c1c50afd632c None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:41.047127 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 320/634] 10.222.0.17 () {56 vars in 1137 bytes} [Tue Jul 12 13:04:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:04:41.048448 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7e70c-5dd1-42cb-a7a2-41421bd2906b None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:41.048739 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7e70c-5dd1-42cb-a7a2-41421bd2906b None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:41.049022 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7e70c-5dd1-42cb-a7a2-41421bd2906b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:41.069475 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-07e7e70c-5dd1-42cb-a7a2-41421bd2906b None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:41.071251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-07e7e70c-5dd1-42cb-a7a2-41421bd2906b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:41.137654 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:41.143522 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 321/635] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:41.144361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7e70c-5dd1-42cb-a7a2-41421bd2906b None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:41.182647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6245555-ab8e-483e-87a2-c1c50afd632c None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:41.220573 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf17770-8aab-4ccc-ae52-ab840644b69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:41.221250 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf17770-8aab-4ccc-ae52-ab840644b69a None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:41.221595 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf17770-8aab-4ccc-ae52-ab840644b69a None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:41.221882 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf17770-8aab-4ccc-ae52-ab840644b69a None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:41.222750 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf17770-8aab-4ccc-ae52-ab840644b69a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:41.223061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf17770-8aab-4ccc-ae52-ab840644b69a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:41.224483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf17770-8aab-4ccc-ae52-ab840644b69a None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:41.242524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 315/636] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:41.243419 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf17770-8aab-4ccc-ae52-ab840644b69a None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:41.246305 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:41.277845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7e70c-5dd1-42cb-a7a2-41421bd2906b None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:41.313569 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6257ef-b047-4c2d-8663-ff69651aca03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:41.314272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6257ef-b047-4c2d-8663-ff69651aca03 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:41.314629 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6257ef-b047-4c2d-8663-ff69651aca03 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:41.315020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6257ef-b047-4c2d-8663-ff69651aca03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:41.360217 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf17770-8aab-4ccc-ae52-ab840644b69a None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:41.385188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:41.388368 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6257ef-b047-4c2d-8663-ff69651aca03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:41.390624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6257ef-b047-4c2d-8663-ff69651aca03 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:41.406656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cf673-7a45-49f9-b8cc-3589b2d08911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:41.407459 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cf673-7a45-49f9-b8cc-3589b2d08911 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:41.407748 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cf673-7a45-49f9-b8cc-3589b2d08911 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:41.408026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cf673-7a45-49f9-b8cc-3589b2d08911 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:41.419559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7cf673-7a45-49f9-b8cc-3589b2d08911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:41.434439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-ca7cf673-7a45-49f9-b8cc-3589b2d08911 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:41.434439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:41.434439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:41.434439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:41.434439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:41.434439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:41.434439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:41.434439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:41.434439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:41.434439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:41.434439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:41.434439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:41.434439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:41.434439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:41.434439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:41.434439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:41.435631 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:41.435631 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:41.435631 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:41.435631 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:41.435631 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:41.435631 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:41.435631 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:41.435631 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:41.435631 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:41.435631 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:41.435631 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:41.435631 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:41.435631 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:41.435631 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:41.435631 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:41.435631 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:41.436687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:41.436687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:41.436687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:41.436687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:41.436687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:41.436687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:41.436687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:41.436687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:41.436687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:41.436687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:41.436687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:41.436687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:41.440591 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 316/637] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Jul 12 13:04:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:41.441566 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cf673-7a45-49f9-b8cc-3589b2d08911 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:41.501035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 322/638] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:04:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:04:41.501035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b36c3a-187d-4748-8f39-feee3b0983ee None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:41.501035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b36c3a-187d-4748-8f39-feee3b0983ee None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:41.501035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b36c3a-187d-4748-8f39-feee3b0983ee None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:41.501035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 323/639] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:41.501035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b36c3a-187d-4748-8f39-feee3b0983ee None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:41.513345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:41.554190 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cf673-7a45-49f9-b8cc-3589b2d08911 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:41.589585 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198870d-b18e-4d8d-8332-81e9149078ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:41.590617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198870d-b18e-4d8d-8332-81e9149078ab None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:41.591069 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198870d-b18e-4d8d-8332-81e9149078ab None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:41.591515 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198870d-b18e-4d8d-8332-81e9149078ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:41.599020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198870d-b18e-4d8d-8332-81e9149078ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:41.600612 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198870d-b18e-4d8d-8332-81e9149078ab None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:41.603745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:41.608290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b36c3a-187d-4748-8f39-feee3b0983ee None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:41.615746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-3198870d-b18e-4d8d-8332-81e9149078ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:04:41.615746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:41.615746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:41.615746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:41.615746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:41.615746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:41.615746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:41.615746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:41.615746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:41.615746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:41.615746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:41.615746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:41.615746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:04:41.615746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:04:41.615746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:04:41.615746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:04:41.616761 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:41.616761 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:41.616761 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:04:41.616761 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:41.616761 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:04:41.616761 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:41.616761 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:41.616761 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:41.616761 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:41.616761 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:41.616761 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:41.616761 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:41.616761 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:41.616761 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:41.616761 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:41.616761 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:41.616761 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:41.616761 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:41.617721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:41.617721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:41.617721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:04:41.617721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:04:41.617721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:04:41.617721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:04:41.617721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:04:41.617721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:04:41.617721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:04:41.617721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:41.617721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 317/640] 10.222.0.17 () {56 vars in 1093 bytes} [Tue Jul 12 13:04:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:41.617721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198870d-b18e-4d8d-8332-81e9149078ab None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:41.649580 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd549e3-6c6c-4cb6-8aea-b5d19b486208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:41.650285 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd549e3-6c6c-4cb6-8aea-b5d19b486208 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:41.650613 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd549e3-6c6c-4cb6-8aea-b5d19b486208 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:41.650842 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd549e3-6c6c-4cb6-8aea-b5d19b486208 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:41.651581 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd549e3-6c6c-4cb6-8aea-b5d19b486208 None admin] RBAC: Adding query filter params (name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:41.651891 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd549e3-6c6c-4cb6-8aea-b5d19b486208 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:41.653244 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd549e3-6c6c-4cb6-8aea-b5d19b486208 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:41.661189 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 324/641] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Jul 12 13:04:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:41.662429 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689e913-a306-4118-863c-b498b95966a6 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:41.662721 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689e913-a306-4118-863c-b498b95966a6 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:41.662999 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689e913-a306-4118-863c-b498b95966a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:41.682576 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-9689e913-a306-4118-863c-b498b95966a6 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:41.683789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-9689e913-a306-4118-863c-b498b95966a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:41.747944 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198870d-b18e-4d8d-8332-81e9149078ab None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:41.755278 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 325/642] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:41.756402 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689e913-a306-4118-863c-b498b95966a6 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:41.775470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:41.788728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf91f99-1ac0-4d10-9af5-fe24a5b58116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:41.789562 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf91f99-1ac0-4d10-9af5-fe24a5b58116 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:41.789852 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf91f99-1ac0-4d10-9af5-fe24a5b58116 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:41.790147 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf91f99-1ac0-4d10-9af5-fe24a5b58116 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:41.802858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf91f99-1ac0-4d10-9af5-fe24a5b58116 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:41.804891 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf91f99-1ac0-4d10-9af5-fe24a5b58116 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:41.827619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-2bf91f99-1ac0-4d10-9af5-fe24a5b58116 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:41.827619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:41.827619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:41.827619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:41.827619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:41.827619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:41.827619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:41.827619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:41.827619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:41.827619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:41.827619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:41.827619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:41.827619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:41.827619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:41.827619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:41.828722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:41.828722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:41.828722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:41.828722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:41.828722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:41.828722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:41.828722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:41.828722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:41.828722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:41.828722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:41.828722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:41.828722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:41.828722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:41.828722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:41.828722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:41.828722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:41.828722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:41.829720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:41.829720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:41.829720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:41.829720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:41.829720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 318/643] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:41.829720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf91f99-1ac0-4d10-9af5-fe24a5b58116 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:41.872559 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:41.884408 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689e913-a306-4118-863c-b498b95966a6 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:41.924225 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb29fb5-4d03-42fa-b01f-48161137057f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:41.925225 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb29fb5-4d03-42fa-b01f-48161137057f None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:41.925616 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb29fb5-4d03-42fa-b01f-48161137057f None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:41.925854 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb29fb5-4d03-42fa-b01f-48161137057f None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:41.926674 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb29fb5-4d03-42fa-b01f-48161137057f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:41.926995 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb29fb5-4d03-42fa-b01f-48161137057f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:41.928447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb29fb5-4d03-42fa-b01f-48161137057f None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:41.933709 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf91f99-1ac0-4d10-9af5-fe24a5b58116 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:41.950150 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 326/644] 10.222.0.17 () {56 vars in 1133 bytes} [Tue Jul 12 13:04:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:41.950150 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb29fb5-4d03-42fa-b01f-48161137057f None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:41.973765 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2312d-0b69-4f6d-8e67-0cd3ac9c95cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:41.974827 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2312d-0b69-4f6d-8e67-0cd3ac9c95cb None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:41.975523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2312d-0b69-4f6d-8e67-0cd3ac9c95cb None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:41.975806 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2312d-0b69-4f6d-8e67-0cd3ac9c95cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:41.987473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2312d-0b69-4f6d-8e67-0cd3ac9c95cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:41.988913 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2312d-0b69-4f6d-8e67-0cd3ac9c95cb None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:42.006992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-b3e2312d-0b69-4f6d-8e67-0cd3ac9c95cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:42.006992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:42.006992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:42.006992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:42.006992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:42.006992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:42.006992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:42.006992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:42.006992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:42.006992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:42.006992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:42.006992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:42.006992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:42.006992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:42.006992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:42.008436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:42.008436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:42.008436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:42.008436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:42.008436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:42.008436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:42.008436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:42.008436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:42.008436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:42.008436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:42.008436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:42.008436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:42.008436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:42.008436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:42.008436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:42.008436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:42.008436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:42.009491 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:42.009491 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:42.009491 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:42.009491 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:42.013552 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 319/645] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:42.014263 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2312d-0b69-4f6d-8e67-0cd3ac9c95cb None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:42.041534 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:42.057014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb29fb5-4d03-42fa-b01f-48161137057f None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:42.092171 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6563d-5c57-4c97-a76e-fbb81fbf5428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:42.092973 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6563d-5c57-4c97-a76e-fbb81fbf5428 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:42.093257 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6563d-5c57-4c97-a76e-fbb81fbf5428 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:42.093536 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6563d-5c57-4c97-a76e-fbb81fbf5428 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:42.104280 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6563d-5c57-4c97-a76e-fbb81fbf5428 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:42.111932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-25c6563d-5c57-4c97-a76e-fbb81fbf5428 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:42.111932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:42.111932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:42.111932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:42.111932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:42.111932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:42.111932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:42.111932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:42.111932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:42.111932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:42.111932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:42.111932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:42.111932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:42.111932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:42.111932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:42.111932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:42.113054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:42.113054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:42.113054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:42.113054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:42.113054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:42.113054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:42.113054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:42.113054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:42.113054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:42.113054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:42.113054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:42.113054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:42.113054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:42.113054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:42.113054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:42.113054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:42.114077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:42.114077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:42.114077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:42.114077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:42.114077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:42.114077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:42.114077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:42.114077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:42.114077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:42.114077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:42.114077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:42.114077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:42.114077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 327/646] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Jul 12 13:04:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:42.114887 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6563d-5c57-4c97-a76e-fbb81fbf5428 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:42.126935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2312d-0b69-4f6d-8e67-0cd3ac9c95cb None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:42.130395 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:42.167615 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e19eda-4991-46b2-9b26-7d199bf35aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:42.168591 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e19eda-4991-46b2-9b26-7d199bf35aed None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:42.168881 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e19eda-4991-46b2-9b26-7d199bf35aed None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:42.169458 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e19eda-4991-46b2-9b26-7d199bf35aed None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:42.170178 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e19eda-4991-46b2-9b26-7d199bf35aed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:42.170484 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e19eda-4991-46b2-9b26-7d199bf35aed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:42.172383 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e19eda-4991-46b2-9b26-7d199bf35aed None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:42.185042 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 320/647] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:42.189978 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e19eda-4991-46b2-9b26-7d199bf35aed None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:42.231337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6563d-5c57-4c97-a76e-fbb81fbf5428 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:42.266285 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764716d-0d60-44b1-a716-efb8297001f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:42.266950 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764716d-0d60-44b1-a716-efb8297001f4 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:42.267241 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764716d-0d60-44b1-a716-efb8297001f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:42.267521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764716d-0d60-44b1-a716-efb8297001f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:42.278724 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:42.294982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e19eda-4991-46b2-9b26-7d199bf35aed None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:42.333819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf6c27-8ad4-4aec-a1d6-2662177332a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:42.334527 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf6c27-8ad4-4aec-a1d6-2662177332a1 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:42.334816 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf6c27-8ad4-4aec-a1d6-2662177332a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:42.335242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf6c27-8ad4-4aec-a1d6-2662177332a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:42.336922 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf6c27-8ad4-4aec-a1d6-2662177332a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:42.337243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf6c27-8ad4-4aec-a1d6-2662177332a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:42.338729 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf6c27-8ad4-4aec-a1d6-2662177332a1 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:42.342434 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764716d-0d60-44b1-a716-efb8297001f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:42.343893 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764716d-0d60-44b1-a716-efb8297001f4 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:42.355193 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 321/648] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:42.355193 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf6c27-8ad4-4aec-a1d6-2662177332a1 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:42.360668 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:42.459790 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 328/649] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:04:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:04:42.461512 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764716d-0d60-44b1-a716-efb8297001f4 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:42.472125 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf6c27-8ad4-4aec-a1d6-2662177332a1 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:42.525219 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be800ff-2c20-4b33-b47f-15fc78d31615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:42.526397 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be800ff-2c20-4b33-b47f-15fc78d31615 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:42.526693 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be800ff-2c20-4b33-b47f-15fc78d31615 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:42.527232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be800ff-2c20-4b33-b47f-15fc78d31615 None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:42.527988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be800ff-2c20-4b33-b47f-15fc78d31615 None admin] RBAC: Adding query filter params (name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:42.528456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be800ff-2c20-4b33-b47f-15fc78d31615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:42.530149 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be800ff-2c20-4b33-b47f-15fc78d31615 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:42.540655 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 322/650] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Jul 12 13:04:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:42.541461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be800ff-2c20-4b33-b47f-15fc78d31615 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:42.554414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:42.591572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764716d-0d60-44b1-a716-efb8297001f4 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:42.606296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:42.637129 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf58f8d-40e6-440d-a09e-a45b0e9d9c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:42.638231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf58f8d-40e6-440d-a09e-a45b0e9d9c49 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:42.638521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf58f8d-40e6-440d-a09e-a45b0e9d9c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:42.638796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf58f8d-40e6-440d-a09e-a45b0e9d9c49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:42.648573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf58f8d-40e6-440d-a09e-a45b0e9d9c49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:42.648852 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be800ff-2c20-4b33-b47f-15fc78d31615 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:42.650020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf58f8d-40e6-440d-a09e-a45b0e9d9c49 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:42.668115 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-eaf58f8d-40e6-440d-a09e-a45b0e9d9c49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:42.668115 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:42.668115 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:42.668115 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:42.668115 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:42.668115 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:42.668115 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:42.668115 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:42.668115 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:42.668115 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:42.668115 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:42.668115 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:42.668115 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:04:42.668115 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:04:42.668115 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:04:42.669065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:04:42.669065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:42.669065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:42.669065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:42.669065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:42.669065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:42.669065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:42.669065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:42.669065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:42.669065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:42.669065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:42.669065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:42.669065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:42.669065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:42.669065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:42.669065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:42.669065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:42.669940 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:04:42.669940 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:04:42.669940 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:04:42.669940 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:04:42.669940 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:04:42.669940 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:04:42.669940 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:42.669940 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:42.669940 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 329/651] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:42.670471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf58f8d-40e6-440d-a09e-a45b0e9d9c49 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:42.691340 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0317ea-86ab-446b-9e78-76183303afa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:42.692157 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0317ea-86ab-446b-9e78-76183303afa9 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:42.692447 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0317ea-86ab-446b-9e78-76183303afa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:42.692723 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0317ea-86ab-446b-9e78-76183303afa9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:42.700827 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0317ea-86ab-446b-9e78-76183303afa9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:42.702342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0317ea-86ab-446b-9e78-76183303afa9 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:42.717168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-2e0317ea-86ab-446b-9e78-76183303afa9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 13:04:42.717168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:42.717168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:42.717168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:42.717168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:42.717168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:42.717168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:42.717168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:42.717168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:42.717168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:42.717168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:42.717168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:42.717168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:04:42.717168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:04:42.717168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:04:42.717168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:04:42.718375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:42.718375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:42.718375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:04:42.718375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:42.718375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:04:42.718375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:42.718375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:42.718375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:42.718375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:42.718375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:42.718375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:42.718375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:42.718375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:42.718375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:42.718375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:42.718375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:42.718375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:42.718375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:42.719470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:42.719470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:42.719470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:04:42.719470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:04:42.719470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:04:42.719470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:04:42.719470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:04:42.719470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:04:42.719470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 13:04:42.719470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:42.719470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 323/652] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:04:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:42.719470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0317ea-86ab-446b-9e78-76183303afa9 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:42.785684 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf58f8d-40e6-440d-a09e-a45b0e9d9c49 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:42.790772 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:42.822283 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024f541-c5da-409f-822e-bd31e61c2819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:42.823110 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024f541-c5da-409f-822e-bd31e61c2819 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:42.823408 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024f541-c5da-409f-822e-bd31e61c2819 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:42.823693 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024f541-c5da-409f-822e-bd31e61c2819 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:42.826585 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0317ea-86ab-446b-9e78-76183303afa9 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:42.834667 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024f541-c5da-409f-822e-bd31e61c2819 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:42.836635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024f541-c5da-409f-822e-bd31e61c2819 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:42.854837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-e024f541-c5da-409f-822e-bd31e61c2819 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:42.854837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:42.854837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:42.854837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:42.854837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:42.854837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:42.854837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:42.854837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:42.854837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:42.854837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:42.854837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:42.854837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:42.854837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:42.854837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:42.854837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:42.855876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:42.855876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:42.855876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:42.855876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:42.855876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:42.855876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:42.855876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:42.855876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:42.855876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:42.855876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:42.855876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:42.855876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:42.855876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:42.855876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:42.855876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:42.855876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:42.855876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:42.857043 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:42.857043 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:42.857043 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:42.857043 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:42.857043 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 330/653] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:42.857043 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024f541-c5da-409f-822e-bd31e61c2819 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:42.865043 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5aa6e7-6836-4763-a76b-bf09de21b12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:42.865854 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5aa6e7-6836-4763-a76b-bf09de21b12a None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:42.866172 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5aa6e7-6836-4763-a76b-bf09de21b12a None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:42.866456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5aa6e7-6836-4763-a76b-bf09de21b12a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:42.877971 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5aa6e7-6836-4763-a76b-bf09de21b12a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:42.879461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5aa6e7-6836-4763-a76b-bf09de21b12a None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:42.884726 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:42.899061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-3b5aa6e7-6836-4763-a76b-bf09de21b12a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:42.899061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:42.899061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:42.899061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:42.899061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:42.899061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:42.899061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:42.899061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:42.899061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:42.899061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:42.899061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:42.899061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:42.899061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:42.899061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:42.899061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:42.900313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:42.900313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:42.900313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:42.900313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:42.900313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:42.900313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:42.900313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:42.900313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:42.900313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:42.900313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:42.900313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:42.900313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:42.900313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:42.900313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:42.900313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:42.900313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:42.900313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:42.901298 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:42.901298 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:42.901298 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:42.901298 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:42.901298 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 324/654] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:42.901298 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5aa6e7-6836-4763-a76b-bf09de21b12a None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:42.966298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024f541-c5da-409f-822e-bd31e61c2819 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:43.003706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe3f1a-1ad6-49a6-9b3f-c934f47091c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:43.004296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe3f1a-1ad6-49a6-9b3f-c934f47091c4 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:43.004584 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe3f1a-1ad6-49a6-9b3f-c934f47091c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:43.004865 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe3f1a-1ad6-49a6-9b3f-c934f47091c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:43.005657 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe3f1a-1ad6-49a6-9b3f-c934f47091c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:43.005970 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe3f1a-1ad6-49a6-9b3f-c934f47091c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:43.007982 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe3f1a-1ad6-49a6-9b3f-c934f47091c4 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:43.016528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5aa6e7-6836-4763-a76b-bf09de21b12a None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:43.021015 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 331/655] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:04:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:43.023753 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581a856-27f4-46f1-9945-680933438186 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:43.023753 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581a856-27f4-46f1-9945-680933438186 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:43.023753 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581a856-27f4-46f1-9945-680933438186 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:43.024930 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 332/656] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:43.025579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581a856-27f4-46f1-9945-680933438186 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:43.040904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:43.057622 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a06c4-6cd8-49db-a911-10ac2d13b8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:43.058759 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a06c4-6cd8-49db-a911-10ac2d13b8eb None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:43.059084 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a06c4-6cd8-49db-a911-10ac2d13b8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:43.060435 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a06c4-6cd8-49db-a911-10ac2d13b8eb None admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:43.060435 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a06c4-6cd8-49db-a911-10ac2d13b8eb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:43.060630 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a06c4-6cd8-49db-a911-10ac2d13b8eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:43.062516 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a06c4-6cd8-49db-a911-10ac2d13b8eb None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:43.080154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 325/657] 10.222.0.17 () {56 vars in 1137 bytes} [Tue Jul 12 13:04:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:43.080984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a06c4-6cd8-49db-a911-10ac2d13b8eb None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:43.121288 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:43.144312 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581a856-27f4-46f1-9945-680933438186 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:43.185718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a06c4-6cd8-49db-a911-10ac2d13b8eb None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:43.185938 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745710d1-127c-415f-87c3-36a6f1b3d823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:43.186466 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745710d1-127c-415f-87c3-36a6f1b3d823 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:43.186753 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745710d1-127c-415f-87c3-36a6f1b3d823 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:43.187032 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745710d1-127c-415f-87c3-36a6f1b3d823 None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:43.188264 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745710d1-127c-415f-87c3-36a6f1b3d823 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:43.188264 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745710d1-127c-415f-87c3-36a6f1b3d823 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:43.189814 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745710d1-127c-415f-87c3-36a6f1b3d823 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:43.207644 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 333/658] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:43.207644 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745710d1-127c-415f-87c3-36a6f1b3d823 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:43.224112 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d0417-5f68-40ee-9af8-a424b853e61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:43.224787 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d0417-5f68-40ee-9af8-a424b853e61f None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:43.225071 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d0417-5f68-40ee-9af8-a424b853e61f None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:43.225348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d0417-5f68-40ee-9af8-a424b853e61f None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:43.226072 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d0417-5f68-40ee-9af8-a424b853e61f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:43.226412 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d0417-5f68-40ee-9af8-a424b853e61f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:43.227786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d0417-5f68-40ee-9af8-a424b853e61f None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:43.240054 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 326/659] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:43.241303 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b6dff-935b-42a3-8484-17c30ca2789e None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:43.241604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b6dff-935b-42a3-8484-17c30ca2789e None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:43.242392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b6dff-935b-42a3-8484-17c30ca2789e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:43.259157 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-346b6dff-935b-42a3-8484-17c30ca2789e None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:43.260285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-346b6dff-935b-42a3-8484-17c30ca2789e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:43.290944 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:43.324177 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745710d1-127c-415f-87c3-36a6f1b3d823 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:43.331928 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 327/660] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:43.332595 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b6dff-935b-42a3-8484-17c30ca2789e None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:43.364582 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1236133-2fe1-41bf-a847-e6eea94af379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:43.365252 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1236133-2fe1-41bf-a847-e6eea94af379 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:43.365538 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1236133-2fe1-41bf-a847-e6eea94af379 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:43.365819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1236133-2fe1-41bf-a847-e6eea94af379 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:43.367212 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1236133-2fe1-41bf-a847-e6eea94af379 None admin] RBAC: Adding query filter params (role.id=88426002bf1b40c0b59071eaaba38530, scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2, user.id=e8b89afc60864451ba7b5a0a6d190628) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:43.367530 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1236133-2fe1-41bf-a847-e6eea94af379 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:43.368971 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1236133-2fe1-41bf-a847-e6eea94af379 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:43.376172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 334/661] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:04:43 2022] GET /identity/v3/role_assignments?user.id=e8b89afc60864451ba7b5a0a6d190628&scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2&role.id=88426002bf1b40c0b59071eaaba38530 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:43.377266 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1236133-2fe1-41bf-a847-e6eea94af379 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:43.389570 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:43.461426 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b6dff-935b-42a3-8484-17c30ca2789e None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:43.503178 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1bf36-7116-40ee-a06e-3e0baec39b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:43.503861 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1bf36-7116-40ee-a06e-3e0baec39b40 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:43.504149 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1bf36-7116-40ee-a06e-3e0baec39b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:43.504429 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1bf36-7116-40ee-a06e-3e0baec39b40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:43.514968 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1236133-2fe1-41bf-a847-e6eea94af379 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:43.556974 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:43.565589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc00e7a-d986-4fd0-8e19-c0154fc552b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:43.566913 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc00e7a-d986-4fd0-8e19-c0154fc552b6 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:43.567232 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc00e7a-d986-4fd0-8e19-c0154fc552b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:43.567482 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc00e7a-d986-4fd0-8e19-c0154fc552b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:43.577594 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc00e7a-d986-4fd0-8e19-c0154fc552b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:43.579324 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc00e7a-d986-4fd0-8e19-c0154fc552b6 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:43.599754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-ecc00e7a-d986-4fd0-8e19-c0154fc552b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:43.599754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:43.599754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:43.599754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:43.599754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:43.599754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:43.599754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:43.599754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:43.599754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:43.599754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:43.599754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:43.599754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:43.599754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:04:43.599754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:04:43.599754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:04:43.600795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:04:43.600795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:43.600795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:43.600795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:43.600795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:43.600795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:43.600795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:43.600795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:43.600795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:43.600795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:43.600795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:43.600795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:43.600795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:43.600795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:43.600795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:43.600795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:43.600795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:43.602476 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:04:43.602476 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:04:43.602476 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:04:43.602476 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:04:43.602476 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:04:43.602476 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:04:43.602476 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:43.602476 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:43.602936 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1bf36-7116-40ee-a06e-3e0baec39b40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:43.602936 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1bf36-7116-40ee-a06e-3e0baec39b40 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:43.608798 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 335/662] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:43.608798 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc00e7a-d986-4fd0-8e19-c0154fc552b6 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:43.687323 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:43.728178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc00e7a-d986-4fd0-8e19-c0154fc552b6 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:43.739670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 328/663] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:04:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:04:43.740828 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1bf36-7116-40ee-a06e-3e0baec39b40 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:43.770477 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9189662-7eb6-491e-9f92-7e88f6ca16f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:43.771214 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9189662-7eb6-491e-9f92-7e88f6ca16f5 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:43.771562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9189662-7eb6-491e-9f92-7e88f6ca16f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:43.771846 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9189662-7eb6-491e-9f92-7e88f6ca16f5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:43.780346 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9189662-7eb6-491e-9f92-7e88f6ca16f5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:43.781797 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9189662-7eb6-491e-9f92-7e88f6ca16f5 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:43.797740 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-b9189662-7eb6-491e-9f92-7e88f6ca16f5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 13:04:43.797740 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:43.797740 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:43.797740 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:43.797740 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:43.797740 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:43.797740 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:43.797740 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:43.797740 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:43.797740 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:43.797740 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:43.797740 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:43.797740 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:04:43.797740 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:04:43.797740 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:04:43.797740 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:04:43.798884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:43.798884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:43.798884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:04:43.798884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:43.798884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:04:43.798884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:43.798884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:43.798884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:43.798884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:43.798884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:43.798884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:43.798884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:43.798884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:43.798884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:43.798884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:43.798884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:43.798884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:43.798884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:43.799826 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:43.799826 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:43.799826 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:04:43.799826 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:04:43.799826 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:04:43.799826 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:04:43.799826 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:04:43.799826 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:04:43.799826 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 13:04:43.799826 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:43.799826 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 336/664] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Jul 12 13:04:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:43.800462 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9189662-7eb6-491e-9f92-7e88f6ca16f5 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:43.817328 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:43.856170 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1bf36-7116-40ee-a06e-3e0baec39b40 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:43.894868 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967ff54-3b44-4a44-bd0c-04ff51fe0899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:43.895651 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967ff54-3b44-4a44-bd0c-04ff51fe0899 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:43.895941 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967ff54-3b44-4a44-bd0c-04ff51fe0899 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:43.896220 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967ff54-3b44-4a44-bd0c-04ff51fe0899 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:43.907259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9189662-7eb6-491e-9f92-7e88f6ca16f5 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:43.908039 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967ff54-3b44-4a44-bd0c-04ff51fe0899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:43.916396 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-6967ff54-3b44-4a44-bd0c-04ff51fe0899 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:43.916396 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:43.916396 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:43.916396 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:43.916396 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:43.916396 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:43.916396 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:43.916396 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:43.916396 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:43.916396 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:43.916396 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:43.916396 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:43.916396 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:43.916396 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:43.916396 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:43.916396 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:43.917332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:43.917332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:43.917332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:43.917332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:43.917332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:43.917332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:43.917332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:43.917332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:43.917332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:43.917332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:43.917332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:43.917332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:43.917332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:43.917332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:43.917332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:43.917332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:43.918313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:43.918313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:43.918313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:43.918313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:43.918313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:43.918313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:43.918313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:43.918313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:43.918313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:43.918313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:43.918313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:43.918313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:43.922262 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 329/665] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Jul 12 13:04:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:43.923425 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967ff54-3b44-4a44-bd0c-04ff51fe0899 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:43.938467 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:43.947485 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748e7d9-fae5-4047-9397-c7ccca423c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:43.948161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e7d9-fae5-4047-9397-c7ccca423c18 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:43.948447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e7d9-fae5-4047-9397-c7ccca423c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:43.948726 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e7d9-fae5-4047-9397-c7ccca423c18 None admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:43.949514 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748e7d9-fae5-4047-9397-c7ccca423c18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:43.949825 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748e7d9-fae5-4047-9397-c7ccca423c18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:43.951295 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748e7d9-fae5-4047-9397-c7ccca423c18 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:43.963981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 337/666] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:04:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:43.964804 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748e7d9-fae5-4047-9397-c7ccca423c18 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:44.035178 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967ff54-3b44-4a44-bd0c-04ff51fe0899 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:44.063967 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:44.072825 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7e191-7ab6-4b9c-b615-77f816b3cc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:44.073630 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7e191-7ab6-4b9c-b615-77f816b3cc93 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:44.073915 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7e191-7ab6-4b9c-b615-77f816b3cc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:44.074215 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7e191-7ab6-4b9c-b615-77f816b3cc93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:44.077682 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748e7d9-fae5-4047-9397-c7ccca423c18 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:44.085106 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7e191-7ab6-4b9c-b615-77f816b3cc93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:44.087147 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7e191-7ab6-4b9c-b615-77f816b3cc93 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:44.105261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-29a7e191-7ab6-4b9c-b615-77f816b3cc93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:44.105261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:44.105261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:44.105261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:44.105261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:44.105261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:44.105261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:44.105261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:44.105261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:44.105261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:44.105261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:44.105261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:44.105261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:44.105261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:44.105261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:44.106429 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:44.106429 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:44.106429 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:44.106429 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:44.106429 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:44.106429 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:44.106429 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:44.106429 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:44.106429 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:44.106429 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:44.106429 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:44.106429 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:44.106429 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:44.106429 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:44.106429 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:44.106429 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:44.106429 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:44.107344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:44.107344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:44.107344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:44.107344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:44.107344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 330/667] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:44.107344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7e191-7ab6-4b9c-b615-77f816b3cc93 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:44.122227 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3930594-2dda-4bc6-8d8e-9773d1c04c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:44.122918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3930594-2dda-4bc6-8d8e-9773d1c04c06 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:44.123203 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3930594-2dda-4bc6-8d8e-9773d1c04c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:44.123483 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3930594-2dda-4bc6-8d8e-9773d1c04c06 None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:44.124317 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3930594-2dda-4bc6-8d8e-9773d1c04c06 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:44.124634 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3930594-2dda-4bc6-8d8e-9773d1c04c06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:44.126085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3930594-2dda-4bc6-8d8e-9773d1c04c06 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:44.144740 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 338/668] 10.222.0.17 () {56 vars in 1139 bytes} [Tue Jul 12 13:04:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:44.147159 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3930594-2dda-4bc6-8d8e-9773d1c04c06 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:44.203101 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:44.221365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7e191-7ab6-4b9c-b615-77f816b3cc93 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:44.256012 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725eef52-62da-432b-8a30-c22bb1a4fcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:44.256698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725eef52-62da-432b-8a30-c22bb1a4fcfe None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:44.257054 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725eef52-62da-432b-8a30-c22bb1a4fcfe None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:44.257332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725eef52-62da-432b-8a30-c22bb1a4fcfe None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:44.258082 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725eef52-62da-432b-8a30-c22bb1a4fcfe None admin] RBAC: Adding query filter params (name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:44.258418 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725eef52-62da-432b-8a30-c22bb1a4fcfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:44.259775 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725eef52-62da-432b-8a30-c22bb1a4fcfe None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:44.264404 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3930594-2dda-4bc6-8d8e-9773d1c04c06 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:44.268281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 331/669] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Jul 12 13:04:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:44.269075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725eef52-62da-432b-8a30-c22bb1a4fcfe None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:44.306361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c00d6-10ff-4d8c-bbe0-900564c01908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:44.306941 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c00d6-10ff-4d8c-bbe0-900564c01908 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:44.307223 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c00d6-10ff-4d8c-bbe0-900564c01908 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:44.307495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c00d6-10ff-4d8c-bbe0-900564c01908 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:44.308319 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c00d6-10ff-4d8c-bbe0-900564c01908 None admin] RBAC: Adding query filter params (role.id=88426002bf1b40c0b59071eaaba38530, scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2, user.id=e52dfce1b06346bfbde6ee33e7f6f249) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:44.309196 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c00d6-10ff-4d8c-bbe0-900564c01908 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:44.310037 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c00d6-10ff-4d8c-bbe0-900564c01908 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:44.326156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 339/670] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:04:44 2022] GET /identity/v3/role_assignments?user.id=e52dfce1b06346bfbde6ee33e7f6f249&scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2&role.id=88426002bf1b40c0b59071eaaba38530 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:44.326156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c00d6-10ff-4d8c-bbe0-900564c01908 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:44.328832 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:44.406728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725eef52-62da-432b-8a30-c22bb1a4fcfe None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:44.449952 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60198c-3068-407f-b28f-ea359b6472fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:44.450770 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60198c-3068-407f-b28f-ea359b6472fc None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:44.451156 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60198c-3068-407f-b28f-ea359b6472fc None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:44.451500 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60198c-3068-407f-b28f-ea359b6472fc None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:44.452330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60198c-3068-407f-b28f-ea359b6472fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:44.452706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60198c-3068-407f-b28f-ea359b6472fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:44.454248 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60198c-3068-407f-b28f-ea359b6472fc None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:44.464364 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c00d6-10ff-4d8c-bbe0-900564c01908 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:44.470089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 332/671] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:44.471345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60198c-3068-407f-b28f-ea359b6472fc None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:44.477025 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:44.518565 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d085b5-0ba5-4789-a0c9-40664925d318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:44.519296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d085b5-0ba5-4789-a0c9-40664925d318 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:44.519579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d085b5-0ba5-4789-a0c9-40664925d318 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:44.519921 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d085b5-0ba5-4789-a0c9-40664925d318 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:44.614410 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60198c-3068-407f-b28f-ea359b6472fc None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:44.615826 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:44.619391 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d085b5-0ba5-4789-a0c9-40664925d318 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:44.622236 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d085b5-0ba5-4789-a0c9-40664925d318 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:44.669091 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997a5cb-bca8-4043-86b5-39b26a438364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:44.670476 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997a5cb-bca8-4043-86b5-39b26a438364 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:44.671037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997a5cb-bca8-4043-86b5-39b26a438364 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:44.671618 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997a5cb-bca8-4043-86b5-39b26a438364 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:44.691450 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997a5cb-bca8-4043-86b5-39b26a438364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:44.693468 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997a5cb-bca8-4043-86b5-39b26a438364 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:44.714492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-f997a5cb-bca8-4043-86b5-39b26a438364 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:44.714492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:44.714492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:44.714492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:44.714492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:44.714492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:44.714492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:44.714492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:44.714492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:44.714492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:44.714492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:44.714492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:44.714492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:44.714492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:44.714492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:44.715442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:44.715442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:44.715442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:44.715442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:44.715442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:44.715442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:44.715442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:44.715442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:44.715442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:44.715442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:44.715442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:44.715442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:44.715442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:44.715442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:44.715442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:44.715442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:44.715442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:44.716468 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:44.716468 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:44.716468 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:44.716468 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:44.718486 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 333/672] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:44.724401 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997a5cb-bca8-4043-86b5-39b26a438364 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:44.747924 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 340/673] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:04:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:04:44.748829 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d085b5-0ba5-4789-a0c9-40664925d318 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:44.765263 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:44.840605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997a5cb-bca8-4043-86b5-39b26a438364 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:44.873092 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d085b5-0ba5-4789-a0c9-40664925d318 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:44.891449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4567886-f2c6-4b50-b9cb-b551ec7c39a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:44.892584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4567886-f2c6-4b50-b9cb-b551ec7c39a6 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:44.893077 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4567886-f2c6-4b50-b9cb-b551ec7c39a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:44.893526 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4567886-f2c6-4b50-b9cb-b551ec7c39a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:44.901949 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4567886-f2c6-4b50-b9cb-b551ec7c39a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:44.903714 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4567886-f2c6-4b50-b9cb-b551ec7c39a6 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:44.940719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-c4567886-f2c6-4b50-b9cb-b551ec7c39a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:44.940719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:44.940719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:44.940719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:44.940719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:44.940719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:44.940719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:44.940719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:44.940719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:44.940719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:44.940719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:44.940719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:44.940719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:04:44.940719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:04:44.940719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:04:44.941719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:04:44.941719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:44.941719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:44.941719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:44.941719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:44.941719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:44.941719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:44.941719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:44.941719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:44.941719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:44.941719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:44.941719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:44.941719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:44.941719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:44.941719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:44.941719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:44.941719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:44.942678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:04:44.942678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:04:44.942678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:04:44.942678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:04:44.942678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:04:44.942678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:04:44.942678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:44.942678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:44.950481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 334/674] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:44.951591 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4567886-f2c6-4b50-b9cb-b551ec7c39a6 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:44.951703 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a14baf-781d-45e1-afe2-35671c4cf6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:44.952317 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a14baf-781d-45e1-afe2-35671c4cf6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:44.952606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a14baf-781d-45e1-afe2-35671c4cf6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:44.952880 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a14baf-781d-45e1-afe2-35671c4cf6d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:44.953615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a14baf-781d-45e1-afe2-35671c4cf6d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:44.953920 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a14baf-781d-45e1-afe2-35671c4cf6d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:44.955319 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a14baf-781d-45e1-afe2-35671c4cf6d4 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:44.973586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 341/675] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:44.973586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a14baf-781d-45e1-afe2-35671c4cf6d4 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:44.979269 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:45.097225 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:45.106928 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4567886-f2c6-4b50-b9cb-b551ec7c39a6 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:45.152294 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fe96a-a9a9-4da9-b3da-fbf07fc422c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:45.153684 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fe96a-a9a9-4da9-b3da-fbf07fc422c6 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:45.154217 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fe96a-a9a9-4da9-b3da-fbf07fc422c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:45.154729 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fe96a-a9a9-4da9-b3da-fbf07fc422c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:45.167011 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fe96a-a9a9-4da9-b3da-fbf07fc422c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:45.168960 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fe96a-a9a9-4da9-b3da-fbf07fc422c6 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:45.183944 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a14baf-781d-45e1-afe2-35671c4cf6d4 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:45.189604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-5a1fe96a-a9a9-4da9-b3da-fbf07fc422c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:45.189604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:45.189604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:45.189604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:45.189604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:45.189604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:45.189604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:45.189604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:45.189604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:45.189604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:45.189604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:45.189604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:45.189604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:45.189604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:45.189604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:45.190563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:45.190563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:45.190563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:45.190563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:45.190563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:45.190563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:45.190563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:45.190563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:45.190563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:45.190563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:45.190563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:45.190563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:45.190563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:45.190563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:45.190563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:45.190563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:45.190563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:45.191505 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:45.191505 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:45.191505 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:45.191505 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:45.198376 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 335/676] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:45.199685 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fe96a-a9a9-4da9-b3da-fbf07fc422c6 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:45.277436 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9a99c-05d3-4d63-ae3b-70cd2c7d0e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:45.278632 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9a99c-05d3-4d63-ae3b-70cd2c7d0e03 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:45.278922 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9a99c-05d3-4d63-ae3b-70cd2c7d0e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:45.279365 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9a99c-05d3-4d63-ae3b-70cd2c7d0e03 None admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:45.280767 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9a99c-05d3-4d63-ae3b-70cd2c7d0e03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:45.281191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9a99c-05d3-4d63-ae3b-70cd2c7d0e03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:45.282796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9a99c-05d3-4d63-ae3b-70cd2c7d0e03 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:45.287661 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:45.318742 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 342/677] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:04:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:45.318742 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9a99c-05d3-4d63-ae3b-70cd2c7d0e03 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:45.334365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fe96a-a9a9-4da9-b3da-fbf07fc422c6 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:45.377876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455002a-1ef2-4997-9d73-6aeaae51146a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:45.379362 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455002a-1ef2-4997-9d73-6aeaae51146a None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:45.380127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455002a-1ef2-4997-9d73-6aeaae51146a None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:45.380741 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455002a-1ef2-4997-9d73-6aeaae51146a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:45.392601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455002a-1ef2-4997-9d73-6aeaae51146a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:45.394748 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455002a-1ef2-4997-9d73-6aeaae51146a None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:45.413120 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-f455002a-1ef2-4997-9d73-6aeaae51146a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 13:04:45.413120 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:45.413120 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:45.413120 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:45.413120 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:45.413120 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:45.413120 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:45.413120 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:45.413120 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:45.413120 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:45.413120 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:45.413120 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:45.413120 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:04:45.413120 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:04:45.413120 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:04:45.413120 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:04:45.414897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:45.414897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:45.414897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:04:45.414897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:45.414897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:04:45.414897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:45.414897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:45.414897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:45.414897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:45.414897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:45.414897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:45.414897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:45.414897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:45.414897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:45.414897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:45.414897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:45.414897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:45.414897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:45.415874 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:45.415874 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:45.415874 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:04:45.415874 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:04:45.415874 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:04:45.415874 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:04:45.415874 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:04:45.415874 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:04:45.415874 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 13:04:45.415874 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:45.415874 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 336/678] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:04:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:45.416889 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455002a-1ef2-4997-9d73-6aeaae51146a None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:45.532237 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9a99c-05d3-4d63-ae3b-70cd2c7d0e03 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:45.566457 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:45.576743 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bab847-e099-4ca4-b9f6-1277d12c847e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:45.577430 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bab847-e099-4ca4-b9f6-1277d12c847e None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:45.577716 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bab847-e099-4ca4-b9f6-1277d12c847e None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:45.577997 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bab847-e099-4ca4-b9f6-1277d12c847e None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:45.578848 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bab847-e099-4ca4-b9f6-1277d12c847e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:45.579118 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bab847-e099-4ca4-b9f6-1277d12c847e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:45.580536 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bab847-e099-4ca4-b9f6-1277d12c847e None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:45.587683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455002a-1ef2-4997-9d73-6aeaae51146a None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:45.593300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 343/679] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:45.594176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bab847-e099-4ca4-b9f6-1277d12c847e None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:45.623068 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:45.634821 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d952325-a7b6-48ca-a7b1-115426e9cd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:45.635582 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d952325-a7b6-48ca-a7b1-115426e9cd7d None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:45.636183 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d952325-a7b6-48ca-a7b1-115426e9cd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:45.636531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d952325-a7b6-48ca-a7b1-115426e9cd7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:45.637440 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d952325-a7b6-48ca-a7b1-115426e9cd7d None admin] RBAC: Adding query filter params (role.id=88426002bf1b40c0b59071eaaba38530, scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2, user.id=f7af0259f7f24dfdafbdfc1f613ebb42) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:45.637753 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d952325-a7b6-48ca-a7b1-115426e9cd7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:45.639279 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d952325-a7b6-48ca-a7b1-115426e9cd7d None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:45.650580 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 337/680] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:04:45 2022] GET /identity/v3/role_assignments?user.id=f7af0259f7f24dfdafbdfc1f613ebb42&scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2&role.id=88426002bf1b40c0b59071eaaba38530 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:45.652642 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebd9a0-41d7-4bd3-b52e-e08b6321e0ba None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:45.652945 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebd9a0-41d7-4bd3-b52e-e08b6321e0ba None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:45.653211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebd9a0-41d7-4bd3-b52e-e08b6321e0ba None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:45.654972 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 338/681] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:45.656260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebd9a0-41d7-4bd3-b52e-e08b6321e0ba None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:45.746220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bab847-e099-4ca4-b9f6-1277d12c847e None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:45.801411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2d99a-980f-4032-8535-31a1c5505058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:45.802149 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2d99a-980f-4032-8535-31a1c5505058 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:45.802444 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2d99a-980f-4032-8535-31a1c5505058 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:45.802742 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2d99a-980f-4032-8535-31a1c5505058 None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:45.803879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2d99a-980f-4032-8535-31a1c5505058 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:45.804833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2d99a-980f-4032-8535-31a1c5505058 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:45.807162 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2d99a-980f-4032-8535-31a1c5505058 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:45.809850 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebd9a0-41d7-4bd3-b52e-e08b6321e0ba None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:45.838061 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 344/682] 10.222.0.17 () {56 vars in 1135 bytes} [Tue Jul 12 13:04:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:45.839031 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ccc15-d30d-4e87-89f9-e50ed7ea4940 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:45.839331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ccc15-d30d-4e87-89f9-e50ed7ea4940 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:45.839612 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ccc15-d30d-4e87-89f9-e50ed7ea4940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:45.861933 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-6a0ccc15-d30d-4e87-89f9-e50ed7ea4940 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:45.863180 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-6a0ccc15-d30d-4e87-89f9-e50ed7ea4940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:45.870154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae727f-b95a-4e44-856f-bc57328a73dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:45.871289 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae727f-b95a-4e44-856f-bc57328a73dc None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:45.871579 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae727f-b95a-4e44-856f-bc57328a73dc None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:45.871858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae727f-b95a-4e44-856f-bc57328a73dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:45.883868 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae727f-b95a-4e44-856f-bc57328a73dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:45.886527 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae727f-b95a-4e44-856f-bc57328a73dc None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:45.907041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-f9ae727f-b95a-4e44-856f-bc57328a73dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:45.907041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:45.907041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:45.907041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:45.907041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:45.907041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:45.907041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:45.907041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:45.907041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:45.907041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:45.907041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:45.907041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:45.907041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:04:45.907041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:04:45.907041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:04:45.908164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:04:45.908164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:45.908164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:45.908164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:45.908164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:45.908164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:45.908164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:45.908164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:45.908164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:45.908164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:45.908164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:45.908164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:45.908164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:45.908164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:45.908164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:45.908164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:45.908164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:45.909129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:04:45.909129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:04:45.909129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:04:45.909129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:04:45.909129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:04:45.909129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:04:45.909129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:45.909129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:45.911397 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 339/683] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:45.912528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae727f-b95a-4e44-856f-bc57328a73dc None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:45.925059 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:45.966712 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 345/684] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:45.967716 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ccc15-d30d-4e87-89f9-e50ed7ea4940 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:46.002972 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:46.083073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae727f-b95a-4e44-856f-bc57328a73dc None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:46.122251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ccc15-d30d-4e87-89f9-e50ed7ea4940 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:46.129491 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99346544-d5fd-4498-8e04-fd62b6d8bba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:46.130191 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99346544-d5fd-4498-8e04-fd62b6d8bba0 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:46.130514 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99346544-d5fd-4498-8e04-fd62b6d8bba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:46.130858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99346544-d5fd-4498-8e04-fd62b6d8bba0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:46.176098 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5bb56-4e68-4f8d-ba75-35570c088b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:46.176812 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5bb56-4e68-4f8d-ba75-35570c088b03 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:46.177103 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5bb56-4e68-4f8d-ba75-35570c088b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:46.177385 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5bb56-4e68-4f8d-ba75-35570c088b03 None admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:46.178225 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5bb56-4e68-4f8d-ba75-35570c088b03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:46.178572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5bb56-4e68-4f8d-ba75-35570c088b03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:46.183206 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5bb56-4e68-4f8d-ba75-35570c088b03 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:46.200234 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 346/685] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:04:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:46.201741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5bb56-4e68-4f8d-ba75-35570c088b03 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:46.223350 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99346544-d5fd-4498-8e04-fd62b6d8bba0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:46.225127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99346544-d5fd-4498-8e04-fd62b6d8bba0 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:46.252044 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:46.303486 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:46.342821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5bb56-4e68-4f8d-ba75-35570c088b03 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:46.368977 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 340/686] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:04:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:04:46.369929 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99346544-d5fd-4498-8e04-fd62b6d8bba0 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:46.382185 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5d20d-9282-4ddc-ad04-dd79d15f1297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:46.383705 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5d20d-9282-4ddc-ad04-dd79d15f1297 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:46.384132 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5d20d-9282-4ddc-ad04-dd79d15f1297 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:46.384503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5d20d-9282-4ddc-ad04-dd79d15f1297 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:46.385255 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5d20d-9282-4ddc-ad04-dd79d15f1297 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:46.387038 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5d20d-9282-4ddc-ad04-dd79d15f1297 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:46.401718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-eec5d20d-9282-4ddc-ad04-dd79d15f1297 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 13:04:46.401718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:46.401718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:04:46.401718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:04:46.401718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:04:46.401718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:04:46.401718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:04:46.401718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:04:46.401718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 13:04:46.401718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:46.401718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:04:46.401718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:46.401718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:46.401718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:46.401718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:46.401718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:46.402947 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:46.402947 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:46.402947 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:46.402947 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:46.402947 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:46.402947 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:46.402947 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:46.402947 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:04:46.402947 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:04:46.402947 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:04:46.402947 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:04:46.402947 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:46.402947 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:46.402947 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:46.402947 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:46.402947 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:46.403990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:46.403990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:46.403990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:46.403990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:46.403990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:46.403990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:46.403990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:46.403990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:46.403990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:46.403990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:46.403990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:46.403990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:04:46.403990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:04:46.403990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 13:04:46.403990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:46.407461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 347/687] 10.222.0.17 () {56 vars in 1129 bytes} [Tue Jul 12 13:04:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:46.407461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5d20d-9282-4ddc-ad04-dd79d15f1297 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:46.498397 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99346544-d5fd-4498-8e04-fd62b6d8bba0 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:46.536927 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:46.542618 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5d20d-9282-4ddc-ad04-dd79d15f1297 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:46.549270 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148820a4-d021-4111-9d96-a40a32c790b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:46.549941 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148820a4-d021-4111-9d96-a40a32c790b5 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:46.550256 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148820a4-d021-4111-9d96-a40a32c790b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:46.550538 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148820a4-d021-4111-9d96-a40a32c790b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:46.551374 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148820a4-d021-4111-9d96-a40a32c790b5 None admin] RBAC: Adding query filter params (role.id=88426002bf1b40c0b59071eaaba38530, scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2, user.id=0f39694be5f447f9a25dacf7e4c99a4d) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:46.551684 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148820a4-d021-4111-9d96-a40a32c790b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:46.553118 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148820a4-d021-4111-9d96-a40a32c790b5 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:46.562216 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 341/688] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:04:46 2022] GET /identity/v3/role_assignments?user.id=0f39694be5f447f9a25dacf7e4c99a4d&scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2&role.id=88426002bf1b40c0b59071eaaba38530 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:46.563451 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148820a4-d021-4111-9d96-a40a32c790b5 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:46.587181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:46.600529 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed0669-bd41-46c9-b238-acfc7009221e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:46.602375 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed0669-bd41-46c9-b238-acfc7009221e None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:46.602808 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed0669-bd41-46c9-b238-acfc7009221e None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:46.603319 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed0669-bd41-46c9-b238-acfc7009221e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:46.620495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed0669-bd41-46c9-b238-acfc7009221e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:46.622933 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed0669-bd41-46c9-b238-acfc7009221e None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:46.650344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-32ed0669-bd41-46c9-b238-acfc7009221e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:46.650344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:46.650344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:46.650344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:46.650344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:46.650344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:46.650344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:46.650344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:46.650344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:46.650344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:46.650344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:46.650344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:46.650344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:46.650344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:46.650344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:46.652038 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:46.652038 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:46.652038 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:46.652038 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:46.652038 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:46.652038 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:46.652038 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:46.652038 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:46.652038 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:46.652038 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:46.652038 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:46.652038 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:46.652038 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:46.652038 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:46.652038 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:46.652038 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:46.652038 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:46.653673 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:46.653673 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:46.653673 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:46.653673 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:46.656472 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 348/689] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:46.658928 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69818f18-2b07-4b1c-8f5d-942930550ff0 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:46.659465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69818f18-2b07-4b1c-8f5d-942930550ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:46.659973 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69818f18-2b07-4b1c-8f5d-942930550ff0 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:46.662464 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 349/690] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:46.663692 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69818f18-2b07-4b1c-8f5d-942930550ff0 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:46.709260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148820a4-d021-4111-9d96-a40a32c790b5 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:46.768295 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc892da6-5278-4011-a2ff-c30eb66a5e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:46.769309 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc892da6-5278-4011-a2ff-c30eb66a5e94 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:46.769593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc892da6-5278-4011-a2ff-c30eb66a5e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:46.769954 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc892da6-5278-4011-a2ff-c30eb66a5e94 None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:46.770967 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc892da6-5278-4011-a2ff-c30eb66a5e94 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:46.771492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc892da6-5278-4011-a2ff-c30eb66a5e94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:46.773916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc892da6-5278-4011-a2ff-c30eb66a5e94 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:46.784423 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 342/691] 10.222.0.17 () {56 vars in 1124 bytes} [Tue Jul 12 13:04:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:46.785877 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e214af-f3e7-4e7e-af34-4a24f1392886 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:46.786193 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e214af-f3e7-4e7e-af34-4a24f1392886 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:46.786484 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e214af-f3e7-4e7e-af34-4a24f1392886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:46.806297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-87e214af-f3e7-4e7e-af34-4a24f1392886 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:46.807516 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-87e214af-f3e7-4e7e-af34-4a24f1392886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:46.828140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69818f18-2b07-4b1c-8f5d-942930550ff0 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:46.884945 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941658cf-4c12-448e-af7d-610d7e73e787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:46.885636 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941658cf-4c12-448e-af7d-610d7e73e787 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:46.886303 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941658cf-4c12-448e-af7d-610d7e73e787 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:46.886616 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941658cf-4c12-448e-af7d-610d7e73e787 None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:46.887922 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941658cf-4c12-448e-af7d-610d7e73e787 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:46.888962 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941658cf-4c12-448e-af7d-610d7e73e787 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:46.891187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941658cf-4c12-448e-af7d-610d7e73e787 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:46.904439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 343/692] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:46.906486 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e214af-f3e7-4e7e-af34-4a24f1392886 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:46.906708 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 350/693] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:46.912160 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941658cf-4c12-448e-af7d-610d7e73e787 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:46.919580 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:46.937622 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:47.022062 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e214af-f3e7-4e7e-af34-4a24f1392886 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:47.034028 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941658cf-4c12-448e-af7d-610d7e73e787 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:47.058796 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a560d9e-9b06-4fcc-8f1b-c95ec41b87a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:47.059482 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a560d9e-9b06-4fcc-8f1b-c95ec41b87a7 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:47.059772 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a560d9e-9b06-4fcc-8f1b-c95ec41b87a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:47.060047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a560d9e-9b06-4fcc-8f1b-c95ec41b87a7 None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:47.060761 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a560d9e-9b06-4fcc-8f1b-c95ec41b87a7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:47.061077 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a560d9e-9b06-4fcc-8f1b-c95ec41b87a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:47.062491 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a560d9e-9b06-4fcc-8f1b-c95ec41b87a7 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:47.068736 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 344/694] 10.222.0.17 () {56 vars in 1124 bytes} [Tue Jul 12 13:04:46 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:47.069677 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a560d9e-9b06-4fcc-8f1b-c95ec41b87a7 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:47.072882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e645e-46d0-4934-8dad-00e251a3a5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:47.073816 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e645e-46d0-4934-8dad-00e251a3a5cd None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:47.074129 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e645e-46d0-4934-8dad-00e251a3a5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:47.074485 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e645e-46d0-4934-8dad-00e251a3a5cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:47.082855 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e645e-46d0-4934-8dad-00e251a3a5cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:47.084464 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e645e-46d0-4934-8dad-00e251a3a5cd None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:47.101926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-5c3e645e-46d0-4934-8dad-00e251a3a5cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:47.101926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:47.101926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:47.101926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:47.101926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:47.101926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:47.101926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:47.101926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:47.101926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:47.101926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:47.101926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:47.101926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:47.101926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:04:47.101926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:04:47.101926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:04:47.102943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:04:47.102943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:47.102943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:47.102943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:47.102943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:47.102943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:47.102943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:47.102943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:47.102943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:47.102943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:47.102943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:47.102943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:47.102943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:47.102943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:47.102943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:47.102943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:47.102943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:47.103819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:04:47.103819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:04:47.103819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:04:47.103819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:04:47.103819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:04:47.103819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:04:47.103819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:47.103819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:47.103819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 351/695] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:47.115342 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e645e-46d0-4934-8dad-00e251a3a5cd None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:47.156227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:47.190825 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a560d9e-9b06-4fcc-8f1b-c95ec41b87a7 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:47.261145 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0e0e6-9bf1-477c-b73d-71b4ef481e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:47.261965 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0e0e6-9bf1-477c-b73d-71b4ef481e1b None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:47.262283 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0e0e6-9bf1-477c-b73d-71b4ef481e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:47.262565 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0e0e6-9bf1-477c-b73d-71b4ef481e1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:47.267236 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:47.275241 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0e0e6-9bf1-477c-b73d-71b4ef481e1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:47.282885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-3bf0e0e6-9bf1-477c-b73d-71b4ef481e1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:04:47.282885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:47.282885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:47.282885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:47.282885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:47.282885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:47.282885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:47.282885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:47.282885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:47.282885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:47.282885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:47.282885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:47.282885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:47.282885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:47.282885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:47.282885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:47.283851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:47.283851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:47.283851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:47.283851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:47.283851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:47.283851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:47.283851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:47.283851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:47.283851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:47.283851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:47.283851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:47.283851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:47.283851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:47.283851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:47.283851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:47.283851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:47.284678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:47.284678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:47.284678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:47.284678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:47.284678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:47.284678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:47.284678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:47.284678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:47.284678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:47.284678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:47.284678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:04:47.284678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:47.284678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 345/696] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:04:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:47.289881 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0e0e6-9bf1-477c-b73d-71b4ef481e1b None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:47.317079 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e645e-46d0-4934-8dad-00e251a3a5cd None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:47.372045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc2d84-8fda-4ec6-b05d-09aaa25f8ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:47.372872 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc2d84-8fda-4ec6-b05d-09aaa25f8ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:47.373366 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc2d84-8fda-4ec6-b05d-09aaa25f8ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:47.373848 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc2d84-8fda-4ec6-b05d-09aaa25f8ca1 None admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:47.377532 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc2d84-8fda-4ec6-b05d-09aaa25f8ca1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:47.377861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc2d84-8fda-4ec6-b05d-09aaa25f8ca1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:47.379551 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc2d84-8fda-4ec6-b05d-09aaa25f8ca1 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:47.410857 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 352/697] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:04:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:47.431662 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc2d84-8fda-4ec6-b05d-09aaa25f8ca1 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:47.456032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0e0e6-9bf1-477c-b73d-71b4ef481e1b None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:47.526616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:47.533609 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38df91-a4b1-453c-b1d3-eca9255a1bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:47.534327 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38df91-a4b1-453c-b1d3-eca9255a1bea None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:47.534617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38df91-a4b1-453c-b1d3-eca9255a1bea None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:47.534897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38df91-a4b1-453c-b1d3-eca9255a1bea None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:47.535654 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38df91-a4b1-453c-b1d3-eca9255a1bea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:47.536798 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38df91-a4b1-453c-b1d3-eca9255a1bea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:47.540638 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38df91-a4b1-453c-b1d3-eca9255a1bea None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:47.559267 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 346/698] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:04:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:47.563997 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38df91-a4b1-453c-b1d3-eca9255a1bea None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:47.644384 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc2d84-8fda-4ec6-b05d-09aaa25f8ca1 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:47.714259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:47.717811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d662516-19bc-4626-b10e-8186dc9aa010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:47.718508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d662516-19bc-4626-b10e-8186dc9aa010 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:47.718790 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d662516-19bc-4626-b10e-8186dc9aa010 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:47.719068 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d662516-19bc-4626-b10e-8186dc9aa010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:47.719905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d662516-19bc-4626-b10e-8186dc9aa010 None admin] RBAC: Adding query filter params (role.id=88426002bf1b40c0b59071eaaba38530, scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2, user.id=fe10f0f42b8247c99ed5f88eff5065e3) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:47.720217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d662516-19bc-4626-b10e-8186dc9aa010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:47.722630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d662516-19bc-4626-b10e-8186dc9aa010 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:47.736387 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 353/699] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:04:47 2022] GET /identity/v3/role_assignments?user.id=fe10f0f42b8247c99ed5f88eff5065e3&scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2&role.id=88426002bf1b40c0b59071eaaba38530 => generated 608 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:47.751966 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38df91-a4b1-453c-b1d3-eca9255a1bea None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:47.797933 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96dc5de-6bac-43ac-af45-1d4beddd756f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:47.798694 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96dc5de-6bac-43ac-af45-1d4beddd756f None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:47.798980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96dc5de-6bac-43ac-af45-1d4beddd756f None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:47.799254 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96dc5de-6bac-43ac-af45-1d4beddd756f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:47.813891 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96dc5de-6bac-43ac-af45-1d4beddd756f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:47.815516 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96dc5de-6bac-43ac-af45-1d4beddd756f None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:47.834843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-c96dc5de-6bac-43ac-af45-1d4beddd756f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:47.834843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:47.834843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:47.834843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:47.834843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:47.834843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:47.834843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:47.834843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:47.834843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:47.834843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:47.834843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:47.834843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:47.834843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:47.834843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:47.834843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:47.836323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:47.836323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:47.836323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:47.836323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:47.836323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:47.836323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:47.836323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:47.836323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:47.836323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:47.836323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:47.836323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:47.836323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:47.836323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:47.836323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:47.836323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:47.836323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:47.836323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:47.837222 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:47.837222 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:47.837222 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:47.837222 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:47.837222 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 347/700] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:47.843272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d662516-19bc-4626-b10e-8186dc9aa010 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:47.978716 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d662516-19bc-4626-b10e-8186dc9aa010 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:48.015006 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646180d5-cce1-433e-a44f-87687d4502da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:48.015698 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646180d5-cce1-433e-a44f-87687d4502da None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:48.015984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646180d5-cce1-433e-a44f-87687d4502da None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:48.016262 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646180d5-cce1-433e-a44f-87687d4502da None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:48.017000 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646180d5-cce1-433e-a44f-87687d4502da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:48.017307 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646180d5-cce1-433e-a44f-87687d4502da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:48.018766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646180d5-cce1-433e-a44f-87687d4502da None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:48.033473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf088e17-8853-4478-a797-66ee7425f711 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:48.033791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf088e17-8853-4478-a797-66ee7425f711 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:48.034047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf088e17-8853-4478-a797-66ee7425f711 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:48.034457 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 354/701] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:48.036753 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 348/702] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:04:48.040173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646180d5-cce1-433e-a44f-87687d4502da None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:48.043529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f6029-6f02-40bd-b25f-829ce6ead9ee None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:48.043826 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f6029-6f02-40bd-b25f-829ce6ead9ee None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:48.044113 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f6029-6f02-40bd-b25f-829ce6ead9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:48.065384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-373f6029-6f02-40bd-b25f-829ce6ead9ee None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:48.066595 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-373f6029-6f02-40bd-b25f-829ce6ead9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:48.115831 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:48.134715 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:48.174144 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 349/703] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:04:48.183329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646180d5-cce1-433e-a44f-87687d4502da None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:48.200943 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f6029-6f02-40bd-b25f-829ce6ead9ee None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:48.229259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9524e9c-b20c-4f40-8a27-cab832a9be78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:48.231771 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9524e9c-b20c-4f40-8a27-cab832a9be78 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:48.232925 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9524e9c-b20c-4f40-8a27-cab832a9be78 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:48.234086 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9524e9c-b20c-4f40-8a27-cab832a9be78 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:48.246216 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9524e9c-b20c-4f40-8a27-cab832a9be78 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:48.247995 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9524e9c-b20c-4f40-8a27-cab832a9be78 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:48.280382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-d9524e9c-b20c-4f40-8a27-cab832a9be78 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:04:48.280382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:48.280382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:48.280382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:48.280382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:48.280382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:48.280382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:48.280382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:48.280382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:48.280382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:48.280382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:48.280382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:48.280382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:04:48.280382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:04:48.280382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:04:48.280382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:04:48.282871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:48.282871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:48.282871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:04:48.282871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:48.282871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:04:48.282871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:48.282871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:48.282871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:48.282871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:48.282871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:48.282871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:48.282871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:48.282871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:48.282871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:48.282871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:48.282871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:48.282871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:48.282871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:48.285890 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:48.285890 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:48.285890 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:04:48.285890 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:04:48.285890 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:04:48.285890 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:04:48.285890 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:04:48.285890 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:04:48.285890 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:04:48.285890 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:48.285890 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 355/704] 10.222.0.17 () {56 vars in 1093 bytes} [Tue Jul 12 13:04:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:48.291434 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9524e9c-b20c-4f40-8a27-cab832a9be78 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:48.350631 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f6029-6f02-40bd-b25f-829ce6ead9ee None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:48.401312 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da082166-adb0-4864-b42f-4b20e7de8c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:48.403133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da082166-adb0-4864-b42f-4b20e7de8c6f None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:48.403676 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da082166-adb0-4864-b42f-4b20e7de8c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:48.404170 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da082166-adb0-4864-b42f-4b20e7de8c6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:48.421650 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da082166-adb0-4864-b42f-4b20e7de8c6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:48.421650 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da082166-adb0-4864-b42f-4b20e7de8c6f None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:48.449136 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9524e9c-b20c-4f40-8a27-cab832a9be78 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:48.473358 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-da082166-adb0-4864-b42f-4b20e7de8c6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:48.473358 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:48.473358 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:48.473358 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:48.473358 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:48.473358 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:48.473358 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:48.473358 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:48.473358 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:48.473358 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:48.473358 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:48.473358 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:48.473358 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:48.473358 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:48.473358 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:48.474718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:48.474718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:48.474718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:48.474718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:48.474718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:48.474718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:48.474718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:48.474718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:48.474718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:48.474718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:48.474718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:48.474718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:48.474718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:48.474718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:48.474718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:48.474718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:48.474718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:48.476466 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:48.476466 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:48.476466 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:48.476466 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:48.482153 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 350/705] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:04:48.486721 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:48.504296 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da082166-adb0-4864-b42f-4b20e7de8c6f None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:48.528039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec1f7b-1e14-4fae-bfae-a1588b5440e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:48.528744 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec1f7b-1e14-4fae-bfae-a1588b5440e3 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:48.529031 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec1f7b-1e14-4fae-bfae-a1588b5440e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:48.529306 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec1f7b-1e14-4fae-bfae-a1588b5440e3 None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:48.530181 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec1f7b-1e14-4fae-bfae-a1588b5440e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:48.530496 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec1f7b-1e14-4fae-bfae-a1588b5440e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:48.534860 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec1f7b-1e14-4fae-bfae-a1588b5440e3 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:48.550097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:48.565643 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 356/706] 10.222.0.17 () {56 vars in 1133 bytes} [Tue Jul 12 13:04:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:48.571359 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec1f7b-1e14-4fae-bfae-a1588b5440e3 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:48.644986 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da082166-adb0-4864-b42f-4b20e7de8c6f None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:48.700217 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753f0cc-13f9-4473-80fe-89e7de991b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:48.700907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753f0cc-13f9-4473-80fe-89e7de991b18 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:48.701193 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753f0cc-13f9-4473-80fe-89e7de991b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:48.701474 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753f0cc-13f9-4473-80fe-89e7de991b18 None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:48.702230 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753f0cc-13f9-4473-80fe-89e7de991b18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:48.702540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753f0cc-13f9-4473-80fe-89e7de991b18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:48.703924 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753f0cc-13f9-4473-80fe-89e7de991b18 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:48.706258 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec1f7b-1e14-4fae-bfae-a1588b5440e3 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:48.729970 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 351/707] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:04:48.735439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753f0cc-13f9-4473-80fe-89e7de991b18 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:48.747708 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62238ca-0a7f-4cd8-a642-d9f5d518f0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:48.748596 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62238ca-0a7f-4cd8-a642-d9f5d518f0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:48.749034 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62238ca-0a7f-4cd8-a642-d9f5d518f0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:48.749423 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62238ca-0a7f-4cd8-a642-d9f5d518f0d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:48.802468 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:48.833173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62238ca-0a7f-4cd8-a642-d9f5d518f0d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:48.834953 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62238ca-0a7f-4cd8-a642-d9f5d518f0d4 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:48.949824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 357/708] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:04:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 13:04:48.957107 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62238ca-0a7f-4cd8-a642-d9f5d518f0d4 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:48.994671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:49.044143 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753f0cc-13f9-4473-80fe-89e7de991b18 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:49.066527 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:49.075060 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62238ca-0a7f-4cd8-a642-d9f5d518f0d4 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:49.112075 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592556d7-7e95-4652-83aa-3c8cc1a3973a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:49.113101 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592556d7-7e95-4652-83aa-3c8cc1a3973a None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:49.113522 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592556d7-7e95-4652-83aa-3c8cc1a3973a None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:49.113903 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592556d7-7e95-4652-83aa-3c8cc1a3973a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:49.126001 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592556d7-7e95-4652-83aa-3c8cc1a3973a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:49.126844 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b82d6f-9015-4f14-b95d-710064290237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:49.127539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b82d6f-9015-4f14-b95d-710064290237 None admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:49.127823 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b82d6f-9015-4f14-b95d-710064290237 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:49.127933 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592556d7-7e95-4652-83aa-3c8cc1a3973a None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:49.128099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b82d6f-9015-4f14-b95d-710064290237 None admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:49.128811 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b82d6f-9015-4f14-b95d-710064290237 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:49.130283 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b82d6f-9015-4f14-b95d-710064290237 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:49.147589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-592556d7-7e95-4652-83aa-3c8cc1a3973a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:49.147589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:49.147589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:49.147589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:49.147589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:49.147589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:49.147589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:49.147589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:49.147589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:49.147589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:49.147589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:49.147589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:49.147589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:49.147589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:49.147589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:49.149013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:49.149013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:49.149013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:49.149013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:49.149013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:49.149013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:49.149013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:49.149013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:49.149013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:49.149013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:49.149013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:49.149013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:49.149013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:49.149013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:49.149013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:49.149013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:49.149013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:49.150208 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:49.150208 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:49.150208 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:49.150208 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:49.154154 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 358/709] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:49.156829 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592556d7-7e95-4652-83aa-3c8cc1a3973a None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:49.184401 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 352/710] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Jul 12 13:04:48 2022] POST /identity/v3/users => generated 254 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:04:49.249439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cdfdc-3e75-45e4-a516-397bba50c15d None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:49.250015 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cdfdc-3e75-45e4-a516-397bba50c15d None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:49.250494 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cdfdc-3e75-45e4-a516-397bba50c15d None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:49.252171 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 353/711] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:04:49.257922 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb7f6f-d262-4c5f-ad26-ec56930330c1 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:49.258522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb7f6f-d262-4c5f-ad26-ec56930330c1 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:49.258984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb7f6f-d262-4c5f-ad26-ec56930330c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:49.291902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-9feb7f6f-d262-4c5f-ad26-ec56930330c1 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:49.293176 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-9feb7f6f-d262-4c5f-ad26-ec56930330c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:49.310647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592556d7-7e95-4652-83aa-3c8cc1a3973a None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:49.353281 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6ab69-b7ba-430b-8944-8e429b7f1efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:49.354346 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6ab69-b7ba-430b-8944-8e429b7f1efa None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:49.354831 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6ab69-b7ba-430b-8944-8e429b7f1efa None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:49.355338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6ab69-b7ba-430b-8944-8e429b7f1efa None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:49.356500 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6ab69-b7ba-430b-8944-8e429b7f1efa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:49.357008 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6ab69-b7ba-430b-8944-8e429b7f1efa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:49.359091 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6ab69-b7ba-430b-8944-8e429b7f1efa None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:49.370146 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:49.385363 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 359/712] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:49.390983 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6ab69-b7ba-430b-8944-8e429b7f1efa None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:49.437039 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 354/713] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:04:49.461136 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb7f6f-d262-4c5f-ad26-ec56930330c1 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:49.527178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6ab69-b7ba-430b-8944-8e429b7f1efa None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:49.553090 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:49.578521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e865c63-293e-42c9-b7ed-75b493e853d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:49.580267 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e865c63-293e-42c9-b7ed-75b493e853d7 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:49.580752 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e865c63-293e-42c9-b7ed-75b493e853d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:49.581244 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e865c63-293e-42c9-b7ed-75b493e853d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:49.591957 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb7f6f-d262-4c5f-ad26-ec56930330c1 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:49.592991 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e865c63-293e-42c9-b7ed-75b493e853d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:49.596099 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e865c63-293e-42c9-b7ed-75b493e853d7 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:49.619772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-2e865c63-293e-42c9-b7ed-75b493e853d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:49.619772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:49.619772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:49.619772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:49.619772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:49.619772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:49.619772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:49.619772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:49.619772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:49.619772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:49.619772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:49.619772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:49.619772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:04:49.619772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:04:49.619772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:04:49.620849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:04:49.620849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:49.620849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:49.620849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:49.620849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:49.620849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:49.620849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:49.620849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:49.620849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:49.620849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:49.620849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:49.620849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:49.620849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:49.620849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:49.620849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:49.620849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:49.620849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:49.622458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:04:49.622458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:04:49.622458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:04:49.622458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:04:49.622458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:04:49.622458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:04:49.622458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:49.622458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:49.622458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 360/714] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:04:49.622458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7f71b-6544-439e-8c1e-322c080f03a8 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:49.623018 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7f71b-6544-439e-8c1e-322c080f03a8 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:49.623018 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7f71b-6544-439e-8c1e-322c080f03a8 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:49.624272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 361/715] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:49.627020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7f71b-6544-439e-8c1e-322c080f03a8 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:49.649277 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a82f3-b4dc-4cba-a631-41dedc658953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:49.650156 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a82f3-b4dc-4cba-a631-41dedc658953 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:49.650470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a82f3-b4dc-4cba-a631-41dedc658953 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:49.650912 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a82f3-b4dc-4cba-a631-41dedc658953 None admin] PATH_INFO: `/v3/services/network` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:49.651714 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a82f3-b4dc-4cba-a631-41dedc658953 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:49.653191 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a82f3-b4dc-4cba-a631-41dedc658953 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:49.676103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-8a8a82f3-b4dc-4cba-a631-41dedc658953 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 13:04:49.676103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:49.676103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:04:49.676103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:04:49.676103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:04:49.676103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:04:49.676103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:04:49.676103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:04:49.676103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 13:04:49.676103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:49.676103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:04:49.676103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:49.676103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:49.676103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:49.676103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:49.676103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:49.676103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:49.678342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:49.678342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:49.678342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:49.678342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:49.678342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:49.678342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:49.678342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:04:49.678342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:04:49.678342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:04:49.678342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:04:49.678342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:49.678342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:49.678342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:49.678342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:49.678342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:49.678342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:49.679819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:49.679819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:49.679819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:49.679819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:49.679819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:49.679819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:49.679819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:49.679819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:49.679819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:49.679819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:49.679819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:04:49.679819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:04:49.679819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 13:04:49.679819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:49.679819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 355/716] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:49 2022] GET /identity/v3/services/network => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:04:49.681504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468dadb-8907-4678-bd96-f1984e64bc68 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:49.681504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468dadb-8907-4678-bd96-f1984e64bc68 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:49.681504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468dadb-8907-4678-bd96-f1984e64bc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:49.704412 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-a468dadb-8907-4678-bd96-f1984e64bc68 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:49.705425 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:49.707147 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-a468dadb-8907-4678-bd96-f1984e64bc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:49.774823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7f71b-6544-439e-8c1e-322c080f03a8 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:49.806178 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 356/717] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:49.807406 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468dadb-8907-4678-bd96-f1984e64bc68 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:49.822809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a47a39-3519-4d23-a501-b93c203e9d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:49.825363 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a47a39-3519-4d23-a501-b93c203e9d1c None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:49.825680 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a47a39-3519-4d23-a501-b93c203e9d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:49.825965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a47a39-3519-4d23-a501-b93c203e9d1c None admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:49.827163 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a47a39-3519-4d23-a501-b93c203e9d1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:49.827662 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a47a39-3519-4d23-a501-b93c203e9d1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:49.829039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a47a39-3519-4d23-a501-b93c203e9d1c None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:49.843506 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 362/718] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:04:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:49.844367 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a47a39-3519-4d23-a501-b93c203e9d1c None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:49.895427 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:49.948388 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468dadb-8907-4678-bd96-f1984e64bc68 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:49.966324 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a47a39-3519-4d23-a501-b93c203e9d1c None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:49.975109 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:50.002009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed7d0c-d3d0-4555-ae65-a27d616aad71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:50.003324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed7d0c-d3d0-4555-ae65-a27d616aad71 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:50.003764 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed7d0c-d3d0-4555-ae65-a27d616aad71 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:50.004183 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed7d0c-d3d0-4555-ae65-a27d616aad71 None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:50.005002 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188698d2-356f-4e36-9a35-35487096b48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:50.005330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed7d0c-d3d0-4555-ae65-a27d616aad71 None admin] RBAC: Adding query filter params (name=network) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:50.005676 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188698d2-356f-4e36-9a35-35487096b48d None admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:50.005952 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed7d0c-d3d0-4555-ae65-a27d616aad71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:50.006063 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188698d2-356f-4e36-9a35-35487096b48d None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:50.006284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188698d2-356f-4e36-9a35-35487096b48d None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:50.007068 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188698d2-356f-4e36-9a35-35487096b48d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:50.008481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed7d0c-d3d0-4555-ae65-a27d616aad71 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:50.009001 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188698d2-356f-4e36-9a35-35487096b48d None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:50.015686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 357/719] 10.222.0.17 () {56 vars in 1112 bytes} [Tue Jul 12 13:04:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:50.016837 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed7d0c-d3d0-4555-ae65-a27d616aad71 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:50.034430 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 363/720] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Jul 12 13:04:49 2022] POST /identity/v3/services => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:04:50.035942 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188698d2-356f-4e36-9a35-35487096b48d None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:50.134704 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed7d0c-d3d0-4555-ae65-a27d616aad71 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:50.178525 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:50.183579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188698d2-356f-4e36-9a35-35487096b48d None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:50.185386 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae385ad-a812-49f8-a96e-27362feda863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:50.190149 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae385ad-a812-49f8-a96e-27362feda863 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:50.190149 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae385ad-a812-49f8-a96e-27362feda863 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:50.190149 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae385ad-a812-49f8-a96e-27362feda863 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:50.190149 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae385ad-a812-49f8-a96e-27362feda863 None admin] RBAC: Adding query filter params (role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0, scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2, user.id=e52dfce1b06346bfbde6ee33e7f6f249) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:50.190149 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae385ad-a812-49f8-a96e-27362feda863 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:50.190149 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae385ad-a812-49f8-a96e-27362feda863 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:50.197665 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 358/721] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:04:50 2022] GET /identity/v3/role_assignments?user.id=e52dfce1b06346bfbde6ee33e7f6f249&scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2&role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:50.245844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb005f-1634-4a1e-8d92-d847542518fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:50.246883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb005f-1634-4a1e-8d92-d847542518fd None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:50.247328 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb005f-1634-4a1e-8d92-d847542518fd None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:50.247761 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb005f-1634-4a1e-8d92-d847542518fd None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:50.248674 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb005f-1634-4a1e-8d92-d847542518fd None admin] RBAC: Adding query filter params (type=network) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:50.249217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb005f-1634-4a1e-8d92-d847542518fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:50.250880 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb005f-1634-4a1e-8d92-d847542518fd None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:50.259037 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 364/722] 10.222.0.17 () {56 vars in 1112 bytes} [Tue Jul 12 13:04:50 2022] GET /identity/v3/services?type=network => generated 124 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:50.696633 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f4160-473a-49ec-ae4e-990c61e89bde None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:50.696968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f4160-473a-49ec-ae4e-990c61e89bde None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:50.697201 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f4160-473a-49ec-ae4e-990c61e89bde None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:50.699080 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 359/723] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:50.704803 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a676e16-7094-4736-be7b-cc1cad64bca0 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:50.705740 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a676e16-7094-4736-be7b-cc1cad64bca0 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:50.706260 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a676e16-7094-4736-be7b-cc1cad64bca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:50.727472 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-0a676e16-7094-4736-be7b-cc1cad64bca0 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:50.729051 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-0a676e16-7094-4736-be7b-cc1cad64bca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:50.754920 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:50.824942 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 365/724] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:50.859912 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f4160-473a-49ec-ae4e-990c61e89bde None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:51.002814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f4160-473a-49ec-ae4e-990c61e89bde None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:51.058836 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149d58c-886f-4a99-93a7-cc95a4f2c264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:51.060026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149d58c-886f-4a99-93a7-cc95a4f2c264 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:51.060511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149d58c-886f-4a99-93a7-cc95a4f2c264 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:51.061009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149d58c-886f-4a99-93a7-cc95a4f2c264 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:51.079160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149d58c-886f-4a99-93a7-cc95a4f2c264 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:51.088020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-6149d58c-886f-4a99-93a7-cc95a4f2c264 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:04:51.088020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:51.088020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:51.088020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:51.088020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:51.088020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:51.088020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:51.088020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:51.088020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:51.088020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:51.088020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:51.088020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:51.088020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:51.088020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:51.088020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:51.088020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:51.088994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:51.088994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:51.088994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:51.088994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:51.088994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:51.088994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:51.088994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:51.088994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:51.088994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:51.088994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:51.088994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:51.088994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:51.088994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:51.088994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:51.088994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:51.088994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:51.089847 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:51.089847 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:51.089847 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:51.089847 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:51.089847 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:51.089847 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:51.089847 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:51.089847 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:51.089847 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:51.089847 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:51.089847 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:04:51.089847 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:51.092348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 360/725] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:04:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:51.098091 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a676e16-7094-4736-be7b-cc1cad64bca0 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:51.257869 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a676e16-7094-4736-be7b-cc1cad64bca0 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:51.311759 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7433d-dd24-46f4-bf28-3b999d01b14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:51.312449 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7433d-dd24-46f4-bf28-3b999d01b14b None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:51.312735 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7433d-dd24-46f4-bf28-3b999d01b14b None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:51.313014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7433d-dd24-46f4-bf28-3b999d01b14b None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:51.313774 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7433d-dd24-46f4-bf28-3b999d01b14b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:51.314081 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7433d-dd24-46f4-bf28-3b999d01b14b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:51.315489 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7433d-dd24-46f4-bf28-3b999d01b14b None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:51.330072 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 366/726] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:04:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:51.336078 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149d58c-886f-4a99-93a7-cc95a4f2c264 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:51.427789 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:51.474132 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149d58c-886f-4a99-93a7-cc95a4f2c264 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:51.524575 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a569d2-62e2-48fc-a728-d73f06aeb063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:51.525303 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a569d2-62e2-48fc-a728-d73f06aeb063 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:51.525588 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a569d2-62e2-48fc-a728-d73f06aeb063 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:51.525866 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a569d2-62e2-48fc-a728-d73f06aeb063 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:51.538233 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a569d2-62e2-48fc-a728-d73f06aeb063 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:51.539793 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a569d2-62e2-48fc-a728-d73f06aeb063 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:51.574483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-78a569d2-62e2-48fc-a728-d73f06aeb063 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:51.574483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:51.574483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:51.574483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:51.574483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:51.574483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:51.574483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:51.574483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:51.574483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:51.574483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:51.574483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:51.574483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:51.574483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:51.574483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:51.574483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:51.575456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:51.575456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:51.575456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:51.575456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:51.575456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:51.575456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:51.575456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:51.575456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:51.575456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:51.575456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:51.575456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:51.575456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:51.575456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:51.575456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:51.575456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:51.575456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:51.575456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:51.576356 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:51.576356 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:51.576356 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:51.576356 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:51.576356 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 361/727] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:51.581528 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7433d-dd24-46f4-bf28-3b999d01b14b None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:51.606538 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:51.717960 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1c982-337f-4f31-8cb3-d5058fa27c4a None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:51.718302 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1c982-337f-4f31-8cb3-d5058fa27c4a None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:51.718556 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1c982-337f-4f31-8cb3-d5058fa27c4a None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:51.720207 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 362/728] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:51.723995 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7433d-dd24-46f4-bf28-3b999d01b14b None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:51.731713 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d266d-1d3d-469a-8ade-4eb110261e34 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:51.731998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d266d-1d3d-469a-8ade-4eb110261e34 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:51.732277 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d266d-1d3d-469a-8ade-4eb110261e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:51.770007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda7935-7ec8-4c4e-b743-8c2307458720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:51.770331 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-5b3d266d-1d3d-469a-8ade-4eb110261e34 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:51.771169 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda7935-7ec8-4c4e-b743-8c2307458720 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:51.771458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda7935-7ec8-4c4e-b743-8c2307458720 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:51.771581 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-5b3d266d-1d3d-469a-8ade-4eb110261e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:51.771746 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda7935-7ec8-4c4e-b743-8c2307458720 None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:51.772460 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda7935-7ec8-4c4e-b743-8c2307458720 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:51.773315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda7935-7ec8-4c4e-b743-8c2307458720 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:51.775032 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda7935-7ec8-4c4e-b743-8c2307458720 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:51.794910 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 367/729] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:51.795881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda7935-7ec8-4c4e-b743-8c2307458720 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:51.902488 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:51.945289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda7935-7ec8-4c4e-b743-8c2307458720 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:51.957751 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 363/730] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:51 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:51.998273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6847c-9eab-4575-8622-adae940d5bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:51.999135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6847c-9eab-4575-8622-adae940d5bbc None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:51.999421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6847c-9eab-4575-8622-adae940d5bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:51.999697 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6847c-9eab-4575-8622-adae940d5bbc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:52.007355 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6847c-9eab-4575-8622-adae940d5bbc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:52.008859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6847c-9eab-4575-8622-adae940d5bbc None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:52.020374 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d266d-1d3d-469a-8ade-4eb110261e34 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:52.039792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-24f6847c-9eab-4575-8622-adae940d5bbc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 13:04:52.039792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:52.039792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:52.039792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:52.039792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:52.039792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:52.039792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:52.039792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:52.039792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:52.039792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:52.039792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:52.039792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:52.039792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:04:52.039792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:04:52.039792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:04:52.039792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:04:52.040802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:52.040802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:52.040802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:04:52.040802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:52.040802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:04:52.040802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:52.040802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:52.040802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:52.040802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:52.040802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:52.040802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:52.040802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:52.040802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:52.040802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:52.040802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:52.040802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:52.040802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:52.040802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:52.041766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:52.041766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:52.041766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:04:52.041766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:04:52.041766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:04:52.041766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:04:52.041766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:04:52.041766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:04:52.041766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 13:04:52.041766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:52.045509 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 368/731] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:04:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:52.065677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6847c-9eab-4575-8622-adae940d5bbc None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:52.102504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:52.162041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d266d-1d3d-469a-8ade-4eb110261e34 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:52.197721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98b97d-bdf8-4d6f-a097-28ddfac32be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:52.198555 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98b97d-bdf8-4d6f-a097-28ddfac32be6 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:52.198839 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98b97d-bdf8-4d6f-a097-28ddfac32be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:52.199115 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98b97d-bdf8-4d6f-a097-28ddfac32be6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:52.209861 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98b97d-bdf8-4d6f-a097-28ddfac32be6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:52.224890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-6c98b97d-bdf8-4d6f-a097-28ddfac32be6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:52.224890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:52.224890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:52.224890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:52.224890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:52.224890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:52.224890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:52.224890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:52.224890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:52.224890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:52.224890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:52.224890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:52.224890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:52.224890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:52.224890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:52.224890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:52.226531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:52.226531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:52.226531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:52.226531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:52.226531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:52.226531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:52.226531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:52.226531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:52.226531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:52.226531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:52.226531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:52.226531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:52.226531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:52.226531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:52.226531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:52.226531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:52.227371 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:52.227371 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:52.227371 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:52.227371 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:52.227371 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:52.227371 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:52.227371 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:52.227371 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:52.227371 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:52.227371 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:52.227371 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:52.227371 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:52.227371 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 364/732] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Jul 12 13:04:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:04:52.239175 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98b97d-bdf8-4d6f-a097-28ddfac32be6 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:52.249874 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6847c-9eab-4575-8622-adae940d5bbc None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:52.287173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c57ee6-e6f1-42db-80b3-5bee6f77df79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:52.287889 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c57ee6-e6f1-42db-80b3-5bee6f77df79 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:52.288215 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c57ee6-e6f1-42db-80b3-5bee6f77df79 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:52.289020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c57ee6-e6f1-42db-80b3-5bee6f77df79 None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:52.289934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c57ee6-e6f1-42db-80b3-5bee6f77df79 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:52.290221 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c57ee6-e6f1-42db-80b3-5bee6f77df79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:52.291677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c57ee6-e6f1-42db-80b3-5bee6f77df79 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:52.300252 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:52.311430 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 369/733] 10.222.0.17 () {56 vars in 1135 bytes} [Tue Jul 12 13:04:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:04:52.316569 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c57ee6-e6f1-42db-80b3-5bee6f77df79 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:52.415240 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:52.418673 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98b97d-bdf8-4d6f-a097-28ddfac32be6 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:52.495893 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6c0b2-c387-4676-b70c-621768fb1378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:52.496594 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6c0b2-c387-4676-b70c-621768fb1378 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:52.496883 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6c0b2-c387-4676-b70c-621768fb1378 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:52.497165 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6c0b2-c387-4676-b70c-621768fb1378 None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:52.497926 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6c0b2-c387-4676-b70c-621768fb1378 None admin] RBAC: Adding query filter params (name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:52.498270 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6c0b2-c387-4676-b70c-621768fb1378 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:52.499662 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6c0b2-c387-4676-b70c-621768fb1378 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:52.502130 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c57ee6-e6f1-42db-80b3-5bee6f77df79 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:52.525260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 365/734] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Jul 12 13:04:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:52.530687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6c0b2-c387-4676-b70c-621768fb1378 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:52.554863 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a3e87-8f69-4b62-955a-7b04482112d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:52.555454 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a3e87-8f69-4b62-955a-7b04482112d1 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:52.555745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a3e87-8f69-4b62-955a-7b04482112d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:52.556025 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a3e87-8f69-4b62-955a-7b04482112d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:52.672655 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6c0b2-c387-4676-b70c-621768fb1378 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:52.703418 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:52.714986 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a3e87-8f69-4b62-955a-7b04482112d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:52.718431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a3e87-8f69-4b62-955a-7b04482112d1 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:52.723067 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3927e-caaf-47e5-965c-91cada34474c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:52.724190 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3927e-caaf-47e5-965c-91cada34474c None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:52.724801 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3927e-caaf-47e5-965c-91cada34474c None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:52.725303 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3927e-caaf-47e5-965c-91cada34474c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:52.737795 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3927e-caaf-47e5-965c-91cada34474c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:52.739875 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3927e-caaf-47e5-965c-91cada34474c None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:52.759998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-f4f3927e-caaf-47e5-965c-91cada34474c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:52.759998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:52.759998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:52.759998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:52.759998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:52.759998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:52.759998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:52.759998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:52.759998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:52.759998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:52.759998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:52.759998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:52.759998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:52.759998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:52.759998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:52.761287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:52.761287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:52.761287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:52.761287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:52.761287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:52.761287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:52.761287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:52.761287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:52.761287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:52.761287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:52.761287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:52.761287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:52.761287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:52.761287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:52.761287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:52.761287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:52.761287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:52.762716 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:52.762716 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:52.762716 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:52.762716 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:52.764733 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 366/735] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:04:52.772651 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3927e-caaf-47e5-965c-91cada34474c None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:52.797330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:52.875811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 370/736] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:04:52 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:04:52.877163 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0080c8-41e6-4e33-a661-69c34b3f1769 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:52.877457 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0080c8-41e6-4e33-a661-69c34b3f1769 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:52.877737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0080c8-41e6-4e33-a661-69c34b3f1769 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:52.879094 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 371/737] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:52.880181 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1e172-7cc5-47f0-bd3e-33fac60a8d9a None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:52.880465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1e172-7cc5-47f0-bd3e-33fac60a8d9a None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:52.880741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1e172-7cc5-47f0-bd3e-33fac60a8d9a None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:52.886649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 372/738] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:52.886649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf1e172-7cc5-47f0-bd3e-33fac60a8d9a None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:52.915713 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3927e-caaf-47e5-965c-91cada34474c None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:52.950855 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196b4bf-9b52-4ff4-824c-2e3c7a11701c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:52.951523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196b4bf-9b52-4ff4-824c-2e3c7a11701c None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:52.951805 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196b4bf-9b52-4ff4-824c-2e3c7a11701c None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:52.952079 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196b4bf-9b52-4ff4-824c-2e3c7a11701c None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:52.952792 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196b4bf-9b52-4ff4-824c-2e3c7a11701c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:52.953098 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196b4bf-9b52-4ff4-824c-2e3c7a11701c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:52.954477 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196b4bf-9b52-4ff4-824c-2e3c7a11701c None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:52.966796 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 367/739] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:04:52.968037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c1899-e7d3-42f3-893f-fcaef1443fb6 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:52.968324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c1899-e7d3-42f3-893f-fcaef1443fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:52.968596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c1899-e7d3-42f3-893f-fcaef1443fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:52.984950 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-be2c1899-e7d3-42f3-893f-fcaef1443fb6 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:52.986163 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-be2c1899-e7d3-42f3-893f-fcaef1443fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:52.994841 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:53.001868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf1e172-7cc5-47f0-bd3e-33fac60a8d9a None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:53.037307 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355313d-4e47-4e2c-8c7c-0fde327b0780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:53.038148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355313d-4e47-4e2c-8c7c-0fde327b0780 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:53.038455 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355313d-4e47-4e2c-8c7c-0fde327b0780 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:53.038736 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355313d-4e47-4e2c-8c7c-0fde327b0780 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:53.049140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355313d-4e47-4e2c-8c7c-0fde327b0780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:53.050659 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355313d-4e47-4e2c-8c7c-0fde327b0780 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:53.052804 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 368/740] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:52 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:53.054726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3b87a-6f59-4135-86ac-7a749ee5fe62 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:53.055024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3b87a-6f59-4135-86ac-7a749ee5fe62 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:53.055306 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3b87a-6f59-4135-86ac-7a749ee5fe62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:53.059955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:53.073675 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-c7d3b87a-6f59-4135-86ac-7a749ee5fe62 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:53.074909 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-c7d3b87a-6f59-4135-86ac-7a749ee5fe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:53.083659 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-b355313d-4e47-4e2c-8c7c-0fde327b0780 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:53.083659 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:53.083659 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:53.083659 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:53.083659 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:53.083659 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:53.083659 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:53.083659 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:53.083659 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:53.083659 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:53.083659 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:53.083659 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:53.083659 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:53.083659 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:53.083659 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:53.084593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:53.084593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:53.084593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:53.084593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:53.084593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:53.084593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:53.084593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:53.084593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:53.084593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:53.084593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:53.084593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:53.084593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:53.084593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:53.084593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:53.084593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:53.084593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:53.084593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:53.085990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:53.085990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:53.085990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:53.085990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:53.085990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 373/741] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:53.086928 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b8e8f-8055-4eec-bc17-00a7b01cede0 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:53.087219 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b8e8f-8055-4eec-bc17-00a7b01cede0 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:53.087508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b8e8f-8055-4eec-bc17-00a7b01cede0 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:53.088765 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 374/742] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:53.089457 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b8e8f-8055-4eec-bc17-00a7b01cede0 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:53.149292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 369/743] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:53 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:04:53.150029 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3b87a-6f59-4135-86ac-7a749ee5fe62 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:53.202889 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b8e8f-8055-4eec-bc17-00a7b01cede0 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:53.239627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f309c-cde2-44ad-9f4b-b935ddaa0c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:53.240451 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f309c-cde2-44ad-9f4b-b935ddaa0c4d None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:53.240741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f309c-cde2-44ad-9f4b-b935ddaa0c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:53.241022 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f309c-cde2-44ad-9f4b-b935ddaa0c4d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:53.248319 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f309c-cde2-44ad-9f4b-b935ddaa0c4d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:53.249770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f309c-cde2-44ad-9f4b-b935ddaa0c4d None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:53.250408 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3b87a-6f59-4135-86ac-7a749ee5fe62 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:53.265188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-337f309c-cde2-44ad-9f4b-b935ddaa0c4d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 13:04:53.265188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:53.265188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:53.265188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:53.265188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:53.265188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:53.265188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:53.265188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:53.265188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:53.265188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:53.265188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:53.265188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:53.265188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:04:53.265188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:04:53.265188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:04:53.265188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:04:53.266361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:53.266361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:53.266361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:04:53.266361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:53.266361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:04:53.266361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:53.266361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:53.266361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:53.266361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:53.266361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:53.266361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:53.266361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:53.266361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:53.266361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:53.266361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:53.266361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:53.266361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:53.266361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:53.267341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:53.267341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:53.267341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:04:53.267341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:04:53.267341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:04:53.267341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:04:53.267341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:04:53.267341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:04:53.267341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 13:04:53.267341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:53.267341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 375/744] 10.222.0.17 () {56 vars in 1117 bytes} [Tue Jul 12 13:04:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:53.267923 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f309c-cde2-44ad-9f4b-b935ddaa0c4d None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:53.278328 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:53.296561 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:53.302257 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff862b-73fd-4c96-94e2-a2c54b8e5977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:53.302941 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff862b-73fd-4c96-94e2-a2c54b8e5977 None admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:53.303225 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff862b-73fd-4c96-94e2-a2c54b8e5977 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:53.303502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff862b-73fd-4c96-94e2-a2c54b8e5977 None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:53.304271 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff862b-73fd-4c96-94e2-a2c54b8e5977 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:53.305653 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff862b-73fd-4c96-94e2-a2c54b8e5977 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:53.319579 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 370/745] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Jul 12 13:04:53 2022] POST /identity/v3/services => generated 240 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:04:53.320835 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767be95d-e1d2-4c66-8c72-dbe0862dc71e None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:53.321127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767be95d-e1d2-4c66-8c72-dbe0862dc71e None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:53.321411 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767be95d-e1d2-4c66-8c72-dbe0862dc71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:53.347491 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-767be95d-e1d2-4c66-8c72-dbe0862dc71e None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:53.348863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-767be95d-e1d2-4c66-8c72-dbe0862dc71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:53.377290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f309c-cde2-44ad-9f4b-b935ddaa0c4d None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:53.423520 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196878af-4ce7-44fd-9808-2da2b853221b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:53.424115 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196878af-4ce7-44fd-9808-2da2b853221b None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:53.424402 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196878af-4ce7-44fd-9808-2da2b853221b None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:53.424679 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196878af-4ce7-44fd-9808-2da2b853221b None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:53.425410 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196878af-4ce7-44fd-9808-2da2b853221b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:53.425718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196878af-4ce7-44fd-9808-2da2b853221b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:53.427181 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196878af-4ce7-44fd-9808-2da2b853221b None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:53.432157 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 371/746] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:04:53.445077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 376/747] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:53.445077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196878af-4ce7-44fd-9808-2da2b853221b None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:53.445341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767be95d-e1d2-4c66-8c72-dbe0862dc71e None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:53.521215 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:53.567006 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196878af-4ce7-44fd-9808-2da2b853221b None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:53.567248 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767be95d-e1d2-4c66-8c72-dbe0862dc71e None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:53.592542 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:53.605328 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448754f-ccc8-4c7d-9f9d-24f1d4e8e07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:53.606028 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448754f-ccc8-4c7d-9f9d-24f1d4e8e07c None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:53.606349 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448754f-ccc8-4c7d-9f9d-24f1d4e8e07c None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:53.606634 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448754f-ccc8-4c7d-9f9d-24f1d4e8e07c None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:53.606928 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2dc14-ec11-4305-b23a-2c0951f5481e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:53.607490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448754f-ccc8-4c7d-9f9d-24f1d4e8e07c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:53.607752 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2dc14-ec11-4305-b23a-2c0951f5481e None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:53.607851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448754f-ccc8-4c7d-9f9d-24f1d4e8e07c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:53.608039 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2dc14-ec11-4305-b23a-2c0951f5481e None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:53.608318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2dc14-ec11-4305-b23a-2c0951f5481e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:53.608985 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2dc14-ec11-4305-b23a-2c0951f5481e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:53.609244 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448754f-ccc8-4c7d-9f9d-24f1d4e8e07c None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:53.610392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2dc14-ec11-4305-b23a-2c0951f5481e None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:53.624862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-e6e2dc14-ec11-4305-b23a-2c0951f5481e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 13:04:53.624862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:53.624862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:04:53.624862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:04:53.624862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:04:53.624862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:04:53.624862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:04:53.624862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:04:53.624862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 13:04:53.624862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:53.624862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:04:53.624862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:53.624862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:53.624862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:53.624862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:53.624862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:53.625872 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:53.625872 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:53.625872 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:53.625872 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:53.625872 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:53.625872 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:53.625872 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:53.625872 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:04:53.625872 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:04:53.625872 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:04:53.625872 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:04:53.625872 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:53.625872 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:53.625872 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:53.625872 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:53.625872 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:53.627227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:53.627227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:53.627227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:53.627227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:53.627227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:53.627227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:53.627227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:53.627227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:53.627227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:53.627227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:53.627227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:53.627227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:04:53.627227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:04:53.627227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 13:04:53.627227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:53.627227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 372/748] 10.222.0.17 () {56 vars in 1129 bytes} [Tue Jul 12 13:04:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:53.628356 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2dc14-ec11-4305-b23a-2c0951f5481e None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:53.633843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 377/749] 10.222.0.17 () {56 vars in 1149 bytes} [Tue Jul 12 13:04:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:53.634990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448754f-ccc8-4c7d-9f9d-24f1d4e8e07c None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:53.744129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2dc14-ec11-4305-b23a-2c0951f5481e None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:53.749879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448754f-ccc8-4c7d-9f9d-24f1d4e8e07c None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:53.775468 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:53.779740 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1119945-5e84-4220-bdb5-77b798a3a464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:53.780561 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1119945-5e84-4220-bdb5-77b798a3a464 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:53.780848 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1119945-5e84-4220-bdb5-77b798a3a464 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:53.781134 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1119945-5e84-4220-bdb5-77b798a3a464 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:53.788330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1119945-5e84-4220-bdb5-77b798a3a464 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:53.789247 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea47e76-2fb9-4693-9f35-777597952ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:53.789798 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1119945-5e84-4220-bdb5-77b798a3a464 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:53.790505 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea47e76-2fb9-4693-9f35-777597952ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:53.790978 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea47e76-2fb9-4693-9f35-777597952ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:53.791577 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea47e76-2fb9-4693-9f35-777597952ef8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:53.805645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-a1119945-5e84-4220-bdb5-77b798a3a464 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:53.805645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:53.805645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:53.805645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:53.805645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:53.805645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:53.805645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:53.805645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:53.805645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:53.805645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:53.805645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:53.805645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:53.805645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:04:53.805645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:04:53.805645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:04:53.806678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:04:53.806678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:53.806678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:53.806678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:53.806678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:53.806678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:53.806678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:53.806678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:53.806678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:53.806678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:53.806678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:53.806678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:53.806678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:53.806678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:53.806678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:53.806678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:53.806678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:53.807604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:04:53.807604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:04:53.807604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:04:53.807604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:04:53.807604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:04:53.807604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:04:53.807604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:53.807604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:53.807604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 373/750] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:53.808530 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1119945-5e84-4220-bdb5-77b798a3a464 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:53.816465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea47e76-2fb9-4693-9f35-777597952ef8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:53.825579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-6ea47e76-2fb9-4693-9f35-777597952ef8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:04:53.825579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:53.825579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:53.825579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:53.825579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:53.825579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:53.825579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:53.825579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:53.825579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:53.825579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:53.825579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:53.825579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:53.825579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:53.825579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:53.825579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:53.825579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:53.826762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:53.826762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:53.826762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:53.826762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:53.826762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:53.826762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:53.826762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:53.826762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:53.826762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:53.826762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:53.826762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:53.826762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:53.826762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:53.826762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:53.826762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:53.826762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:53.827810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:53.827810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:53.827810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:53.827810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:53.827810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:53.827810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:53.827810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:53.827810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:53.827810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:53.827810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:53.827810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:04:53.827810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:53.830407 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 378/751] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:04:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:53.831486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea47e76-2fb9-4693-9f35-777597952ef8 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:53.870490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:53.930506 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1119945-5e84-4220-bdb5-77b798a3a464 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:53.945881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea47e76-2fb9-4693-9f35-777597952ef8 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:53.970287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38897a45-bb97-450b-8595-93ecad64e32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:53.971085 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38897a45-bb97-450b-8595-93ecad64e32d None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:53.971479 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38897a45-bb97-450b-8595-93ecad64e32d None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:53.971863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38897a45-bb97-450b-8595-93ecad64e32d None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:53.972681 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38897a45-bb97-450b-8595-93ecad64e32d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:53.973097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38897a45-bb97-450b-8595-93ecad64e32d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:53.974620 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38897a45-bb97-450b-8595-93ecad64e32d None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:53.983996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 374/752] 10.222.0.17 () {56 vars in 1124 bytes} [Tue Jul 12 13:04:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:53.983996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38897a45-bb97-450b-8595-93ecad64e32d None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:53.986616 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87efb0-6bcc-4832-8adf-f1977a8adddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:53.987577 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87efb0-6bcc-4832-8adf-f1977a8adddb None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:53.988835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87efb0-6bcc-4832-8adf-f1977a8adddb None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:53.989199 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87efb0-6bcc-4832-8adf-f1977a8adddb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:54.045884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:54.068293 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87efb0-6bcc-4832-8adf-f1977a8adddb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:54.070453 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87efb0-6bcc-4832-8adf-f1977a8adddb None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:54.090093 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38897a45-bb97-450b-8595-93ecad64e32d None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:54.101697 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:54.126179 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed29e7-17f0-498a-a6f5-6c8cb87f6fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:54.127003 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed29e7-17f0-498a-a6f5-6c8cb87f6fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:54.127291 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed29e7-17f0-498a-a6f5-6c8cb87f6fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:54.127630 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed29e7-17f0-498a-a6f5-6c8cb87f6fb4 None admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:54.128411 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed29e7-17f0-498a-a6f5-6c8cb87f6fb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:54.128764 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed29e7-17f0-498a-a6f5-6c8cb87f6fb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:54.130219 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed29e7-17f0-498a-a6f5-6c8cb87f6fb4 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:54.147081 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 375/753] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:04:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:54.147081 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed29e7-17f0-498a-a6f5-6c8cb87f6fb4 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:54.190451 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 379/754] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:04:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:04:54.190451 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87efb0-6bcc-4832-8adf-f1977a8adddb None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:54.265178 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed29e7-17f0-498a-a6f5-6c8cb87f6fb4 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:54.276057 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:54.296114 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87efb0-6bcc-4832-8adf-f1977a8adddb None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:54.301298 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f5267-1de3-46ef-8abe-78c7c4afa348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:54.301981 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f5267-1de3-46ef-8abe-78c7c4afa348 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:54.302296 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f5267-1de3-46ef-8abe-78c7c4afa348 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:54.302573 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f5267-1de3-46ef-8abe-78c7c4afa348 None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:54.303324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f5267-1de3-46ef-8abe-78c7c4afa348 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:54.303632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f5267-1de3-46ef-8abe-78c7c4afa348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:54.305563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f5267-1de3-46ef-8abe-78c7c4afa348 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:54.314297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 376/755] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:04:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:54.315102 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f5267-1de3-46ef-8abe-78c7c4afa348 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:54.340176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a70a6-7be4-4347-8b7c-2c51bc051676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:54.340846 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a70a6-7be4-4347-8b7c-2c51bc051676 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:54.341131 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a70a6-7be4-4347-8b7c-2c51bc051676 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:54.341403 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a70a6-7be4-4347-8b7c-2c51bc051676 None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:54.342103 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a70a6-7be4-4347-8b7c-2c51bc051676 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:54.342591 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a70a6-7be4-4347-8b7c-2c51bc051676 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:54.343793 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a70a6-7be4-4347-8b7c-2c51bc051676 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:54.349110 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 380/756] 10.222.0.17 () {56 vars in 1124 bytes} [Tue Jul 12 13:04:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:54.349533 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:54.349925 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a70a6-7be4-4347-8b7c-2c51bc051676 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:54.425405 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f5267-1de3-46ef-8abe-78c7c4afa348 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:54.462214 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a70a6-7be4-4347-8b7c-2c51bc051676 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:54.462645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac213fe-c2b4-41ce-8b7b-e15c705bf77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:54.463314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac213fe-c2b4-41ce-8b7b-e15c705bf77c None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:54.463607 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac213fe-c2b4-41ce-8b7b-e15c705bf77c None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:54.463885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac213fe-c2b4-41ce-8b7b-e15c705bf77c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:54.464722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac213fe-c2b4-41ce-8b7b-e15c705bf77c None admin] RBAC: Adding query filter params (role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0, scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2, user.id=fe10f0f42b8247c99ed5f88eff5065e3) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:54.465037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac213fe-c2b4-41ce-8b7b-e15c705bf77c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:54.466522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac213fe-c2b4-41ce-8b7b-e15c705bf77c None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:54.482141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 377/757] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:04:54 2022] GET /identity/v3/role_assignments?user.id=fe10f0f42b8247c99ed5f88eff5065e3&scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2&role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:54.482141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac213fe-c2b4-41ce-8b7b-e15c705bf77c None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:54.510488 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c294aea-8d86-4726-a84c-5354c7e7b469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:54.511563 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c294aea-8d86-4726-a84c-5354c7e7b469 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:54.511849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c294aea-8d86-4726-a84c-5354c7e7b469 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:54.512123 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c294aea-8d86-4726-a84c-5354c7e7b469 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:54.525040 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c294aea-8d86-4726-a84c-5354c7e7b469 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:54.526788 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c294aea-8d86-4726-a84c-5354c7e7b469 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:54.544723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:54.547586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-6c294aea-8d86-4726-a84c-5354c7e7b469 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:54.547586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:54.547586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:54.547586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:54.547586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:54.547586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:54.547586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:54.547586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:54.547586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:54.547586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:54.547586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:54.547586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:54.547586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:54.547586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:54.547586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:54.548543 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:54.548543 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:54.548543 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:54.548543 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:54.548543 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:54.548543 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:54.548543 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:54.548543 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:54.548543 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:54.548543 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:54.548543 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:54.548543 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:54.548543 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:54.548543 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:54.548543 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:54.548543 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:54.548543 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:54.549745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:54.549745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:54.549745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:54.549745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:54.549745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 381/758] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:54.550977 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c294aea-8d86-4726-a84c-5354c7e7b469 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:54.607265 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:54.614439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac213fe-c2b4-41ce-8b7b-e15c705bf77c None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:54.658074 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d637e1-fe28-4f79-81a7-3599235b2eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:54.659412 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d637e1-fe28-4f79-81a7-3599235b2eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:54.659778 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d637e1-fe28-4f79-81a7-3599235b2eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:54.660124 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d637e1-fe28-4f79-81a7-3599235b2eb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:54.685620 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d637e1-fe28-4f79-81a7-3599235b2eb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:54.685620 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d637e1-fe28-4f79-81a7-3599235b2eb6 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:54.707197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-53d637e1-fe28-4f79-81a7-3599235b2eb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:54.707197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:54.707197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:54.707197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:54.707197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:54.707197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:54.707197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:54.707197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:54.707197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:54.707197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:54.707197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:54.707197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:54.707197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:54.707197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:54.707197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:54.708361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:54.708361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:54.708361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:54.708361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:54.708361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:54.708361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:54.708361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:54.708361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:54.708361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:54.708361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:54.708361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:54.708361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:54.708361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:54.708361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:54.708361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:54.708361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:54.708361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:54.709492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:54.709492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:54.709492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:54.709492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:54.713373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 378/759] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:54.714177 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d637e1-fe28-4f79-81a7-3599235b2eb6 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:54.716122 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c294aea-8d86-4726-a84c-5354c7e7b469 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:54.753973 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb21d71-f9f3-4e95-930f-856bcc2c7e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:54.754898 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb21d71-f9f3-4e95-930f-856bcc2c7e9c None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:54.755303 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb21d71-f9f3-4e95-930f-856bcc2c7e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:54.755682 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb21d71-f9f3-4e95-930f-856bcc2c7e9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:54.756680 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb21d71-f9f3-4e95-930f-856bcc2c7e9c None admin] RBAC: Adding query filter params (interface=public, service_id=a22398ea556b40f485ad717ad4f12684, region_id=RegionOne) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:54.757647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb21d71-f9f3-4e95-930f-856bcc2c7e9c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:54.759260 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb21d71-f9f3-4e95-930f-856bcc2c7e9c None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:54.768547 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 382/760] 10.222.0.17 () {56 vars in 1251 bytes} [Tue Jul 12 13:04:54 2022] GET /identity/v3/endpoints?service_id=a22398ea556b40f485ad717ad4f12684&interface=public®ion_id=RegionOne => generated 194 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:54.769509 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb21d71-f9f3-4e95-930f-856bcc2c7e9c None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:54.824991 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d637e1-fe28-4f79-81a7-3599235b2eb6 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:54.840700 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:54.863323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2383d06-10ad-4108-b31e-91320b1ba6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:54.864392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2383d06-10ad-4108-b31e-91320b1ba6eb None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:54.864911 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2383d06-10ad-4108-b31e-91320b1ba6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:54.865487 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2383d06-10ad-4108-b31e-91320b1ba6eb None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:54.867122 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2383d06-10ad-4108-b31e-91320b1ba6eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:54.867639 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2383d06-10ad-4108-b31e-91320b1ba6eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:54.869319 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2383d06-10ad-4108-b31e-91320b1ba6eb None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:54.883518 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 379/761] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:54.884844 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2383d06-10ad-4108-b31e-91320b1ba6eb None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:54.893318 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb21d71-f9f3-4e95-930f-856bcc2c7e9c None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:54.897417 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:54.937769 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459e155-65c9-4ce3-9584-c12576475a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:54.938767 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459e155-65c9-4ce3-9584-c12576475a35 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:54.939064 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459e155-65c9-4ce3-9584-c12576475a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:54.939344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459e155-65c9-4ce3-9584-c12576475a35 None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:54.940083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459e155-65c9-4ce3-9584-c12576475a35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:54.940394 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459e155-65c9-4ce3-9584-c12576475a35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:54.941952 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459e155-65c9-4ce3-9584-c12576475a35 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:54.962161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 383/762] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:54.962161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459e155-65c9-4ce3-9584-c12576475a35 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:55.011521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2383d06-10ad-4108-b31e-91320b1ba6eb None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:55.050412 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e109487-2bb9-4cbc-8cc5-1777aa69d26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:55.051580 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e109487-2bb9-4cbc-8cc5-1777aa69d26b None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:55.052187 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e109487-2bb9-4cbc-8cc5-1777aa69d26b None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:55.052668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e109487-2bb9-4cbc-8cc5-1777aa69d26b None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:55.053627 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e109487-2bb9-4cbc-8cc5-1777aa69d26b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:55.055316 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e109487-2bb9-4cbc-8cc5-1777aa69d26b None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:55.061987 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 380/763] 10.222.0.17 () {56 vars in 1087 bytes} [Tue Jul 12 13:04:54 2022] GET /identity/v3/services => generated 772 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:55.063300 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e109487-2bb9-4cbc-8cc5-1777aa69d26b None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:55.116190 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459e155-65c9-4ce3-9584-c12576475a35 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:55.176085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:55.203053 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16d39a-2731-45e9-8aa8-744a1ebb3eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:55.204301 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16d39a-2731-45e9-8aa8-744a1ebb3eec None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:55.206408 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16d39a-2731-45e9-8aa8-744a1ebb3eec None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:55.206948 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16d39a-2731-45e9-8aa8-744a1ebb3eec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:55.224184 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16d39a-2731-45e9-8aa8-744a1ebb3eec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:55.226677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16d39a-2731-45e9-8aa8-744a1ebb3eec None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:55.239298 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:55.260521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-7c16d39a-2731-45e9-8aa8-744a1ebb3eec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:55.260521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:55.260521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:55.260521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:55.260521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:55.260521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:55.260521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:55.260521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:55.260521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:55.260521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:55.260521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:55.260521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:55.260521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:04:55.260521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:04:55.260521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:04:55.261807 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:04:55.261807 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:55.261807 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:55.261807 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:55.261807 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:55.261807 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:55.261807 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:55.261807 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:55.261807 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:55.261807 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:55.261807 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:55.261807 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:55.261807 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:55.261807 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:55.261807 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:55.261807 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:55.261807 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:55.262777 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:04:55.262777 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:04:55.262777 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:04:55.262777 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:04:55.262777 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:04:55.262777 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:04:55.262777 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:55.262777 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:55.266026 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 384/764] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:55.271273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16d39a-2731-45e9-8aa8-744a1ebb3eec None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:55.291744 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e109487-2bb9-4cbc-8cc5-1777aa69d26b None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:55.339909 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3f19b-c329-4602-b27f-918d5c5f5648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:55.341079 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3f19b-c329-4602-b27f-918d5c5f5648 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:55.341567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3f19b-c329-4602-b27f-918d5c5f5648 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:55.342068 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3f19b-c329-4602-b27f-918d5c5f5648 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:55.361391 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3f19b-c329-4602-b27f-918d5c5f5648 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:55.363394 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3f19b-c329-4602-b27f-918d5c5f5648 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:55.388182 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-2ff3f19b-c329-4602-b27f-918d5c5f5648 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:04:55.388182 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:55.388182 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:55.388182 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:55.388182 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:55.388182 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:55.388182 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:55.388182 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:55.388182 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:55.388182 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:55.388182 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:55.388182 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:55.388182 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:04:55.388182 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:04:55.388182 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:04:55.388182 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:04:55.389226 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:55.389226 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:55.389226 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:04:55.389226 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:55.389226 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:04:55.389226 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:55.389226 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:55.389226 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:55.389226 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:55.389226 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:55.389226 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:55.389226 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:55.389226 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:55.389226 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:55.389226 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:55.389226 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:55.389226 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:55.389226 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:55.390786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:55.390786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:55.390786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:04:55.390786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:04:55.390786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:04:55.390786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:04:55.390786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:04:55.390786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:04:55.390786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:04:55.390786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:55.390786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 381/765] 10.222.0.17 () {56 vars in 1093 bytes} [Tue Jul 12 13:04:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:55.395709 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77b78a-bd02-4761-b2a3-b801efa0b38d None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:55.396005 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77b78a-bd02-4761-b2a3-b801efa0b38d None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:55.396285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77b78a-bd02-4761-b2a3-b801efa0b38d None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:55.398429 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 382/766] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:55.399274 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77b78a-bd02-4761-b2a3-b801efa0b38d None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:55.431234 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16d39a-2731-45e9-8aa8-744a1ebb3eec None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:55.485315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d8072-7509-4afe-9f49-d44f6c8cde1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:55.486062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d8072-7509-4afe-9f49-d44f6c8cde1c None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:55.486657 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d8072-7509-4afe-9f49-d44f6c8cde1c None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:55.486986 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d8072-7509-4afe-9f49-d44f6c8cde1c None admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:55.487787 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d8072-7509-4afe-9f49-d44f6c8cde1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:55.488102 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d8072-7509-4afe-9f49-d44f6c8cde1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:55.490627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d8072-7509-4afe-9f49-d44f6c8cde1c None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:55.509397 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 385/767] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:04:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:04:55.511443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ab4bd-54b0-42de-84bd-6480fe167c23 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:55.512575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ab4bd-54b0-42de-84bd-6480fe167c23 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:55.513065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ab4bd-54b0-42de-84bd-6480fe167c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:55.527598 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77b78a-bd02-4761-b2a3-b801efa0b38d None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:55.536331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-542ab4bd-54b0-42de-84bd-6480fe167c23 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:55.538839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-542ab4bd-54b0-42de-84bd-6480fe167c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:55.564418 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:55.569487 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fb20c-25ba-4504-ade1-d2795492163b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:55.570304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fb20c-25ba-4504-ade1-d2795492163b None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:55.570672 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fb20c-25ba-4504-ade1-d2795492163b None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:55.571022 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fb20c-25ba-4504-ade1-d2795492163b None admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:55.572217 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fb20c-25ba-4504-ade1-d2795492163b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:55.572850 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fb20c-25ba-4504-ade1-d2795492163b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:55.574839 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fb20c-25ba-4504-ade1-d2795492163b None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:55.600287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 383/768] 10.222.0.17 () {56 vars in 1133 bytes} [Tue Jul 12 13:04:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:55.600287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fb20c-25ba-4504-ade1-d2795492163b None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:55.608410 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:55.666136 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 386/769] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:04:55.666136 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ab4bd-54b0-42de-84bd-6480fe167c23 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:55.739391 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fb20c-25ba-4504-ade1-d2795492163b None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:55.776625 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f81cc-2c93-411f-9133-0c09f96cd63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:55.777321 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f81cc-2c93-411f-9133-0c09f96cd63d None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:55.777678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f81cc-2c93-411f-9133-0c09f96cd63d None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:55.778025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f81cc-2c93-411f-9133-0c09f96cd63d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:55.778973 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f81cc-2c93-411f-9133-0c09f96cd63d None admin] RBAC: Adding query filter params (role.id=88426002bf1b40c0b59071eaaba38530, scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2, user.id=72f556aac45c460cb573498aab7590fe) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:55.779354 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f81cc-2c93-411f-9133-0c09f96cd63d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:55.781040 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f81cc-2c93-411f-9133-0c09f96cd63d None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:55.787524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 384/770] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:04:55 2022] GET /identity/v3/role_assignments?user.id=72f556aac45c460cb573498aab7590fe&scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2&role.id=88426002bf1b40c0b59071eaaba38530 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:55.788637 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f81cc-2c93-411f-9133-0c09f96cd63d None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:55.809833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ab4bd-54b0-42de-84bd-6480fe167c23 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:55.850229 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f3b25-3949-4741-8916-9b6c917ad2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:55.851460 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f3b25-3949-4741-8916-9b6c917ad2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:55.851961 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f3b25-3949-4741-8916-9b6c917ad2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:55.852447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f3b25-3949-4741-8916-9b6c917ad2d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:55.853570 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:55.867000 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f3b25-3949-4741-8916-9b6c917ad2d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:55.868873 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f3b25-3949-4741-8916-9b6c917ad2d4 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:55.890672 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-cd8f3b25-3949-4741-8916-9b6c917ad2d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:55.890672 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:55.890672 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:55.890672 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:55.890672 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:55.890672 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:55.890672 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:55.890672 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:55.890672 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:55.890672 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:55.890672 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:55.890672 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:55.890672 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:55.890672 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:55.890672 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:55.891669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:55.891669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:55.891669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:55.891669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:55.891669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:55.891669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:55.891669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:55.891669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:55.891669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:55.891669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:55.891669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:55.891669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:55.891669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:55.891669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:55.891669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:55.891669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:55.891669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:55.892572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:55.892572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:55.892572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:55.892572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:55.895155 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 387/771] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:55.901611 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f3b25-3949-4741-8916-9b6c917ad2d4 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:55.905777 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f81cc-2c93-411f-9133-0c09f96cd63d None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:55.931451 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:55.943469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25ad06-b200-48ff-984b-a34d492fcbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:55.944900 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25ad06-b200-48ff-984b-a34d492fcbb2 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:55.945194 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25ad06-b200-48ff-984b-a34d492fcbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:55.945472 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25ad06-b200-48ff-984b-a34d492fcbb2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:55.946952 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25ad06-b200-48ff-984b-a34d492fcbb2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:55.947660 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25ad06-b200-48ff-984b-a34d492fcbb2 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:55.961330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-0b25ad06-b200-48ff-984b-a34d492fcbb2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 13:04:55.961330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:55.961330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:04:55.961330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:04:55.961330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:04:55.961330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:04:55.961330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:04:55.961330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:04:55.961330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 13:04:55.961330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:55.961330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:04:55.961330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:55.961330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:55.961330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:55.961330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:55.961330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:55.961330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:55.962436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:55.962436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:55.962436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:55.962436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:55.962436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:55.962436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:55.962436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:04:55.962436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:04:55.962436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:04:55.962436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:04:55.962436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:55.962436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:55.962436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:55.962436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:55.962436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:55.962436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:55.963338 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:55.963338 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:55.963338 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:55.963338 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:55.963338 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:55.963338 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:55.963338 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:55.963338 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:55.963338 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:55.963338 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:55.963338 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:04:55.963338 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:04:55.963338 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 13:04:55.963338 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:55.967842 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 385/772] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:55 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:55.969301 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25ad06-b200-48ff-984b-a34d492fcbb2 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:56.090465 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25ad06-b200-48ff-984b-a34d492fcbb2 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:56.120524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:56.153266 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f3b25-3949-4741-8916-9b6c917ad2d4 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:56.175843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a9547-ee94-4ed1-8b79-f61935ceb7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:56.176536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a9547-ee94-4ed1-8b79-f61935ceb7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:56.176821 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a9547-ee94-4ed1-8b79-f61935ceb7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:56.177095 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a9547-ee94-4ed1-8b79-f61935ceb7c0 None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:56.177812 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a9547-ee94-4ed1-8b79-f61935ceb7c0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:56.178136 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a9547-ee94-4ed1-8b79-f61935ceb7c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:56.179579 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a9547-ee94-4ed1-8b79-f61935ceb7c0 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:56.192867 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 386/773] 10.222.0.17 () {56 vars in 1112 bytes} [Tue Jul 12 13:04:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:56.198907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a9547-ee94-4ed1-8b79-f61935ceb7c0 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:56.207549 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc635c-721e-42d0-804d-e7aa33cb7c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:56.208733 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc635c-721e-42d0-804d-e7aa33cb7c9c None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:56.209231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc635c-721e-42d0-804d-e7aa33cb7c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:56.209728 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc635c-721e-42d0-804d-e7aa33cb7c9c None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:56.211248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc635c-721e-42d0-804d-e7aa33cb7c9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:56.211830 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc635c-721e-42d0-804d-e7aa33cb7c9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:56.213429 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc635c-721e-42d0-804d-e7aa33cb7c9c None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:56.238651 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 388/774] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:04:56.245291 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc635c-721e-42d0-804d-e7aa33cb7c9c None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:56.314141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a9547-ee94-4ed1-8b79-f61935ceb7c0 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:56.349703 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef698399-66c9-4c50-b978-30ad426c6346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:56.351854 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef698399-66c9-4c50-b978-30ad426c6346 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:56.352146 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef698399-66c9-4c50-b978-30ad426c6346 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:56.352425 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef698399-66c9-4c50-b978-30ad426c6346 None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:56.353134 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef698399-66c9-4c50-b978-30ad426c6346 None admin] RBAC: Adding query filter params (type=network) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:56.353448 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef698399-66c9-4c50-b978-30ad426c6346 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:56.354863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef698399-66c9-4c50-b978-30ad426c6346 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:56.365605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 387/775] 10.222.0.17 () {56 vars in 1112 bytes} [Tue Jul 12 13:04:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:56.368392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef698399-66c9-4c50-b978-30ad426c6346 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:56.400964 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:56.419241 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc635c-721e-42d0-804d-e7aa33cb7c9c None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:56.459021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:56.467235 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edaa947-b2a4-4a5a-838e-7fa4bf85bb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:56.468327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaa947-b2a4-4a5a-838e-7fa4bf85bb6e None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:56.468619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaa947-b2a4-4a5a-838e-7fa4bf85bb6e None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:56.469308 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaa947-b2a4-4a5a-838e-7fa4bf85bb6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:56.479253 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edaa947-b2a4-4a5a-838e-7fa4bf85bb6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:56.480730 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edaa947-b2a4-4a5a-838e-7fa4bf85bb6e None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:56.497096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-6edaa947-b2a4-4a5a-838e-7fa4bf85bb6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:56.497096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:56.497096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:56.497096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:56.497096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:56.497096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:56.497096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:56.497096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:56.497096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:56.497096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:56.497096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:56.497096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:56.497096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:04:56.497096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:04:56.497096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:04:56.498083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:04:56.498083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:56.498083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:56.498083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:56.498083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:56.498083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:56.498083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:56.498083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:56.498083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:56.498083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:56.498083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:56.498083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:56.498083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:56.498083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:56.498083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:56.498083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:56.498083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:56.499051 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:04:56.499051 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:04:56.499051 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:04:56.499051 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:04:56.499051 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:04:56.499051 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:04:56.499051 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:56.499051 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:56.499051 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 389/776] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:04:56.507596 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edaa947-b2a4-4a5a-838e-7fa4bf85bb6e None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:56.591461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef698399-66c9-4c50-b978-30ad426c6346 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:56.669327 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42573e-b5ca-4712-a07c-4bd2d1fc9d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:56.669935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42573e-b5ca-4712-a07c-4bd2d1fc9d32 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:56.670255 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42573e-b5ca-4712-a07c-4bd2d1fc9d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:56.670538 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42573e-b5ca-4712-a07c-4bd2d1fc9d32 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:56.672507 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42573e-b5ca-4712-a07c-4bd2d1fc9d32 None admin] RBAC: Adding query filter params (interface=public, service_id=cc80fe19c737482e8e5b1890c783e32e, region_id=RegionOne) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:56.672832 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42573e-b5ca-4712-a07c-4bd2d1fc9d32 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:56.676980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42573e-b5ca-4712-a07c-4bd2d1fc9d32 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:56.701284 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 388/777] 10.222.0.17 () {56 vars in 1251 bytes} [Tue Jul 12 13:04:56 2022] GET /identity/v3/endpoints?service_id=cc80fe19c737482e8e5b1890c783e32e&interface=public®ion_id=RegionOne => generated 194 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:56.717408 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42573e-b5ca-4712-a07c-4bd2d1fc9d32 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:56.727242 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edaa947-b2a4-4a5a-838e-7fa4bf85bb6e None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:56.785305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a123933-22d5-40f3-8a47-9c5565bb4c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:56.786405 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a123933-22d5-40f3-8a47-9c5565bb4c1b None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:56.786953 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a123933-22d5-40f3-8a47-9c5565bb4c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:56.787436 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a123933-22d5-40f3-8a47-9c5565bb4c1b None admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:56.788479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a123933-22d5-40f3-8a47-9c5565bb4c1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:56.789001 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a123933-22d5-40f3-8a47-9c5565bb4c1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:56.790683 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a123933-22d5-40f3-8a47-9c5565bb4c1b None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:56.804480 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 390/778] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:04:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:56.811200 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f07e2-22eb-4c34-a2ec-2d31ba9920a4 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:56.811838 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f07e2-22eb-4c34-a2ec-2d31ba9920a4 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:56.812334 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f07e2-22eb-4c34-a2ec-2d31ba9920a4 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:56.814228 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 391/779] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:56.815433 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f07e2-22eb-4c34-a2ec-2d31ba9920a4 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:56.824599 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:56.861056 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42573e-b5ca-4712-a07c-4bd2d1fc9d32 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:56.875511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:56.902965 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7caec52-6b2d-405c-99f3-64e22eca9331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:56.903730 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caec52-6b2d-405c-99f3-64e22eca9331 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:56.904020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caec52-6b2d-405c-99f3-64e22eca9331 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:56.904351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caec52-6b2d-405c-99f3-64e22eca9331 None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:56.905047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7caec52-6b2d-405c-99f3-64e22eca9331 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:56.907061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7caec52-6b2d-405c-99f3-64e22eca9331 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:56.917128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 389/780] 10.222.0.17 () {56 vars in 1087 bytes} [Tue Jul 12 13:04:56 2022] GET /identity/v3/services => generated 772 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:04:56.917128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb071bd1-8ab6-4019-a6a5-2db09c090a6a None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:56.917128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb071bd1-8ab6-4019-a6a5-2db09c090a6a None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:56.917128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb071bd1-8ab6-4019-a6a5-2db09c090a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:56.947412 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-bb071bd1-8ab6-4019-a6a5-2db09c090a6a None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:56.949048 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-bb071bd1-8ab6-4019-a6a5-2db09c090a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:56.962180 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f07e2-22eb-4c34-a2ec-2d31ba9920a4 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:57.047781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af28bc-27c5-4533-9055-127874e940fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:57.048965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af28bc-27c5-4533-9055-127874e940fd None admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:57.049403 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af28bc-27c5-4533-9055-127874e940fd None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:57.049833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af28bc-27c5-4533-9055-127874e940fd None admin] PATH_INFO: `/v3/projects/cd70432d4e5a4e25a4a6def32ffc6ee2/users/e52dfce1b06346bfbde6ee33e7f6f249/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:57.059256 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af28bc-27c5-4533-9055-127874e940fd None admin] RBAC: Authorizing `identity:create_grant(project_id=cd70432d4e5a4e25a4a6def32ffc6ee2, user_id=e52dfce1b06346bfbde6ee33e7f6f249, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:57.061512 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af28bc-27c5-4533-9055-127874e940fd None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:57.080041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 392/781] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Jul 12 13:04:56 2022] PUT /identity/v3/projects/cd70432d4e5a4e25a4a6def32ffc6ee2/users/e52dfce1b06346bfbde6ee33e7f6f249/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:04:57.123950 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 390/782] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:04:57.151110 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af28bc-27c5-4533-9055-127874e940fd None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:57.230021 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:57.284645 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af28bc-27c5-4533-9055-127874e940fd None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:57.324788 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbfb6b-bd8f-4a7f-ba2a-93307cf89197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:57.325621 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbfb6b-bd8f-4a7f-ba2a-93307cf89197 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:57.325907 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbfb6b-bd8f-4a7f-ba2a-93307cf89197 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:57.326215 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbfb6b-bd8f-4a7f-ba2a-93307cf89197 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:57.339773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbfb6b-bd8f-4a7f-ba2a-93307cf89197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:57.347747 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-3fcbfb6b-bd8f-4a7f-ba2a-93307cf89197 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:04:57.347747 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:57.347747 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:57.347747 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:57.347747 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:57.347747 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:57.347747 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:57.347747 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:57.347747 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:57.347747 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:57.347747 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:57.347747 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:57.347747 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:57.347747 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:57.347747 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:57.347747 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:57.348722 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:57.348722 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:57.348722 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:57.348722 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:57.348722 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:57.348722 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:57.348722 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:57.348722 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:57.348722 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:57.348722 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:57.348722 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:57.348722 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:57.348722 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:57.348722 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:57.348722 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:57.348722 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:57.349577 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:57.349577 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:57.349577 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:57.349577 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:57.349577 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:57.349577 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:57.349577 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:57.349577 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:57.349577 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:57.349577 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:57.349577 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:04:57.349577 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:57.349577 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 393/783] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:04:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:57.357926 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb071bd1-8ab6-4019-a6a5-2db09c090a6a None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:57.464268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d301b2-70ac-4090-9e21-344533502952 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:57.464615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d301b2-70ac-4090-9e21-344533502952 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:57.464824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d301b2-70ac-4090-9e21-344533502952 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:57.466215 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 394/784] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:04:57.471434 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4a60e-2c62-43c4-a3b1-8cf54a05740f None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:57.471729 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4a60e-2c62-43c4-a3b1-8cf54a05740f None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:57.472021 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4a60e-2c62-43c4-a3b1-8cf54a05740f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:57.499795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-20a4a60e-2c62-43c4-a3b1-8cf54a05740f None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:57.500946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-20a4a60e-2c62-43c4-a3b1-8cf54a05740f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:57.518043 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb071bd1-8ab6-4019-a6a5-2db09c090a6a None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:57.520659 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:57.577292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057108c-09e3-4ecc-ade8-77a7038c9d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:57.577984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057108c-09e3-4ecc-ade8-77a7038c9d1a None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:57.578292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057108c-09e3-4ecc-ade8-77a7038c9d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:57.578567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057108c-09e3-4ecc-ade8-77a7038c9d1a None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:57.579321 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057108c-09e3-4ecc-ade8-77a7038c9d1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:57.579626 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057108c-09e3-4ecc-ade8-77a7038c9d1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:57.580997 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057108c-09e3-4ecc-ade8-77a7038c9d1a None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:57.608273 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 391/785] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:04:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:57.624774 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057108c-09e3-4ecc-ade8-77a7038c9d1a None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:57.644478 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 395/786] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:04:57.668500 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4a60e-2c62-43c4-a3b1-8cf54a05740f None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:57.751852 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057108c-09e3-4ecc-ade8-77a7038c9d1a None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:57.781911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:57.800241 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf53425-7931-4c59-9680-6c39a2ab8ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:57.801059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf53425-7931-4c59-9680-6c39a2ab8ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:57.801340 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf53425-7931-4c59-9680-6c39a2ab8ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:57.801613 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf53425-7931-4c59-9680-6c39a2ab8ec3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:57.827095 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf53425-7931-4c59-9680-6c39a2ab8ec3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:57.828937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf53425-7931-4c59-9680-6c39a2ab8ec3 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:57.835865 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4a60e-2c62-43c4-a3b1-8cf54a05740f None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:57.869521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-6cf53425-7931-4c59-9680-6c39a2ab8ec3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:57.869521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:57.869521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:57.869521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:57.869521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:57.869521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:57.869521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:57.869521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:57.869521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:57.869521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:57.869521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:57.869521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:57.869521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:57.869521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:57.869521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:57.870523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:57.870523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:57.870523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:57.870523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:57.870523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:57.870523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:57.870523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:57.870523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:57.870523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:57.870523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:57.870523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:57.870523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:57.870523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:57.870523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:57.870523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:57.870523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:57.870523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:57.871446 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:57.871446 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:57.871446 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:57.871446 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:57.873328 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 392/787] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:57.879523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf53425-7931-4c59-9680-6c39a2ab8ec3 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:57.880121 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9983c4e-6fe3-4eca-95d1-448517b81958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:57.881070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9983c4e-6fe3-4eca-95d1-448517b81958 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:57.881362 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9983c4e-6fe3-4eca-95d1-448517b81958 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:57.881643 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9983c4e-6fe3-4eca-95d1-448517b81958 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:57.882384 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9983c4e-6fe3-4eca-95d1-448517b81958 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:57.889176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9983c4e-6fe3-4eca-95d1-448517b81958 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:57.902153 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-b9983c4e-6fe3-4eca-95d1-448517b81958 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 13:04:57.902153 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:57.902153 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:04:57.902153 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:04:57.902153 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:04:57.902153 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:04:57.902153 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:04:57.902153 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:04:57.902153 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 13:04:57.902153 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:57.902153 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:04:57.902153 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:57.902153 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:57.902153 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:57.902153 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:57.902153 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:57.903172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:57.903172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:57.903172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:57.903172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:57.903172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:57.903172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:57.903172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:57.903172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:04:57.903172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:04:57.903172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:04:57.903172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:04:57.903172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:57.903172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:57.903172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:57.903172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:57.903172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:57.904033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:57.904033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:57.904033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:57.904033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:57.904033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:57.904033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:57.904033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:57.904033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:57.904033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:57.904033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:57.904033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:57.904033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:04:57.904033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:04:57.904033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 13:04:57.904033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:57.904033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 396/788] 10.222.0.17 () {56 vars in 1129 bytes} [Tue Jul 12 13:04:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:57.908059 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9983c4e-6fe3-4eca-95d1-448517b81958 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:57.930496 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:58.071377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9983c4e-6fe3-4eca-95d1-448517b81958 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:58.094566 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:58.114140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276d10f-5b60-41c2-a61b-03c7f8c72807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:58.114140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276d10f-5b60-41c2-a61b-03c7f8c72807 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:58.114140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276d10f-5b60-41c2-a61b-03c7f8c72807 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:58.114140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276d10f-5b60-41c2-a61b-03c7f8c72807 None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:58.114567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276d10f-5b60-41c2-a61b-03c7f8c72807 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:58.114567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276d10f-5b60-41c2-a61b-03c7f8c72807 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:58.114737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276d10f-5b60-41c2-a61b-03c7f8c72807 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:58.121395 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 397/789] 10.222.0.17 () {56 vars in 1124 bytes} [Tue Jul 12 13:04:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:58.131614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276d10f-5b60-41c2-a61b-03c7f8c72807 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:58.232720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf53425-7931-4c59-9680-6c39a2ab8ec3 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:58.270055 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb735b-149b-4d7b-bb3e-ef28527c7031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:58.270757 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb735b-149b-4d7b-bb3e-ef28527c7031 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:58.271044 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb735b-149b-4d7b-bb3e-ef28527c7031 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:58.271320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb735b-149b-4d7b-bb3e-ef28527c7031 None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:58.272065 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb735b-149b-4d7b-bb3e-ef28527c7031 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:58.272751 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb735b-149b-4d7b-bb3e-ef28527c7031 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:58.273743 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb735b-149b-4d7b-bb3e-ef28527c7031 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:58.285448 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276d10f-5b60-41c2-a61b-03c7f8c72807 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:58.287694 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 393/790] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:58.290149 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce255b-48c3-4342-85f2-021371d95c56 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:58.290149 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce255b-48c3-4342-85f2-021371d95c56 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:58.290149 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce255b-48c3-4342-85f2-021371d95c56 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:58.295066 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 394/791] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:58.295825 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce255b-48c3-4342-85f2-021371d95c56 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:58.328485 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5475b-9196-47c3-9797-f76d1ec5be9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:58.329526 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5475b-9196-47c3-9797-f76d1ec5be9a None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:58.330199 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5475b-9196-47c3-9797-f76d1ec5be9a None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:58.330584 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5475b-9196-47c3-9797-f76d1ec5be9a None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:58.331401 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5475b-9196-47c3-9797-f76d1ec5be9a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:58.331812 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5475b-9196-47c3-9797-f76d1ec5be9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:58.333439 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5475b-9196-47c3-9797-f76d1ec5be9a None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:58.345001 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 398/792] 10.222.0.17 () {56 vars in 1124 bytes} [Tue Jul 12 13:04:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:58.345001 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb68d78-3b6d-4d54-9525-48030cd2d693 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:58.345001 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb68d78-3b6d-4d54-9525-48030cd2d693 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:58.345001 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb68d78-3b6d-4d54-9525-48030cd2d693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:58.363697 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-ccb68d78-3b6d-4d54-9525-48030cd2d693 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:58.365240 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-ccb68d78-3b6d-4d54-9525-48030cd2d693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:58.392423 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:58.418587 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:58.425949 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce255b-48c3-4342-85f2-021371d95c56 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:58.454606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 399/793] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:04:58.454606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb68d78-3b6d-4d54-9525-48030cd2d693 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:58.488277 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e936a-5427-47fa-bbd6-141eec2cd536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:58.489831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e936a-5427-47fa-bbd6-141eec2cd536 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:58.490363 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e936a-5427-47fa-bbd6-141eec2cd536 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:58.490786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e936a-5427-47fa-bbd6-141eec2cd536 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:58.501162 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e936a-5427-47fa-bbd6-141eec2cd536 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:58.502981 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e936a-5427-47fa-bbd6-141eec2cd536 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:58.521504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-066e936a-5427-47fa-bbd6-141eec2cd536 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 13:04:58.521504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:58.521504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:58.521504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:58.521504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:58.521504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:58.521504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:58.521504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:58.521504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:58.521504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:58.521504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:58.521504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:58.521504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:04:58.521504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:04:58.521504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:04:58.521504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:04:58.523231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:58.523231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:58.523231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:04:58.523231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:58.523231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:04:58.523231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:58.523231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:58.523231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:58.523231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:58.523231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:58.523231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:58.523231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:58.523231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:58.523231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:58.523231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:58.523231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:58.523231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:58.523231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:58.524375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:58.524375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:58.524375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:04:58.524375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:04:58.524375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:04:58.524375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:04:58.524375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:04:58.524375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:04:58.524375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 13:04:58.524375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:58.527152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 395/794] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:04:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:58.528296 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e936a-5427-47fa-bbd6-141eec2cd536 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:58.576220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb68d78-3b6d-4d54-9525-48030cd2d693 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:58.619012 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ac219-dc9f-456e-9b63-cd8ee70176e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:58.619881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ac219-dc9f-456e-9b63-cd8ee70176e8 None admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:58.620329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ac219-dc9f-456e-9b63-cd8ee70176e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:58.621143 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ac219-dc9f-456e-9b63-cd8ee70176e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:58.622037 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ac219-dc9f-456e-9b63-cd8ee70176e8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:58.623932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ac219-dc9f-456e-9b63-cd8ee70176e8 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:58.651002 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e936a-5427-47fa-bbd6-141eec2cd536 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:58.658139 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 400/795] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Jul 12 13:04:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:04:58.658139 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ac219-dc9f-456e-9b63-cd8ee70176e8 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:58.725707 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:58.752380 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ae1a9-12f8-44c0-a64b-1cf09898612f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:58.753610 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ae1a9-12f8-44c0-a64b-1cf09898612f None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:58.755452 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ae1a9-12f8-44c0-a64b-1cf09898612f None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:58.756069 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ae1a9-12f8-44c0-a64b-1cf09898612f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:58.761801 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:58.783294 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ae1a9-12f8-44c0-a64b-1cf09898612f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:04:58.800046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-994ae1a9-12f8-44c0-a64b-1cf09898612f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:58.800046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:58.800046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:58.800046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:58.800046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:58.800046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:58.800046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:58.800046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:58.800046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:58.800046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:58.800046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:58.800046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:58.800046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:04:58.800046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:04:58.800046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:04:58.800046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:04:58.801242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:04:58.801242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:04:58.801242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:04:58.801242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:04:58.801242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:58.801242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:58.801242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:58.801242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:58.801242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:58.801242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:58.801242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:58.801242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:58.801242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:58.801242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:58.801242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:58.801242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:58.802259 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:58.802259 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:58.802259 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:58.802259 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:58.802259 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:04:58.802259 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:04:58.802259 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:04:58.802259 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:04:58.802259 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:04:58.802259 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:04:58.802259 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:04:58.802259 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:58.805928 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 396/796] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Jul 12 13:04:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:58.815341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ae1a9-12f8-44c0-a64b-1cf09898612f None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:58.869840 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ac219-dc9f-456e-9b63-cd8ee70176e8 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:58.912732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251427a3-94ea-42fa-9ee4-ace9173497ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:58.913834 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251427a3-94ea-42fa-9ee4-ace9173497ee None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:58.914127 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251427a3-94ea-42fa-9ee4-ace9173497ee None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:58.914565 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251427a3-94ea-42fa-9ee4-ace9173497ee None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:58.916117 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251427a3-94ea-42fa-9ee4-ace9173497ee None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:58.916871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251427a3-94ea-42fa-9ee4-ace9173497ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:58.919036 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251427a3-94ea-42fa-9ee4-ace9173497ee None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:58.940083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 401/797] 10.222.0.17 () {56 vars in 1135 bytes} [Tue Jul 12 13:04:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:58.945679 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251427a3-94ea-42fa-9ee4-ace9173497ee None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:58.981595 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ae1a9-12f8-44c0-a64b-1cf09898612f None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:59.029289 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb226e2-d416-49d8-8c4a-016a62b6d9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:59.030572 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb226e2-d416-49d8-8c4a-016a62b6d9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:59.031051 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb226e2-d416-49d8-8c4a-016a62b6d9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:59.031474 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb226e2-d416-49d8-8c4a-016a62b6d9d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:59.032681 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb226e2-d416-49d8-8c4a-016a62b6d9d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:59.033735 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb226e2-d416-49d8-8c4a-016a62b6d9d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:59.035632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb226e2-d416-49d8-8c4a-016a62b6d9d0 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:59.048046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 397/798] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Jul 12 13:04:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:59.054358 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb226e2-d416-49d8-8c4a-016a62b6d9d0 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:59.062174 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:59.078149 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251427a3-94ea-42fa-9ee4-ace9173497ee None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:59.144474 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6c339-45e9-4234-a701-445aa2a64636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:59.145278 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6c339-45e9-4234-a701-445aa2a64636 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:59.145566 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6c339-45e9-4234-a701-445aa2a64636 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:59.145841 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6c339-45e9-4234-a701-445aa2a64636 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:59.161738 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:59.162353 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6c339-45e9-4234-a701-445aa2a64636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:59.165158 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6c339-45e9-4234-a701-445aa2a64636 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:59.201217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-61f6c339-45e9-4234-a701-445aa2a64636 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:59.201217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:59.201217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:59.201217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:59.201217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:59.201217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:59.201217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:59.201217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:59.201217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:59.201217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:59.201217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:59.201217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:59.201217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:59.201217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:59.201217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:59.202392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:59.202392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:59.202392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:59.202392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:59.202392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:59.202392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:59.202392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:59.202392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:59.202392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:59.202392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:59.202392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:59.202392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:59.202392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:59.202392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:59.202392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:59.202392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:59.202392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:59.203461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:59.203461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:59.203461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:59.203461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:59.203461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 402/799] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:59.208312 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6c339-45e9-4234-a701-445aa2a64636 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:59.246573 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb226e2-d416-49d8-8c4a-016a62b6d9d0 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:59.312188 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f659f-3fe8-4b2d-b863-734eb58661c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:59.312999 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f659f-3fe8-4b2d-b863-734eb58661c9 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:59.313284 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f659f-3fe8-4b2d-b863-734eb58661c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:59.313561 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f659f-3fe8-4b2d-b863-734eb58661c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:59.333431 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f659f-3fe8-4b2d-b863-734eb58661c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:59.335114 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f659f-3fe8-4b2d-b863-734eb58661c9 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:59.354598 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-784f659f-3fe8-4b2d-b863-734eb58661c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:59.354598 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:59.354598 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:59.354598 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:59.354598 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:59.354598 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:59.354598 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:59.354598 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:59.354598 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:59.354598 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:59.354598 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:59.354598 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:59.354598 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:04:59.354598 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:04:59.354598 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:04:59.355572 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:04:59.355572 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:59.355572 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:59.355572 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:59.355572 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:59.355572 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:59.355572 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:59.355572 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:59.355572 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:59.355572 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:59.355572 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:59.355572 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:59.355572 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:59.355572 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:59.355572 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:59.355572 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:59.355572 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:59.356551 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:04:59.356551 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:04:59.356551 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:04:59.356551 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:04:59.356551 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 398/800] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:04:59.361115 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6c339-45e9-4234-a701-445aa2a64636 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:59.361782 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f659f-3fe8-4b2d-b863-734eb58661c9 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:59.399067 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124132b-74c3-4897-99b0-fade0457992d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:59.400169 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124132b-74c3-4897-99b0-fade0457992d None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:59.400662 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124132b-74c3-4897-99b0-fade0457992d None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:59.401145 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124132b-74c3-4897-99b0-fade0457992d None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:59.402068 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124132b-74c3-4897-99b0-fade0457992d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:59.402611 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124132b-74c3-4897-99b0-fade0457992d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:59.404315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124132b-74c3-4897-99b0-fade0457992d None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:59.422299 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 403/801] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:04:59.423652 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71005893-42ab-4b4b-bf8c-f11cedc9e933 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:59.423943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71005893-42ab-4b4b-bf8c-f11cedc9e933 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:59.424219 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71005893-42ab-4b4b-bf8c-f11cedc9e933 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:59.425653 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 404/802] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:59.426880 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71005893-42ab-4b4b-bf8c-f11cedc9e933 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:59.435420 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:59.502926 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f659f-3fe8-4b2d-b863-734eb58661c9 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:59.512744 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:59.539302 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318807a-1305-428b-99d2-a4048079a8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:59.539977 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318807a-1305-428b-99d2-a4048079a8aa None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:59.540261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318807a-1305-428b-99d2-a4048079a8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:59.540536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318807a-1305-428b-99d2-a4048079a8aa None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:59.540748 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71005893-42ab-4b4b-bf8c-f11cedc9e933 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:59.541258 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318807a-1305-428b-99d2-a4048079a8aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:59.541563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318807a-1305-428b-99d2-a4048079a8aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:59.542969 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318807a-1305-428b-99d2-a4048079a8aa None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:59.555976 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 399/803] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:59.557264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a9c3a-8ae3-46c0-8ec0-41fdd1150034 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:59.557549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a9c3a-8ae3-46c0-8ec0-41fdd1150034 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:59.557823 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a9c3a-8ae3-46c0-8ec0-41fdd1150034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:59.574366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-d91a9c3a-8ae3-46c0-8ec0-41fdd1150034 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:59.575571 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-d91a9c3a-8ae3-46c0-8ec0-41fdd1150034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:59.582309 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38679d-1def-4db4-a9cc-4659dd164606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:59.583120 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38679d-1def-4db4-a9cc-4659dd164606 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:59.583839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38679d-1def-4db4-a9cc-4659dd164606 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:59.584126 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38679d-1def-4db4-a9cc-4659dd164606 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:59.591809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38679d-1def-4db4-a9cc-4659dd164606 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:59.593266 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38679d-1def-4db4-a9cc-4659dd164606 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:59.607904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-5a38679d-1def-4db4-a9cc-4659dd164606 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:59.607904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:59.607904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:59.607904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:59.607904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:59.607904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:59.607904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:59.607904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:59.607904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:59.607904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:59.607904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:59.607904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:59.607904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:04:59.607904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:04:59.607904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:04:59.608883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:04:59.608883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:59.608883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:59.608883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:59.608883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:59.608883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:59.608883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:59.608883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:59.608883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:59.608883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:59.608883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:59.608883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:59.608883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:59.608883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:59.608883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:59.608883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:59.608883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:59.609809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:04:59.609809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:04:59.609809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:04:59.609809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:04:59.609809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:04:59.609809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:04:59.609809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:04:59.609809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:59.609809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 405/804] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:04:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:59.611899 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75c501-289b-4750-804c-89f033561d82 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:59.611899 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75c501-289b-4750-804c-89f033561d82 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:59.611899 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75c501-289b-4750-804c-89f033561d82 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:59.614411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 406/805] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:04:59.614411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75c501-289b-4750-804c-89f033561d82 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:59.661179 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 400/806] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:04:59.662426 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a9c3a-8ae3-46c0-8ec0-41fdd1150034 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:59.705456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:59.751031 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75c501-289b-4750-804c-89f033561d82 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:59.768985 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:59.773152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a9c3a-8ae3-46c0-8ec0-41fdd1150034 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:59.792989 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc04db-1698-4910-a908-54c260bc4181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:59.793811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc04db-1698-4910-a908-54c260bc4181 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:59.794094 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc04db-1698-4910-a908-54c260bc4181 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:59.794396 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc04db-1698-4910-a908-54c260bc4181 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:59.801704 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc04db-1698-4910-a908-54c260bc4181 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:59.803175 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc04db-1698-4910-a908-54c260bc4181 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:59.812354 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb8352-3e3f-4c7c-b3d1-43df4c5c3f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:59.813026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb8352-3e3f-4c7c-b3d1-43df4c5c3f21 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:59.813314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb8352-3e3f-4c7c-b3d1-43df4c5c3f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:59.813589 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb8352-3e3f-4c7c-b3d1-43df4c5c3f21 None admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:59.814407 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb8352-3e3f-4c7c-b3d1-43df4c5c3f21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:04:59.814747 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb8352-3e3f-4c7c-b3d1-43df4c5c3f21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:04:59.816167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb8352-3e3f-4c7c-b3d1-43df4c5c3f21 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:04:59.818723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-f3dc04db-1698-4910-a908-54c260bc4181 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 13:04:59.818723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:04:59.818723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:04:59.818723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:04:59.818723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:04:59.818723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:04:59.818723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:04:59.818723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:04:59.818723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:04:59.818723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:04:59.818723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:04:59.818723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:04:59.818723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:04:59.818723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:04:59.818723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:04:59.818723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:04:59.820248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:04:59.820248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:04:59.820248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:04:59.820248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:59.820248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:04:59.820248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:04:59.820248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:04:59.820248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:04:59.820248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:04:59.820248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:04:59.820248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:04:59.820248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:04:59.820248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:04:59.820248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:04:59.820248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:04:59.820248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:04:59.820248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:04:59.820248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:04:59.821205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:04:59.821205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:04:59.821205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:04:59.821205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:04:59.821205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:04:59.821205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:04:59.821205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:04:59.821205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:04:59.821205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 13:04:59.821205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:04:59.825241 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 407/807] 10.222.0.17 () {56 vars in 1117 bytes} [Tue Jul 12 13:04:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:04:59.826549 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed490a8-1388-4dd4-8b31-da35f3c7637e None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:59.826840 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed490a8-1388-4dd4-8b31-da35f3c7637e None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:59.827118 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed490a8-1388-4dd4-8b31-da35f3c7637e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:04:59.836048 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 401/808] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:04:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:04:59.836048 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb8352-3e3f-4c7c-b3d1-43df4c5c3f21 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:59.843441 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-bed490a8-1388-4dd4-8b31-da35f3c7637e None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:04:59.844628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-bed490a8-1388-4dd4-8b31-da35f3c7637e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:04:59.915930 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 408/809] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:04:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:04:59.916686 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed490a8-1388-4dd4-8b31-da35f3c7637e None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:04:59.959545 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb8352-3e3f-4c7c-b3d1-43df4c5c3f21 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:04:59.982789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:04:59.996339 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4d738-aca0-46f4-ab68-60f1d6700cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:04:59.997136 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4d738-aca0-46f4-ab68-60f1d6700cdc None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:04:59.997417 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4d738-aca0-46f4-ab68-60f1d6700cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:04:59.997690 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4d738-aca0-46f4-ab68-60f1d6700cdc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:00.013690 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4d738-aca0-46f4-ab68-60f1d6700cdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:05:00.021351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-6df4d738-aca0-46f4-ab68-60f1d6700cdc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:05:00.021351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:00.021351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:00.021351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:00.021351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:00.021351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:00.021351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:00.021351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:00.021351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:00.021351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:00.021351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:00.021351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:00.021351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:05:00.021351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:05:00.021351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:05:00.021351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:05:00.022372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:05:00.022372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:05:00.022372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:05:00.022372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:05:00.022372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:00.022372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:00.022372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:00.022372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:00.022372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:00.022372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:00.022372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:00.022372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:00.022372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:00.022372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:00.022372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:00.022372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:00.023235 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:00.023235 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:00.023235 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:00.023235 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:00.023235 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:05:00.023235 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:05:00.023235 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:05:00.023235 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:05:00.023235 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:05:00.023235 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:05:00.023235 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:05:00.023235 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:00.027521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 402/810] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:04:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:00.028403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4d738-aca0-46f4-ab68-60f1d6700cdc None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:00.038248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed490a8-1388-4dd4-8b31-da35f3c7637e None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:00.047790 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:00.080503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80efeb-3304-4962-be18-3f538c163270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:00.081184 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80efeb-3304-4962-be18-3f538c163270 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:00.081468 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80efeb-3304-4962-be18-3f538c163270 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:00.081741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80efeb-3304-4962-be18-3f538c163270 None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:00.082626 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80efeb-3304-4962-be18-3f538c163270 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:00.082929 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80efeb-3304-4962-be18-3f538c163270 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:00.084574 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80efeb-3304-4962-be18-3f538c163270 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:00.106516 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 409/811] 10.222.0.17 () {56 vars in 1149 bytes} [Tue Jul 12 13:04:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:00.111519 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80efeb-3304-4962-be18-3f538c163270 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:00.155114 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4d738-aca0-46f4-ab68-60f1d6700cdc None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:00.193878 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8631287-9437-4d01-8800-dc3a2ab33eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:00.194966 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8631287-9437-4d01-8800-dc3a2ab33eb9 None admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:00.195357 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8631287-9437-4d01-8800-dc3a2ab33eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:00.195704 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8631287-9437-4d01-8800-dc3a2ab33eb9 None admin] PATH_INFO: `/v3/projects/cd70432d4e5a4e25a4a6def32ffc6ee2/users/fe10f0f42b8247c99ed5f88eff5065e3/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:00.197810 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8631287-9437-4d01-8800-dc3a2ab33eb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd70432d4e5a4e25a4a6def32ffc6ee2, user_id=fe10f0f42b8247c99ed5f88eff5065e3, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:00.199357 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8631287-9437-4d01-8800-dc3a2ab33eb9 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:00.213387 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 403/812] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Jul 12 13:05:00 2022] PUT /identity/v3/projects/cd70432d4e5a4e25a4a6def32ffc6ee2/users/fe10f0f42b8247c99ed5f88eff5065e3/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:05:00.214370 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8631287-9437-4d01-8800-dc3a2ab33eb9 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:00.238842 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80efeb-3304-4962-be18-3f538c163270 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:00.262233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:00.289766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2692a3-6e1e-4548-b259-4a25e6729181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:00.293292 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2692a3-6e1e-4548-b259-4a25e6729181 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:00.294624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2692a3-6e1e-4548-b259-4a25e6729181 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:00.295150 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2692a3-6e1e-4548-b259-4a25e6729181 None admin] PATH_INFO: `/v3/services/network` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:00.296396 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2692a3-6e1e-4548-b259-4a25e6729181 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:00.299008 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2692a3-6e1e-4548-b259-4a25e6729181 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:00.314699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-4f2692a3-6e1e-4548-b259-4a25e6729181 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 13:05:00.314699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:00.314699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:05:00.314699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:05:00.314699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:05:00.314699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:05:00.314699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:05:00.314699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:00.314699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 13:05:00.314699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:00.314699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:05:00.314699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:00.314699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:00.314699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:00.314699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:00.314699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:00.314699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:00.315821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:00.315821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:00.315821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:00.315821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:00.315821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:00.315821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:00.315821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:05:00.315821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:05:00.315821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:05:00.315821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:05:00.315821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:00.315821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:00.315821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:00.315821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:00.315821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:00.315821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:00.316663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:00.316663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:00.316663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:00.316663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:00.316663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:00.316663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:00.316663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:00.316663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:00.316663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:00.316663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:00.316663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:05:00.316663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:00.316663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 13:05:00.316663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:00.316663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 410/813] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:05:00 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:00.317484 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2692a3-6e1e-4548-b259-4a25e6729181 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:00.334489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:00.369810 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8631287-9437-4d01-8800-dc3a2ab33eb9 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:00.417097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b5e7b-732c-49bf-9a3e-eb8c2f4bd6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:00.417664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b5e7b-732c-49bf-9a3e-eb8c2f4bd6cc None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:00.418099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b5e7b-732c-49bf-9a3e-eb8c2f4bd6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:00.418321 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b5e7b-732c-49bf-9a3e-eb8c2f4bd6cc None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:00.419096 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b5e7b-732c-49bf-9a3e-eb8c2f4bd6cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:00.419410 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b5e7b-732c-49bf-9a3e-eb8c2f4bd6cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:00.420799 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b5e7b-732c-49bf-9a3e-eb8c2f4bd6cc None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:00.434541 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 404/814] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:05:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:00.434541 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b5e7b-732c-49bf-9a3e-eb8c2f4bd6cc None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:00.459703 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2692a3-6e1e-4548-b259-4a25e6729181 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:00.506034 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ebc9e-4519-43a9-93a0-10908c914ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:00.507412 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ebc9e-4519-43a9-93a0-10908c914ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:00.507848 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ebc9e-4519-43a9-93a0-10908c914ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:00.508885 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ebc9e-4519-43a9-93a0-10908c914ca9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:00.524876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ebc9e-4519-43a9-93a0-10908c914ca9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:00.526883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ebc9e-4519-43a9-93a0-10908c914ca9 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:00.545952 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-466ebc9e-4519-43a9-93a0-10908c914ca9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:00.545952 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:00.545952 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:00.545952 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:00.545952 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:00.545952 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:00.545952 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:00.545952 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:00.545952 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:00.545952 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:00.545952 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:00.545952 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:00.545952 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:05:00.545952 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:05:00.545952 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:05:00.547125 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:05:00.547125 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:00.547125 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:00.547125 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:00.547125 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:00.547125 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:00.547125 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:00.547125 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:00.547125 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:00.547125 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:00.547125 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:00.547125 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:00.547125 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:00.547125 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:00.547125 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:00.547125 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:00.547125 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:00.548224 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:05:00.548224 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:05:00.548224 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:00.548224 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:00.549383 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 411/815] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:00.554429 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ebc9e-4519-43a9-93a0-10908c914ca9 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:00.559264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b5e7b-732c-49bf-9a3e-eb8c2f4bd6cc None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:00.595935 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:00.603244 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a63c44-562b-4610-9ed5-4811d45bfbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:00.604168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a63c44-562b-4610-9ed5-4811d45bfbdb None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:00.604639 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a63c44-562b-4610-9ed5-4811d45bfbdb None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:00.605090 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a63c44-562b-4610-9ed5-4811d45bfbdb None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:00.605946 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a63c44-562b-4610-9ed5-4811d45bfbdb None admin] RBAC: Adding query filter params (name=network) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:00.606427 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a63c44-562b-4610-9ed5-4811d45bfbdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:00.608022 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a63c44-562b-4610-9ed5-4811d45bfbdb None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:00.618251 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 405/816] 10.222.0.17 () {56 vars in 1112 bytes} [Tue Jul 12 13:05:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:00.619463 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a63c44-562b-4610-9ed5-4811d45bfbdb None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:00.624380 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:00.702854 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ebc9e-4519-43a9-93a0-10908c914ca9 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:00.738191 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a63c44-562b-4610-9ed5-4811d45bfbdb None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:00.751116 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284f84f-b688-4506-ba92-be97d2c15532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:00.752373 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284f84f-b688-4506-ba92-be97d2c15532 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:00.752761 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284f84f-b688-4506-ba92-be97d2c15532 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:00.753163 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284f84f-b688-4506-ba92-be97d2c15532 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:00.769327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284f84f-b688-4506-ba92-be97d2c15532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:00.770870 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284f84f-b688-4506-ba92-be97d2c15532 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:00.780251 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55baefd7-af7a-46ff-b99e-bd9f8572d7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:00.781959 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55baefd7-af7a-46ff-b99e-bd9f8572d7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:00.782541 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55baefd7-af7a-46ff-b99e-bd9f8572d7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:00.783474 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55baefd7-af7a-46ff-b99e-bd9f8572d7a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:00.785005 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55baefd7-af7a-46ff-b99e-bd9f8572d7a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:00.785517 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55baefd7-af7a-46ff-b99e-bd9f8572d7a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:00.787143 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55baefd7-af7a-46ff-b99e-bd9f8572d7a6 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:00.794327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-2284f84f-b688-4506-ba92-be97d2c15532 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:00.794327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:00.794327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:00.794327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:00.794327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:00.794327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:00.794327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:00.794327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:00.794327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:00.794327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:00.794327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:00.794327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:00.794327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:05:00.794327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:05:00.794327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:05:00.795305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:05:00.795305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:00.795305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:00.795305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:00.795305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:00.795305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:00.795305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:00.795305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:00.795305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:00.795305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:00.795305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:00.795305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:00.795305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:00.795305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:00.795305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:00.795305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:00.795305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:00.796385 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:05:00.796385 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:05:00.796385 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:00.796385 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:00.796385 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 412/817] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:00.797288 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284f84f-b688-4506-ba92-be97d2c15532 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:00.807004 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 406/818] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:00.808150 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55baefd7-af7a-46ff-b99e-bd9f8572d7a6 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:00.893570 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:00.904234 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:00.928081 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284f84f-b688-4506-ba92-be97d2c15532 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:00.938786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55baefd7-af7a-46ff-b99e-bd9f8572d7a6 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:00.964390 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729eb9fb-f40c-4afe-9cbd-b16f6e2c93a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:00.965217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729eb9fb-f40c-4afe-9cbd-b16f6e2c93a8 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:00.965604 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729eb9fb-f40c-4afe-9cbd-b16f6e2c93a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:00.965994 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729eb9fb-f40c-4afe-9cbd-b16f6e2c93a8 None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:00.966833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729eb9fb-f40c-4afe-9cbd-b16f6e2c93a8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:00.967241 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729eb9fb-f40c-4afe-9cbd-b16f6e2c93a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:00.968719 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729eb9fb-f40c-4afe-9cbd-b16f6e2c93a8 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:00.978208 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 413/819] 10.222.0.17 () {56 vars in 1112 bytes} [Tue Jul 12 13:05:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:00.979333 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729eb9fb-f40c-4afe-9cbd-b16f6e2c93a8 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:00.983592 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480e1c3-4d39-42a9-856d-be909fb1c80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:00.984786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480e1c3-4d39-42a9-856d-be909fb1c80b None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:00.984786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480e1c3-4d39-42a9-856d-be909fb1c80b None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:00.984981 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480e1c3-4d39-42a9-856d-be909fb1c80b None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:00.985671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480e1c3-4d39-42a9-856d-be909fb1c80b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:00.985987 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480e1c3-4d39-42a9-856d-be909fb1c80b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:00.987395 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480e1c3-4d39-42a9-856d-be909fb1c80b None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:01.000905 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 407/820] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:01.001728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480e1c3-4d39-42a9-856d-be909fb1c80b None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:01.090721 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729eb9fb-f40c-4afe-9cbd-b16f6e2c93a8 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:01.114751 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480e1c3-4d39-42a9-856d-be909fb1c80b None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:01.126608 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9b6e1-0600-480a-86c9-6bfc2428cd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:01.127424 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9b6e1-0600-480a-86c9-6bfc2428cd7d None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:01.127711 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9b6e1-0600-480a-86c9-6bfc2428cd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:01.127988 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9b6e1-0600-480a-86c9-6bfc2428cd7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:01.136167 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9b6e1-0600-480a-86c9-6bfc2428cd7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:01.137625 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9b6e1-0600-480a-86c9-6bfc2428cd7d None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:01.141606 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:01.153279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-6db9b6e1-0600-480a-86c9-6bfc2428cd7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:05:01.153279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:01.153279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:01.153279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:01.153279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:01.153279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:01.153279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:01.153279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:01.153279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:01.153279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:01.153279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:01.153279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:01.153279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:05:01.153279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:05:01.153279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:05:01.154398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:05:01.154398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:01.154398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:01.154398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:01.154398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:01.154398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:01.154398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:01.154398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:01.154398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:01.154398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:01.154398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:01.154398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:01.154398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:01.154398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:01.154398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:01.154398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:01.154398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:01.155501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:05:01.155501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:05:01.155501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:05:01.155501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:05:01.155501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:05:01.155501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:05:01.155501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:05:01.155501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:01.161158 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 414/821] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:05:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:01.161299 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9360a-54bf-4533-9c3c-3acb1a567e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:01.161400 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9b6e1-0600-480a-86c9-6bfc2428cd7d None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:01.161475 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9360a-54bf-4533-9c3c-3acb1a567e0f None admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:01.161475 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9360a-54bf-4533-9c3c-3acb1a567e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:01.161475 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9360a-54bf-4533-9c3c-3acb1a567e0f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:01.161475 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de9360a-54bf-4533-9c3c-3acb1a567e0f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:01.161475 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de9360a-54bf-4533-9c3c-3acb1a567e0f None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:01.163925 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:01.183189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 408/822] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Jul 12 13:05:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:05:01.184824 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78e509-7e44-4d6c-bd9d-22718924cfa2 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:01.185138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78e509-7e44-4d6c-bd9d-22718924cfa2 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:01.185399 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78e509-7e44-4d6c-bd9d-22718924cfa2 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:01.190908 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 409/823] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:01.190908 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78e509-7e44-4d6c-bd9d-22718924cfa2 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:01.321465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9b6e1-0600-480a-86c9-6bfc2428cd7d None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:01.326942 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78e509-7e44-4d6c-bd9d-22718924cfa2 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:01.371509 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1acaf1-a15b-4165-bb63-2b5a2f8e788c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:01.372337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1acaf1-a15b-4165-bb63-2b5a2f8e788c None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:01.372675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1acaf1-a15b-4165-bb63-2b5a2f8e788c None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:01.372962 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1acaf1-a15b-4165-bb63-2b5a2f8e788c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:01.374730 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd98a1-5a1e-4ca0-b2c2-42987d181a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:01.375765 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd98a1-5a1e-4ca0-b2c2-42987d181a47 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:01.376380 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd98a1-5a1e-4ca0-b2c2-42987d181a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:01.376751 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd98a1-5a1e-4ca0-b2c2-42987d181a47 None admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:01.377655 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd98a1-5a1e-4ca0-b2c2-42987d181a47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:01.378071 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd98a1-5a1e-4ca0-b2c2-42987d181a47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:01.379660 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd98a1-5a1e-4ca0-b2c2-42987d181a47 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:01.383372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1acaf1-a15b-4165-bb63-2b5a2f8e788c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:01.384828 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1acaf1-a15b-4165-bb63-2b5a2f8e788c None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:01.396747 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 410/824] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:05:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:01.399477 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539371a-e903-43e7-b466-67d7edcd8045 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:01.399906 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539371a-e903-43e7-b466-67d7edcd8045 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:01.400346 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539371a-e903-43e7-b466-67d7edcd8045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:01.404050 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-2d1acaf1-a15b-4165-bb63-2b5a2f8e788c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:05:01.404050 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:01.404050 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:01.404050 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:01.404050 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:01.404050 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:01.404050 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:01.404050 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:01.404050 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:01.404050 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:01.404050 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:01.404050 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:01.404050 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:05:01.404050 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:05:01.404050 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:05:01.404050 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:05:01.405017 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:01.405017 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:01.405017 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:05:01.405017 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:05:01.405017 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:05:01.405017 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:05:01.405017 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:01.405017 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:01.405017 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:01.405017 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:01.405017 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:01.405017 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:01.405017 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:01.405017 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:01.405017 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:01.405017 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:01.405017 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:01.405017 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:01.406093 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:01.406093 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:01.406093 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:05:01.406093 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:05:01.406093 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:05:01.406093 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:05:01.406093 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:05:01.406093 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:05:01.406093 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:05:01.406093 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:01.406093 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 415/825] 10.222.0.17 () {56 vars in 1093 bytes} [Tue Jul 12 13:05:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:01.406860 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1acaf1-a15b-4165-bb63-2b5a2f8e788c None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:01.426224 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-d539371a-e903-43e7-b466-67d7edcd8045 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:01.427543 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-d539371a-e903-43e7-b466-67d7edcd8045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:01.471546 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:01.487537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:01.517446 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 411/826] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:01.521858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539371a-e903-43e7-b466-67d7edcd8045 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:01.530853 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1acaf1-a15b-4165-bb63-2b5a2f8e788c None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:01.566199 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6338889-ffc3-4001-9663-9a5e7fc90525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:01.567262 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6338889-ffc3-4001-9663-9a5e7fc90525 None admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:01.567545 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6338889-ffc3-4001-9663-9a5e7fc90525 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:01.567820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6338889-ffc3-4001-9663-9a5e7fc90525 None admin] PATH_INFO: `/v3/projects/cd70432d4e5a4e25a4a6def32ffc6ee2/users/72f556aac45c460cb573498aab7590fe/roles/88426002bf1b40c0b59071eaaba38530` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:01.583319 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6338889-ffc3-4001-9663-9a5e7fc90525 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd70432d4e5a4e25a4a6def32ffc6ee2, user_id=72f556aac45c460cb573498aab7590fe, role_id=88426002bf1b40c0b59071eaaba38530)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:01.584688 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6338889-ffc3-4001-9663-9a5e7fc90525 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:01.599069 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 416/827] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Jul 12 13:05:01 2022] PUT /identity/v3/projects/cd70432d4e5a4e25a4a6def32ffc6ee2/users/72f556aac45c460cb573498aab7590fe/roles/88426002bf1b40c0b59071eaaba38530 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:05:01.599849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6338889-ffc3-4001-9663-9a5e7fc90525 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:01.654223 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539371a-e903-43e7-b466-67d7edcd8045 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:01.707072 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d0826-68eb-41e1-9924-81339262f9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:01.707780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d0826-68eb-41e1-9924-81339262f9d8 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:01.708062 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d0826-68eb-41e1-9924-81339262f9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:01.708341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d0826-68eb-41e1-9924-81339262f9d8 None admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:01.709620 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d0826-68eb-41e1-9924-81339262f9d8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:01.709620 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d0826-68eb-41e1-9924-81339262f9d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:01.711758 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d0826-68eb-41e1-9924-81339262f9d8 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:01.733359 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 412/828] 10.222.0.17 () {56 vars in 1133 bytes} [Tue Jul 12 13:05:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:01.742454 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d0826-68eb-41e1-9924-81339262f9d8 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:01.759158 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6338889-ffc3-4001-9663-9a5e7fc90525 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:01.775901 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:01.776517 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:01.806609 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866624ba-d6bc-459d-8ed5-e27eeb37b535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:01.807768 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866624ba-d6bc-459d-8ed5-e27eeb37b535 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:01.808234 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866624ba-d6bc-459d-8ed5-e27eeb37b535 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:01.808702 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866624ba-d6bc-459d-8ed5-e27eeb37b535 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:01.809598 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866624ba-d6bc-459d-8ed5-e27eeb37b535 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:01.811211 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866624ba-d6bc-459d-8ed5-e27eeb37b535 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:01.824755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-866624ba-d6bc-459d-8ed5-e27eeb37b535 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 13:05:01.824755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:01.824755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:05:01.824755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:05:01.824755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:05:01.824755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:05:01.824755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:05:01.824755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:01.824755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 13:05:01.824755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:01.824755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:05:01.824755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:01.824755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:01.824755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:01.824755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:01.824755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:01.824755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:01.826041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:01.826041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:01.826041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:01.826041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:01.826041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:01.826041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:01.826041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:05:01.826041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:05:01.826041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:05:01.826041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:05:01.826041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:01.826041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:01.826041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:01.826041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:01.826041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:01.826041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:01.827161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:01.827161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:01.827161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:01.827161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:01.827161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:01.827161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:01.827161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:01.827161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:01.827161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:01.827161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:01.827161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:05:01.827161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:01.827161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 13:05:01.827161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:01.833301 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 417/829] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Jul 12 13:05:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:01.834061 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866624ba-d6bc-459d-8ed5-e27eeb37b535 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:01.891734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d0826-68eb-41e1-9924-81339262f9d8 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:01.946435 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de874795-c868-4cce-84fe-738c5071559b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:01.947815 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de874795-c868-4cce-84fe-738c5071559b None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:01.948474 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de874795-c868-4cce-84fe-738c5071559b None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:01.948858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de874795-c868-4cce-84fe-738c5071559b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:01.958257 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866624ba-d6bc-459d-8ed5-e27eeb37b535 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:02.000386 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44ae9c-9544-4ea1-a1cd-cdee3d8f14eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:02.001174 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44ae9c-9544-4ea1-a1cd-cdee3d8f14eb None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:02.001463 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44ae9c-9544-4ea1-a1cd-cdee3d8f14eb None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:02.001891 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44ae9c-9544-4ea1-a1cd-cdee3d8f14eb None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:02.002694 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44ae9c-9544-4ea1-a1cd-cdee3d8f14eb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:02.003010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44ae9c-9544-4ea1-a1cd-cdee3d8f14eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:02.004411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44ae9c-9544-4ea1-a1cd-cdee3d8f14eb None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:02.011092 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 418/830] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Jul 12 13:05:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:02.016888 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44ae9c-9544-4ea1-a1cd-cdee3d8f14eb None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:02.046869 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de874795-c868-4cce-84fe-738c5071559b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:02.049089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de874795-c868-4cce-84fe-738c5071559b None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:02.080562 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:02.082864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:02.150948 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44ae9c-9544-4ea1-a1cd-cdee3d8f14eb None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:02.184612 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 413/831] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:05:01 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:05:02.189684 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de874795-c868-4cce-84fe-738c5071559b None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:02.194050 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15ef61-cc9a-4cb5-8e1b-9c14b94ac662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:02.195306 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15ef61-cc9a-4cb5-8e1b-9c14b94ac662 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:02.195598 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15ef61-cc9a-4cb5-8e1b-9c14b94ac662 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:02.195881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15ef61-cc9a-4cb5-8e1b-9c14b94ac662 None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:02.196602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15ef61-cc9a-4cb5-8e1b-9c14b94ac662 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:02.196976 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15ef61-cc9a-4cb5-8e1b-9c14b94ac662 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:02.198468 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15ef61-cc9a-4cb5-8e1b-9c14b94ac662 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:02.203870 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 419/832] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Jul 12 13:05:02 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:02.304767 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de874795-c868-4cce-84fe-738c5071559b None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:02.332797 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:02.345012 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714d22c-4793-480c-ac35-6ebd3dbbdceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:02.346428 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714d22c-4793-480c-ac35-6ebd3dbbdceb None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:02.346964 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714d22c-4793-480c-ac35-6ebd3dbbdceb None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:02.347579 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714d22c-4793-480c-ac35-6ebd3dbbdceb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:02.359829 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714d22c-4793-480c-ac35-6ebd3dbbdceb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:02.361289 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714d22c-4793-480c-ac35-6ebd3dbbdceb None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:02.379845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-3714d22c-4793-480c-ac35-6ebd3dbbdceb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:02.379845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:02.379845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:02.379845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:02.379845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:02.379845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:02.379845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:02.379845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:02.379845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:02.379845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:02.379845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:02.379845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:02.379845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:05:02.379845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:05:02.379845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:05:02.380955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:05:02.380955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:02.380955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:02.380955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:02.380955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:02.380955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:02.380955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:02.380955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:02.380955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:02.380955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:02.380955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:02.380955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:02.380955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:02.380955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:02.380955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:02.380955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:02.380955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:02.382651 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:05:02.382651 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:05:02.382651 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:02.382651 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:02.382651 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 414/833] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:05:02.388999 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15ef61-cc9a-4cb5-8e1b-9c14b94ac662 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:02.407587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcdf01-44e0-43a6-be34-93b2198089cb None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:02.407964 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcdf01-44e0-43a6-be34-93b2198089cb None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:02.408378 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcdf01-44e0-43a6-be34-93b2198089cb None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:02.410138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 415/834] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:02.416373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e93b3-2d1d-4db4-95f8-cf2dc448f319 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:02.417039 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e93b3-2d1d-4db4-95f8-cf2dc448f319 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:02.417419 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e93b3-2d1d-4db4-95f8-cf2dc448f319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:02.438828 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-321e93b3-2d1d-4db4-95f8-cf2dc448f319 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:02.440101 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-321e93b3-2d1d-4db4-95f8-cf2dc448f319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:02.502991 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15ef61-cc9a-4cb5-8e1b-9c14b94ac662 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:02.506017 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:02.530215 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 416/835] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:05:02.547639 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f9abb-326a-4b18-9715-4d80cd9e4c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:02.548650 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f9abb-326a-4b18-9715-4d80cd9e4c29 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:02.549137 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f9abb-326a-4b18-9715-4d80cd9e4c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:02.549613 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f9abb-326a-4b18-9715-4d80cd9e4c29 None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:02.550634 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f9abb-326a-4b18-9715-4d80cd9e4c29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:02.551143 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f9abb-326a-4b18-9715-4d80cd9e4c29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:02.552721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e93b3-2d1d-4db4-95f8-cf2dc448f319 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:02.555373 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f9abb-326a-4b18-9715-4d80cd9e4c29 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:02.571403 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 420/836] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:02.576548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f9abb-326a-4b18-9715-4d80cd9e4c29 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:02.685716 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e93b3-2d1d-4db4-95f8-cf2dc448f319 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:02.693405 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:02.715522 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f9abb-326a-4b18-9715-4d80cd9e4c29 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:02.727423 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb900b7-fdd3-4b40-ab58-2b0735b2588d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:02.728234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb900b7-fdd3-4b40-ab58-2b0735b2588d None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:02.728522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb900b7-fdd3-4b40-ab58-2b0735b2588d None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:02.728801 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb900b7-fdd3-4b40-ab58-2b0735b2588d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:02.739729 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb900b7-fdd3-4b40-ab58-2b0735b2588d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:05:02.747529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-8cb900b7-fdd3-4b40-ab58-2b0735b2588d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:05:02.747529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:02.747529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:02.747529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:02.747529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:02.747529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:02.747529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:02.747529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:02.747529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:02.747529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:02.747529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:02.747529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:02.747529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:05:02.747529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:05:02.747529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:05:02.747529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:05:02.748471 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:05:02.748471 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:05:02.748471 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:05:02.748471 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:05:02.748471 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:02.748471 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:02.748471 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:02.748471 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:02.748471 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:02.748471 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:02.748471 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:02.748471 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:02.748471 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:02.748471 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:02.748471 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:02.748471 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:02.749318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:02.749318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:02.749318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:02.749318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:02.749318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:05:02.749318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:05:02.749318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:05:02.749318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:05:02.749318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:05:02.749318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:05:02.749318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:05:02.749318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:02.749318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 417/837] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:05:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:05:02.755715 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb900b7-fdd3-4b40-ab58-2b0735b2588d None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:02.760286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19118ec-fba1-478b-83fe-1ac968633a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:02.761625 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19118ec-fba1-478b-83fe-1ac968633a4d None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:02.762498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19118ec-fba1-478b-83fe-1ac968633a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:02.762861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19118ec-fba1-478b-83fe-1ac968633a4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:02.772014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19118ec-fba1-478b-83fe-1ac968633a4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:02.774660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19118ec-fba1-478b-83fe-1ac968633a4d None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:02.798298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-b19118ec-fba1-478b-83fe-1ac968633a4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:05:02.798298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:02.798298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:02.798298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:02.798298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:02.798298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:02.798298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:02.798298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:02.798298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:02.798298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:02.798298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:02.798298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:02.798298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:05:02.798298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:05:02.798298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:05:02.799251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:05:02.799251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:02.799251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:02.799251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:02.799251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:02.799251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:02.799251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:02.799251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:02.799251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:02.799251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:02.799251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:02.799251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:02.799251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:02.799251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:02.799251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:02.799251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:02.799251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:02.800148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:05:02.800148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:05:02.800148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:05:02.800148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:05:02.800148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:05:02.800148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:05:02.800148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:05:02.800148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:02.805918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 421/838] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:05:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:02.810502 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19118ec-fba1-478b-83fe-1ac968633a4d None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:02.845350 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:02.890467 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb900b7-fdd3-4b40-ab58-2b0735b2588d None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:02.929056 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb49148-ee57-4a16-bfd4-b0f5b8d56759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:02.930164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb49148-ee57-4a16-bfd4-b0f5b8d56759 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:02.930682 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb49148-ee57-4a16-bfd4-b0f5b8d56759 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:02.931196 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb49148-ee57-4a16-bfd4-b0f5b8d56759 None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:02.932145 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb49148-ee57-4a16-bfd4-b0f5b8d56759 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:02.932655 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb49148-ee57-4a16-bfd4-b0f5b8d56759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:02.934269 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb49148-ee57-4a16-bfd4-b0f5b8d56759 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:02.948190 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19118ec-fba1-478b-83fe-1ac968633a4d None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:02.948531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 418/839] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:05:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:02.949711 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb49148-ee57-4a16-bfd4-b0f5b8d56759 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:02.989120 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:02.994373 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974d3ec-9f1c-4e60-abf6-2d0302fca607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:02.995770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974d3ec-9f1c-4e60-abf6-2d0302fca607 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:02.995770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974d3ec-9f1c-4e60-abf6-2d0302fca607 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:02.996441 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974d3ec-9f1c-4e60-abf6-2d0302fca607 None admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:02.997491 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974d3ec-9f1c-4e60-abf6-2d0302fca607 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:02.998034 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974d3ec-9f1c-4e60-abf6-2d0302fca607 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:02.999945 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974d3ec-9f1c-4e60-abf6-2d0302fca607 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:03.016260 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 422/840] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:05:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:03.023611 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974d3ec-9f1c-4e60-abf6-2d0302fca607 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:03.071286 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb49148-ee57-4a16-bfd4-b0f5b8d56759 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:03.106829 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e607b4-8dc9-46a7-9463-8f2a6d1fca5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:03.108015 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e607b4-8dc9-46a7-9463-8f2a6d1fca5c None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:03.108502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e607b4-8dc9-46a7-9463-8f2a6d1fca5c None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:03.108977 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e607b4-8dc9-46a7-9463-8f2a6d1fca5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:03.115324 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:03.121960 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e607b4-8dc9-46a7-9463-8f2a6d1fca5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:03.123904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e607b4-8dc9-46a7-9463-8f2a6d1fca5c None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:03.133678 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974d3ec-9f1c-4e60-abf6-2d0302fca607 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:03.143780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-09e607b4-8dc9-46a7-9463-8f2a6d1fca5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:03.143780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:03.143780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:03.143780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:03.143780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:03.143780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:03.143780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:03.143780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:03.143780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:03.143780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:03.143780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:03.143780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:03.143780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:05:03.143780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:05:03.143780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:05:03.144701 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:05:03.144701 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:03.144701 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:03.144701 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:03.144701 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:03.144701 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:03.144701 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:03.144701 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:03.144701 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:03.144701 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:03.144701 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:03.144701 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:03.144701 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:03.144701 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:03.144701 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:03.144701 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:03.144701 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:03.145672 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:05:03.145672 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:05:03.145672 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:03.145672 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:03.153100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 419/841] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:03.154704 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e607b4-8dc9-46a7-9463-8f2a6d1fca5c None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:03.173525 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d730a99-3eaf-45f7-ab57-b8e2fca10bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:03.174279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d730a99-3eaf-45f7-ab57-b8e2fca10bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:03.174565 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d730a99-3eaf-45f7-ab57-b8e2fca10bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:03.174824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d730a99-3eaf-45f7-ab57-b8e2fca10bf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:03.175708 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d730a99-3eaf-45f7-ab57-b8e2fca10bf6 None admin] RBAC: Adding query filter params (role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0, scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2, user.id=e52dfce1b06346bfbde6ee33e7f6f249) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:03.176204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d730a99-3eaf-45f7-ab57-b8e2fca10bf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:03.177887 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d730a99-3eaf-45f7-ab57-b8e2fca10bf6 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:03.190477 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 423/842] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:05:03 2022] GET /identity/v3/role_assignments?user.id=e52dfce1b06346bfbde6ee33e7f6f249&scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2&role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:03.252227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:03.276870 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e607b4-8dc9-46a7-9463-8f2a6d1fca5c None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:03.317465 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6bb96-ed7d-48b5-aef0-b5c585292114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:03.318196 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6bb96-ed7d-48b5-aef0-b5c585292114 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:03.318488 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6bb96-ed7d-48b5-aef0-b5c585292114 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:03.318765 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6bb96-ed7d-48b5-aef0-b5c585292114 None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:03.319556 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6bb96-ed7d-48b5-aef0-b5c585292114 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:03.319872 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6bb96-ed7d-48b5-aef0-b5c585292114 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:03.321349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6bb96-ed7d-48b5-aef0-b5c585292114 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:03.335862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 420/843] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:03.341482 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d730a99-3eaf-45f7-ab57-b8e2fca10bf6 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:03.460821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d730a99-3eaf-45f7-ab57-b8e2fca10bf6 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:03.497391 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329eff1-b68a-4dba-80e6-f1e0bbf0876b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:03.498238 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329eff1-b68a-4dba-80e6-f1e0bbf0876b None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:03.498521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329eff1-b68a-4dba-80e6-f1e0bbf0876b None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:03.498821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329eff1-b68a-4dba-80e6-f1e0bbf0876b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:03.507587 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329eff1-b68a-4dba-80e6-f1e0bbf0876b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:03.509043 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329eff1-b68a-4dba-80e6-f1e0bbf0876b None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:03.533495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-2329eff1-b68a-4dba-80e6-f1e0bbf0876b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 13:05:03.533495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:03.533495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:03.533495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:03.533495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:03.533495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:03.533495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:03.533495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:03.533495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:03.533495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:03.533495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:03.533495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:03.533495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:05:03.533495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:05:03.533495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:05:03.533495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:05:03.534573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:03.534573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:03.534573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:05:03.534573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:05:03.534573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:05:03.534573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:05:03.534573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:03.534573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:03.534573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:03.534573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:03.534573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:03.534573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:03.534573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:03.534573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:03.534573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:03.534573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:03.534573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:03.534573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:03.535513 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:03.535513 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:03.535513 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:05:03.535513 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:05:03.535513 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:05:03.535513 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:05:03.535513 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:05:03.535513 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:05:03.535513 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 13:05:03.535513 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:03.536137 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 424/844] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:05:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:03.542465 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6bb96-ed7d-48b5-aef0-b5c585292114 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:03.658860 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6bb96-ed7d-48b5-aef0-b5c585292114 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:03.695871 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4519f9c-08e7-44b0-8c97-3ff7b3aa4d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:03.696618 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4519f9c-08e7-44b0-8c97-3ff7b3aa4d9b None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:03.696834 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4519f9c-08e7-44b0-8c97-3ff7b3aa4d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:03.697120 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4519f9c-08e7-44b0-8c97-3ff7b3aa4d9b None admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:03.697958 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4519f9c-08e7-44b0-8c97-3ff7b3aa4d9b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:03.698301 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4519f9c-08e7-44b0-8c97-3ff7b3aa4d9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:03.699897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4519f9c-08e7-44b0-8c97-3ff7b3aa4d9b None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:03.714564 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:03.718545 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 421/845] 10.222.0.17 () {56 vars in 1135 bytes} [Tue Jul 12 13:05:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:03.724474 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329eff1-b68a-4dba-80e6-f1e0bbf0876b None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:03.736621 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:03.791085 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a41de-2f14-4cba-84ae-a523516fa3de None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:03.791408 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a41de-2f14-4cba-84ae-a523516fa3de None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:03.791648 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a41de-2f14-4cba-84ae-a523516fa3de None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:03.793357 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 422/846] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:05:03.798523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d3d36-54c1-412d-9687-4a2352a00daa None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:03.798811 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d3d36-54c1-412d-9687-4a2352a00daa None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:03.799091 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d3d36-54c1-412d-9687-4a2352a00daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:03.816751 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-1f1d3d36-54c1-412d-9687-4a2352a00daa None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:03.817939 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-1f1d3d36-54c1-412d-9687-4a2352a00daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:03.839093 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329eff1-b68a-4dba-80e6-f1e0bbf0876b None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:03.874859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7c51d-d054-4fea-bbd4-7eb5b83606ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:03.875534 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7c51d-d054-4fea-bbd4-7eb5b83606ea None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:03.875820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7c51d-d054-4fea-bbd4-7eb5b83606ea None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:03.876101 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7c51d-d054-4fea-bbd4-7eb5b83606ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:03.902044 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 423/847] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:05:03.925359 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d3d36-54c1-412d-9687-4a2352a00daa None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:03.974744 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7c51d-d054-4fea-bbd4-7eb5b83606ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:03.976840 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7c51d-d054-4fea-bbd4-7eb5b83606ea None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:03.990057 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:04.055077 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d3d36-54c1-412d-9687-4a2352a00daa None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:04.086287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:04.097788 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d849255-e659-44da-b8a7-04466dc50242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:04.099750 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d849255-e659-44da-b8a7-04466dc50242 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:04.100957 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d849255-e659-44da-b8a7-04466dc50242 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:04.101440 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d849255-e659-44da-b8a7-04466dc50242 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:04.116823 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d849255-e659-44da-b8a7-04466dc50242 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:05:04.120310 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 425/848] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:05:03 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:05:04.125469 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7c51d-d054-4fea-bbd4-7eb5b83606ea None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:04.126329 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-3d849255-e659-44da-b8a7-04466dc50242 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:05:04.126329 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:04.126329 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:04.126329 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:04.126329 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:04.126329 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:04.126329 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:04.126329 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:04.126329 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:04.126329 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:04.126329 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:04.126329 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:04.126329 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:05:04.126329 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:05:04.126329 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:05:04.126329 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:05:04.127260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:05:04.127260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:05:04.127260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:05:04.127260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:05:04.127260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:04.127260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:04.127260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:04.127260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:04.127260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:04.127260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:04.127260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:04.127260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:04.127260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:04.127260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:04.127260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:04.127260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:04.128117 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:04.128117 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:04.128117 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:04.128117 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:04.128117 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:05:04.128117 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:05:04.128117 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:05:04.128117 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:05:04.128117 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:05:04.128117 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:05:04.128117 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:05:04.128117 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:04.137815 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 424/849] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Jul 12 13:05:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:05:04.139528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d849255-e659-44da-b8a7-04466dc50242 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:04.248534 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7c51d-d054-4fea-bbd4-7eb5b83606ea None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:04.259563 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:04.262019 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d849255-e659-44da-b8a7-04466dc50242 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:04.291588 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ee3a3-d9fd-4279-8975-5fb96a6a0ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:04.293380 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ee3a3-d9fd-4279-8975-5fb96a6a0ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:04.294140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ee3a3-d9fd-4279-8975-5fb96a6a0ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:04.294659 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ee3a3-d9fd-4279-8975-5fb96a6a0ac6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:04.301946 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149de23-e388-4d8b-95c7-5166a02cdcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:04.303166 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149de23-e388-4d8b-95c7-5166a02cdcc8 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:04.303166 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149de23-e388-4d8b-95c7-5166a02cdcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:04.303459 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149de23-e388-4d8b-95c7-5166a02cdcc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:04.304188 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149de23-e388-4d8b-95c7-5166a02cdcc8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:04.304494 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149de23-e388-4d8b-95c7-5166a02cdcc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:04.305978 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149de23-e388-4d8b-95c7-5166a02cdcc8 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:04.308164 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ee3a3-d9fd-4279-8975-5fb96a6a0ac6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:04.310290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ee3a3-d9fd-4279-8975-5fb96a6a0ac6 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:04.319971 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 425/850] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Jul 12 13:05:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:04.322097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149de23-e388-4d8b-95c7-5166a02cdcc8 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:04.336864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-4c2ee3a3-d9fd-4279-8975-5fb96a6a0ac6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:04.336864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:04.336864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:04.336864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:04.336864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:04.336864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:04.336864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:04.336864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:04.336864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:04.336864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:04.336864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:04.336864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:04.336864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:05:04.336864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:05:04.336864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:05:04.337820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:05:04.337820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:04.337820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:04.337820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:04.337820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:04.337820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:04.337820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:04.337820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:04.337820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:04.337820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:04.337820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:04.337820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:04.337820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:04.337820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:04.337820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:04.337820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:04.337820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:04.339144 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:05:04.339144 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:05:04.339144 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:04.339144 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:04.339144 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 426/851] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:04.343569 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ee3a3-d9fd-4279-8975-5fb96a6a0ac6 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:04.388217 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:04.442626 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149de23-e388-4d8b-95c7-5166a02cdcc8 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:04.457771 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ee3a3-d9fd-4279-8975-5fb96a6a0ac6 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:04.481871 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393184c6-c54b-425d-b9c1-0f45c95d578d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:04.482709 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393184c6-c54b-425d-b9c1-0f45c95d578d None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:04.482997 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393184c6-c54b-425d-b9c1-0f45c95d578d None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:04.483276 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393184c6-c54b-425d-b9c1-0f45c95d578d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:04.494687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393184c6-c54b-425d-b9c1-0f45c95d578d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:04.495337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993060d5-aa00-4ddf-80a8-9f02e880983d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:04.496007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993060d5-aa00-4ddf-80a8-9f02e880983d None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:04.496288 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993060d5-aa00-4ddf-80a8-9f02e880983d None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:04.496395 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393184c6-c54b-425d-b9c1-0f45c95d578d None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:04.496561 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993060d5-aa00-4ddf-80a8-9f02e880983d None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:04.497280 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993060d5-aa00-4ddf-80a8-9f02e880983d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:04.497594 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993060d5-aa00-4ddf-80a8-9f02e880983d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:04.499024 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993060d5-aa00-4ddf-80a8-9f02e880983d None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:04.518158 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 427/852] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:04.518158 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5009d0-dacc-45b3-aaf6-e8b0563bddb5 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:04.518158 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5009d0-dacc-45b3-aaf6-e8b0563bddb5 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:04.518158 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5009d0-dacc-45b3-aaf6-e8b0563bddb5 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:04.518158 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 428/853] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:04.519033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5009d0-dacc-45b3-aaf6-e8b0563bddb5 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:04.539578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-393184c6-c54b-425d-b9c1-0f45c95d578d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:04.539578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:04.539578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:04.539578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:04.539578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:04.539578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:04.539578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:04.539578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:04.539578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:04.539578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:04.539578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:04.539578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:04.539578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:05:04.539578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:05:04.539578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:05:04.541398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:05:04.541398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:04.541398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:04.541398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:04.541398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:04.541398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:04.541398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:04.541398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:04.541398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:04.541398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:04.541398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:04.541398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:04.541398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:04.541398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:04.541398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:04.541398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:04.541398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:04.543244 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:05:04.543244 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:05:04.543244 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:04.543244 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:04.543244 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 426/854] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:04.543244 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2a746-1a6c-4544-8230-9689ef97318e None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:04.543244 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2a746-1a6c-4544-8230-9689ef97318e None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:04.543244 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2a746-1a6c-4544-8230-9689ef97318e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:04.556899 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:04.563090 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-cce2a746-1a6c-4544-8230-9689ef97318e None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:04.564647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-cce2a746-1a6c-4544-8230-9689ef97318e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:04.644490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 427/855] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:04.645582 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2a746-1a6c-4544-8230-9689ef97318e None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:04.665440 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5009d0-dacc-45b3-aaf6-e8b0563bddb5 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:04.691375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:04.711505 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dce227-a54e-475c-9250-8619ac20d15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:04.712314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dce227-a54e-475c-9250-8619ac20d15f None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:04.712599 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dce227-a54e-475c-9250-8619ac20d15f None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:04.712878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dce227-a54e-475c-9250-8619ac20d15f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:04.719845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dce227-a54e-475c-9250-8619ac20d15f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:04.721236 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dce227-a54e-475c-9250-8619ac20d15f None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:04.735045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-76dce227-a54e-475c-9250-8619ac20d15f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:05:04.735045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:04.735045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:04.735045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:04.735045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:04.735045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:04.735045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:04.735045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:04.735045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:04.735045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:04.735045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:04.735045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:04.735045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:05:04.735045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:05:04.735045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:05:04.735955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:05:04.735955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:04.735955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:04.735955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:04.735955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:04.735955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:04.735955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:04.735955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:04.735955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:04.735955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:04.735955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:04.735955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:04.735955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:04.735955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:04.735955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:04.735955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:04.735955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:04.736906 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:05:04.736906 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:05:04.736906 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:05:04.736906 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:05:04.736906 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:05:04.736906 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:05:04.736906 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:05:04.736906 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:04.741088 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 429/856] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:05:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:04.741905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dce227-a54e-475c-9250-8619ac20d15f None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:04.769412 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2a746-1a6c-4544-8230-9689ef97318e None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:04.805460 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f71a1-c9f1-47fe-b068-42e63b485c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:04.806287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f71a1-c9f1-47fe-b068-42e63b485c1a None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:04.806584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f71a1-c9f1-47fe-b068-42e63b485c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:04.806866 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f71a1-c9f1-47fe-b068-42e63b485c1a None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:04.807598 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f71a1-c9f1-47fe-b068-42e63b485c1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:04.807909 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f71a1-c9f1-47fe-b068-42e63b485c1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:04.809279 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f71a1-c9f1-47fe-b068-42e63b485c1a None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:04.822049 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 428/857] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:04.822776 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f71a1-c9f1-47fe-b068-42e63b485c1a None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:04.833875 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:04.855399 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dce227-a54e-475c-9250-8619ac20d15f None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:04.900159 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7f4de-f4f4-4039-94dd-30c5fe1176aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:04.900848 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7f4de-f4f4-4039-94dd-30c5fe1176aa None admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:04.901223 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7f4de-f4f4-4039-94dd-30c5fe1176aa None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:04.901402 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7f4de-f4f4-4039-94dd-30c5fe1176aa None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:04.902199 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7f4de-f4f4-4039-94dd-30c5fe1176aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:04.903662 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7f4de-f4f4-4039-94dd-30c5fe1176aa None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:04.924879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 430/858] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Jul 12 13:05:04 2022] POST /identity/v3/services => generated 251 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:05:04.925893 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7f4de-f4f4-4039-94dd-30c5fe1176aa None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:04.961151 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:04.972961 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f71a1-c9f1-47fe-b068-42e63b485c1a None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:05.029318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66374103-a96d-4ba8-a75d-a58e3a601f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:05.030220 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66374103-a96d-4ba8-a75d-a58e3a601f2c None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:05.030694 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66374103-a96d-4ba8-a75d-a58e3a601f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:05.031221 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66374103-a96d-4ba8-a75d-a58e3a601f2c None admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:05.032576 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66374103-a96d-4ba8-a75d-a58e3a601f2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:05.033057 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66374103-a96d-4ba8-a75d-a58e3a601f2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:05.034956 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66374103-a96d-4ba8-a75d-a58e3a601f2c None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:05.054349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 429/859] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:05:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:05.059049 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66374103-a96d-4ba8-a75d-a58e3a601f2c None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:05.092855 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7f4de-f4f4-4039-94dd-30c5fe1176aa None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:05.138693 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20d1c8-0eb8-46e4-a872-c539e86f9b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:05.139679 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20d1c8-0eb8-46e4-a872-c539e86f9b5a None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:05.140829 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20d1c8-0eb8-46e4-a872-c539e86f9b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:05.141201 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20d1c8-0eb8-46e4-a872-c539e86f9b5a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:05.153432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20d1c8-0eb8-46e4-a872-c539e86f9b5a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:05.155026 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20d1c8-0eb8-46e4-a872-c539e86f9b5a None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:05.159533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:05.178902 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-3c20d1c8-0eb8-46e4-a872-c539e86f9b5a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 13:05:05.178902 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:05.178902 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:05.178902 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:05.178902 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:05.178902 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:05.178902 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:05.178902 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:05.178902 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:05.178902 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:05.178902 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:05.178902 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:05.178902 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:05:05.178902 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:05:05.178902 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:05:05.178902 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:05:05.180135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:05.180135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:05.180135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:05:05.180135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:05:05.180135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:05:05.180135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:05:05.180135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:05.180135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:05.180135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:05.180135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:05.180135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:05.180135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:05.180135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:05.180135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:05.180135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:05.180135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:05.180135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:05.180135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:05.181268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:05.181268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:05.181268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:05:05.181268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:05:05.181268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:05:05.181268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:05:05.181268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:05:05.181268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:05:05.181268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 13:05:05.181268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:05.182873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66374103-a96d-4ba8-a75d-a58e3a601f2c None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:05.185987 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 431/860] 10.222.0.17 () {56 vars in 1117 bytes} [Tue Jul 12 13:05:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:05.187226 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20d1c8-0eb8-46e4-a872-c539e86f9b5a None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:05.230529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489159c0-4aaf-44a0-a300-df6f13b0ebbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:05.231472 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489159c0-4aaf-44a0-a300-df6f13b0ebbc None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:05.231937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489159c0-4aaf-44a0-a300-df6f13b0ebbc None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:05.232363 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489159c0-4aaf-44a0-a300-df6f13b0ebbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:05.233344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489159c0-4aaf-44a0-a300-df6f13b0ebbc None admin] RBAC: Adding query filter params (role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0, scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2, user.id=fe10f0f42b8247c99ed5f88eff5065e3) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:05.233811 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489159c0-4aaf-44a0-a300-df6f13b0ebbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:05.236053 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489159c0-4aaf-44a0-a300-df6f13b0ebbc None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:05.245295 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 430/861] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:05:05 2022] GET /identity/v3/role_assignments?user.id=fe10f0f42b8247c99ed5f88eff5065e3&scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2&role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:05.317682 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20d1c8-0eb8-46e4-a872-c539e86f9b5a None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:05.360234 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078eafea-1cef-410f-a550-2e07efe4e167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:05.360953 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078eafea-1cef-410f-a550-2e07efe4e167 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:05.361244 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078eafea-1cef-410f-a550-2e07efe4e167 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:05.361531 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078eafea-1cef-410f-a550-2e07efe4e167 None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:05.362457 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078eafea-1cef-410f-a550-2e07efe4e167 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:05.362781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078eafea-1cef-410f-a550-2e07efe4e167 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:05.364296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078eafea-1cef-410f-a550-2e07efe4e167 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:05.390517 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 432/862] 10.222.0.17 () {56 vars in 1149 bytes} [Tue Jul 12 13:05:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:05.395333 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489159c0-4aaf-44a0-a300-df6f13b0ebbc None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:05.416126 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fee8e9-8a20-47e6-a475-1a7ccc29e3b0 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:05.416712 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fee8e9-8a20-47e6-a475-1a7ccc29e3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:05.417178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fee8e9-8a20-47e6-a475-1a7ccc29e3b0 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:05.418783 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 433/863] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:05.421361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:05.424047 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b54fc7-a4f6-4ada-82cd-a4bea3bad86b None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:05.424341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b54fc7-a4f6-4ada-82cd-a4bea3bad86b None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:05.424619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b54fc7-a4f6-4ada-82cd-a4bea3bad86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:05.443939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-a4b54fc7-a4f6-4ada-82cd-a4bea3bad86b None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:05.445178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a4b54fc7-a4f6-4ada-82cd-a4bea3bad86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:05.522506 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:05.529749 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489159c0-4aaf-44a0-a300-df6f13b0ebbc None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:05.539568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 434/864] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:05 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:05:05.561960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b54fc7-a4f6-4ada-82cd-a4bea3bad86b None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:05.572653 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6844cc5-86a1-4b94-be10-25bfaf80eb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:05.573301 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6844cc5-86a1-4b94-be10-25bfaf80eb44 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:05.573599 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6844cc5-86a1-4b94-be10-25bfaf80eb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:05.573888 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6844cc5-86a1-4b94-be10-25bfaf80eb44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:05.664394 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b54fc7-a4f6-4ada-82cd-a4bea3bad86b None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:05.671022 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6844cc5-86a1-4b94-be10-25bfaf80eb44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:05.676190 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6844cc5-86a1-4b94-be10-25bfaf80eb44 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:05.699937 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8fa74-735f-4059-8d5e-4e701ac3d118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:05.700785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8fa74-735f-4059-8d5e-4e701ac3d118 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:05.701594 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8fa74-735f-4059-8d5e-4e701ac3d118 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:05.701594 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8fa74-735f-4059-8d5e-4e701ac3d118 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:05.702002 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8fa74-735f-4059-8d5e-4e701ac3d118 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:05.703385 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8fa74-735f-4059-8d5e-4e701ac3d118 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:05.713692 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:05.717039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-87e8fa74-735f-4059-8d5e-4e701ac3d118 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 13:05:05.717039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:05.717039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:05:05.717039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:05:05.717039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:05:05.717039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:05:05.717039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:05:05.717039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:05.717039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 13:05:05.717039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:05.717039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:05:05.717039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:05.717039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:05.717039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:05.717039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:05.717039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:05.718936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:05.718936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:05.718936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:05.718936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:05.718936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:05.718936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:05.718936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:05.718936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:05:05.718936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:05:05.718936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:05:05.718936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:05:05.718936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:05.718936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:05.718936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:05.718936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:05.718936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:05.721020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:05.721020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:05.721020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:05.721020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:05.721020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:05.721020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:05.721020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:05.721020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:05.721020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:05.721020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:05.721020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:05.721020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:05:05.721020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:05.721020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 13:05:05.721020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:05.723417 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 435/865] 10.222.0.17 () {56 vars in 1132 bytes} [Tue Jul 12 13:05:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:05:05.724286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8fa74-735f-4059-8d5e-4e701ac3d118 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:05.790611 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:05.833709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8fa74-735f-4059-8d5e-4e701ac3d118 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:05.848256 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 431/866] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:05:05 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:05:05.851054 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6844cc5-86a1-4b94-be10-25bfaf80eb44 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:05.873401 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aff522-95a1-4144-a5ad-f7181413ce19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:05.874595 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aff522-95a1-4144-a5ad-f7181413ce19 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:05.875144 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aff522-95a1-4144-a5ad-f7181413ce19 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:05.875650 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aff522-95a1-4144-a5ad-f7181413ce19 None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:05.876577 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aff522-95a1-4144-a5ad-f7181413ce19 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:05.877134 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aff522-95a1-4144-a5ad-f7181413ce19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:05.878858 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aff522-95a1-4144-a5ad-f7181413ce19 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:05.889516 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 436/867] 10.222.0.17 () {56 vars in 1126 bytes} [Tue Jul 12 13:05:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:05.890865 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aff522-95a1-4144-a5ad-f7181413ce19 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:05.956617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6844cc5-86a1-4b94-be10-25bfaf80eb44 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:05.971144 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:05.994501 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2eae2-2721-4b65-b94e-4ab6334b3e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:05.995313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2eae2-2721-4b65-b94e-4ab6334b3e96 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:05.995626 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2eae2-2721-4b65-b94e-4ab6334b3e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:05.995878 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2eae2-2721-4b65-b94e-4ab6334b3e96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:06.004033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aff522-95a1-4144-a5ad-f7181413ce19 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:06.006501 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2eae2-2721-4b65-b94e-4ab6334b3e96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:06.008499 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2eae2-2721-4b65-b94e-4ab6334b3e96 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:06.023753 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:06.028601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-edf2eae2-2721-4b65-b94e-4ab6334b3e96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:06.028601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:06.028601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:06.028601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:06.028601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:06.028601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:06.028601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:06.028601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:06.028601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:06.028601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:06.028601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:06.028601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:06.028601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:05:06.028601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:05:06.028601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:05:06.031133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:05:06.031133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:06.031133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:06.031133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:06.031133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:06.031133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:06.031133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:06.031133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:06.031133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:06.031133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:06.031133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:06.031133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:06.031133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:06.031133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:06.031133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:06.031133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:06.031133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:06.032041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:05:06.032041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:05:06.032041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:06.032041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:06.034566 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 432/868] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:05:06.035895 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2eae2-2721-4b65-b94e-4ab6334b3e96 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:06.046543 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712b943-8042-4239-aeee-0a51230ce1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:06.047531 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712b943-8042-4239-aeee-0a51230ce1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:06.048016 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712b943-8042-4239-aeee-0a51230ce1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:06.048589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712b943-8042-4239-aeee-0a51230ce1e2 None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:06.049511 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712b943-8042-4239-aeee-0a51230ce1e2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:06.050167 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712b943-8042-4239-aeee-0a51230ce1e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:06.051738 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712b943-8042-4239-aeee-0a51230ce1e2 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:06.062213 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 437/869] 10.222.0.17 () {56 vars in 1126 bytes} [Tue Jul 12 13:05:05 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:06.153859 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2eae2-2721-4b65-b94e-4ab6334b3e96 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:06.195373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986b183-ab99-4df8-b15f-2e71917b494e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:06.196143 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986b183-ab99-4df8-b15f-2e71917b494e None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:06.196433 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986b183-ab99-4df8-b15f-2e71917b494e None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:06.196715 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986b183-ab99-4df8-b15f-2e71917b494e None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:06.197518 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986b183-ab99-4df8-b15f-2e71917b494e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:06.197836 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986b183-ab99-4df8-b15f-2e71917b494e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:06.199352 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986b183-ab99-4df8-b15f-2e71917b494e None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:06.217395 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 433/870] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:06.219830 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712b943-8042-4239-aeee-0a51230ce1e2 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:06.348718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712b943-8042-4239-aeee-0a51230ce1e2 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:06.387448 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabacab0-7e4f-46a0-8760-3fb57b5837c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:06.388289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabacab0-7e4f-46a0-8760-3fb57b5837c3 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:06.388576 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabacab0-7e4f-46a0-8760-3fb57b5837c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:06.388852 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabacab0-7e4f-46a0-8760-3fb57b5837c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:06.396513 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabacab0-7e4f-46a0-8760-3fb57b5837c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:06.398636 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabacab0-7e4f-46a0-8760-3fb57b5837c3 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:06.414471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-aabacab0-7e4f-46a0-8760-3fb57b5837c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:05:06.414471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:06.414471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:06.414471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:06.414471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:06.414471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:06.414471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:06.414471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:06.414471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:06.414471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:06.414471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:06.414471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:06.414471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:05:06.414471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:05:06.414471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:05:06.415421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:05:06.415421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:06.415421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:06.415421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:06.415421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:06.415421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:06.415421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:06.415421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:06.415421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:06.415421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:06.415421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:06.415421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:06.415421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:06.415421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:06.415421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:06.415421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:06.415421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:06.416339 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:05:06.416339 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:05:06.416339 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:05:06.416339 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:05:06.416339 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:05:06.416339 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:05:06.416339 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:05:06.416339 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:06.420395 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 438/871] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:05:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:06.421768 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986b183-ab99-4df8-b15f-2e71917b494e None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:06.450837 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:06.532538 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986b183-ab99-4df8-b15f-2e71917b494e None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:06.570605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43debe5-53bf-43bd-8084-76b9d4ded8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:06.571331 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43debe5-53bf-43bd-8084-76b9d4ded8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:06.571623 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43debe5-53bf-43bd-8084-76b9d4ded8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:06.571963 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43debe5-53bf-43bd-8084-76b9d4ded8b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:06.572768 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43debe5-53bf-43bd-8084-76b9d4ded8b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:06.573086 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43debe5-53bf-43bd-8084-76b9d4ded8b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:06.574568 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43debe5-53bf-43bd-8084-76b9d4ded8b2 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:06.592398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 434/872] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:05:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:06.593802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabacab0-7e4f-46a0-8760-3fb57b5837c3 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:06.649528 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:06.713004 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabacab0-7e4f-46a0-8760-3fb57b5837c3 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:06.749735 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0d264-62be-4381-8ee2-2e97f487204d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:06.750488 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0d264-62be-4381-8ee2-2e97f487204d None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:06.750780 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0d264-62be-4381-8ee2-2e97f487204d None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:06.751054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0d264-62be-4381-8ee2-2e97f487204d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:06.751886 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0d264-62be-4381-8ee2-2e97f487204d None admin] RBAC: Adding query filter params (role.id=88426002bf1b40c0b59071eaaba38530, scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2, user.id=72f556aac45c460cb573498aab7590fe) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:06.752197 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0d264-62be-4381-8ee2-2e97f487204d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:06.753623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0d264-62be-4381-8ee2-2e97f487204d None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:06.760461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 439/873] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:05:06 2022] GET /identity/v3/role_assignments?user.id=72f556aac45c460cb573498aab7590fe&scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2&role.id=88426002bf1b40c0b59071eaaba38530 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:07.169416 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7163e38-01e6-4440-922f-e6a3e8917b4e None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:07.170051 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7163e38-01e6-4440-922f-e6a3e8917b4e None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:07.170051 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7163e38-01e6-4440-922f-e6a3e8917b4e None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:07.171998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 435/874] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:07.177513 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feff1f2-6c80-49a0-bcc8-a38b570cabf3 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:07.177884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feff1f2-6c80-49a0-bcc8-a38b570cabf3 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:07.178271 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feff1f2-6c80-49a0-bcc8-a38b570cabf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:07.196015 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-9feff1f2-6c80-49a0-bcc8-a38b570cabf3 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:07.197222 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-9feff1f2-6c80-49a0-bcc8-a38b570cabf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:07.270453 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 440/875] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:07 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:07.294633 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7163e38-01e6-4440-922f-e6a3e8917b4e None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:07.389865 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:07.408295 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7163e38-01e6-4440-922f-e6a3e8917b4e None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:07.439924 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973a18e-7aa0-4c01-a776-c77739612650 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:07.440275 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973a18e-7aa0-4c01-a776-c77739612650 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:07.440706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973a18e-7aa0-4c01-a776-c77739612650 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:07.442472 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 441/876] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:05:07.445158 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809f079-0077-4157-a688-e27f80ed2578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:07.445980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809f079-0077-4157-a688-e27f80ed2578 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:07.446297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809f079-0077-4157-a688-e27f80ed2578 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:07.446576 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809f079-0077-4157-a688-e27f80ed2578 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:07.447328 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809f079-0077-4157-a688-e27f80ed2578 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:07.448147 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31434903-26e8-4e50-806c-a179ac6b30c5 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:07.448436 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31434903-26e8-4e50-806c-a179ac6b30c5 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:07.448706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809f079-0077-4157-a688-e27f80ed2578 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:07.448810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31434903-26e8-4e50-806c-a179ac6b30c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:07.461529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-5809f079-0077-4157-a688-e27f80ed2578 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 13:05:07.461529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:07.461529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:05:07.461529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:05:07.461529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:05:07.461529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:05:07.461529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:05:07.461529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:07.461529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 13:05:07.461529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:07.461529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:05:07.461529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:07.461529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:07.461529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:07.461529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:07.461529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:07.461529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:07.462670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:07.462670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:07.462670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:07.462670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:07.462670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:07.462670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:07.462670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:05:07.462670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:05:07.462670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:05:07.462670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:05:07.462670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:07.462670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:07.462670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:07.462670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:07.462670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:07.462670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:07.463553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:07.463553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:07.463553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:07.463553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:07.463553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:07.463553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:07.463553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:07.463553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:07.463553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:07.463553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:07.463553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:05:07.463553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:07.463553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 13:05:07.463553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:07.466208 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 436/877] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Jul 12 13:05:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:07.468729 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-31434903-26e8-4e50-806c-a179ac6b30c5 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:07.469921 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-31434903-26e8-4e50-806c-a179ac6b30c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:07.471045 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809f079-0077-4157-a688-e27f80ed2578 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:07.546632 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:07.550237 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 442/878] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:07 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:05:07.569041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31434903-26e8-4e50-806c-a179ac6b30c5 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:07.581402 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809f079-0077-4157-a688-e27f80ed2578 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:07.618396 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04aa9f-c67a-45d7-9810-beffe07d0537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:07.619500 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04aa9f-c67a-45d7-9810-beffe07d0537 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:07.620035 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04aa9f-c67a-45d7-9810-beffe07d0537 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:07.620525 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04aa9f-c67a-45d7-9810-beffe07d0537 None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:07.621446 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04aa9f-c67a-45d7-9810-beffe07d0537 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:07.622008 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04aa9f-c67a-45d7-9810-beffe07d0537 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:07.623666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04aa9f-c67a-45d7-9810-beffe07d0537 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:07.634066 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 437/879] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Jul 12 13:05:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:07.635561 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04aa9f-c67a-45d7-9810-beffe07d0537 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:07.652280 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:07.689134 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31434903-26e8-4e50-806c-a179ac6b30c5 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:07.727839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac8c8c-c30b-4ad6-a9bb-1f35171a344a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:07.728755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac8c8c-c30b-4ad6-a9bb-1f35171a344a None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:07.729146 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac8c8c-c30b-4ad6-a9bb-1f35171a344a None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:07.729560 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac8c8c-c30b-4ad6-a9bb-1f35171a344a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:07.730399 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac8c8c-c30b-4ad6-a9bb-1f35171a344a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:07.731946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac8c8c-c30b-4ad6-a9bb-1f35171a344a None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:07.745184 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-d7ac8c8c-c30b-4ad6-a9bb-1f35171a344a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:05:07.745184 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:07.745184 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:05:07.745184 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:05:07.745184 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:05:07.745184 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:05:07.745184 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:05:07.745184 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:07.745184 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:05:07.745184 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:07.745184 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:05:07.745184 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:07.745184 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:07.745184 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:07.745184 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:07.745184 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:07.745184 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:07.746280 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:07.746280 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:07.746280 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:07.746280 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:07.746280 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:07.746280 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:07.746280 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:05:07.746280 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:05:07.746280 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:05:07.746280 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:05:07.746280 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:07.746280 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:07.746280 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:07.746280 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:07.746280 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:07.746280 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:07.747148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:07.747148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:07.747148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:07.747148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:07.747148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:07.747148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:07.747148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:07.747148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:07.747148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:07.747148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:07.747148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:05:07.747148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:07.747148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:05:07.747148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:07.751665 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 443/880] 10.222.0.17 () {56 vars in 1126 bytes} [Tue Jul 12 13:05:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:05:07.752628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac8c8c-c30b-4ad6-a9bb-1f35171a344a None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:07.754366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04aa9f-c67a-45d7-9810-beffe07d0537 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:07.792320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e9d73-4784-4d01-a0f6-0270616c9494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:07.793393 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e9d73-4784-4d01-a0f6-0270616c9494 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:07.793870 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e9d73-4784-4d01-a0f6-0270616c9494 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:07.794397 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e9d73-4784-4d01-a0f6-0270616c9494 None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:07.795303 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e9d73-4784-4d01-a0f6-0270616c9494 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:07.795798 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e9d73-4784-4d01-a0f6-0270616c9494 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:07.797485 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e9d73-4784-4d01-a0f6-0270616c9494 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:07.808508 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 438/881] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Jul 12 13:05:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:07.810040 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e9d73-4784-4d01-a0f6-0270616c9494 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:07.826554 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:07.872142 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac8c8c-c30b-4ad6-a9bb-1f35171a344a None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:07.898535 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:07.908560 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f02217-4b28-4ee6-b559-bb7c4a28878b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:07.909303 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f02217-4b28-4ee6-b559-bb7c4a28878b None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:07.909602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f02217-4b28-4ee6-b559-bb7c4a28878b None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:07.909880 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f02217-4b28-4ee6-b559-bb7c4a28878b None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:07.910648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f02217-4b28-4ee6-b559-bb7c4a28878b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:07.911008 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f02217-4b28-4ee6-b559-bb7c4a28878b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:07.912458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f02217-4b28-4ee6-b559-bb7c4a28878b None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:07.918448 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 444/882] 10.222.0.17 () {56 vars in 1122 bytes} [Tue Jul 12 13:05:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:07.921196 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e9d73-4784-4d01-a0f6-0270616c9494 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:07.924720 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f02217-4b28-4ee6-b559-bb7c4a28878b None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:07.962684 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37355b00-be6f-4903-9cf7-71856ef06e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:07.963924 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37355b00-be6f-4903-9cf7-71856ef06e93 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:07.964451 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37355b00-be6f-4903-9cf7-71856ef06e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:07.964949 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37355b00-be6f-4903-9cf7-71856ef06e93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:07.966006 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37355b00-be6f-4903-9cf7-71856ef06e93 None admin] RBAC: Adding query filter params (interface=public, service_id=b9cbd53ae63e46f7b6542d8d9ff15776, region_id=RegionOne) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:07.966614 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37355b00-be6f-4903-9cf7-71856ef06e93 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:07.968276 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37355b00-be6f-4903-9cf7-71856ef06e93 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:07.980927 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 439/883] 10.222.0.17 () {56 vars in 1251 bytes} [Tue Jul 12 13:05:07 2022] GET /identity/v3/endpoints?service_id=b9cbd53ae63e46f7b6542d8d9ff15776&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:07.982905 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37355b00-be6f-4903-9cf7-71856ef06e93 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:08.052779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f02217-4b28-4ee6-b559-bb7c4a28878b None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:08.074570 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:08.091019 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c06ad6-3608-4a72-8db3-922693aac2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:08.092085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c06ad6-3608-4a72-8db3-922693aac2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:08.092582 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c06ad6-3608-4a72-8db3-922693aac2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:08.093068 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c06ad6-3608-4a72-8db3-922693aac2f0 None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:08.094031 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c06ad6-3608-4a72-8db3-922693aac2f0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:08.094582 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c06ad6-3608-4a72-8db3-922693aac2f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:08.096159 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c06ad6-3608-4a72-8db3-922693aac2f0 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:08.101920 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 445/884] 10.222.0.17 () {56 vars in 1122 bytes} [Tue Jul 12 13:05:07 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:08.124313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37355b00-be6f-4903-9cf7-71856ef06e93 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:08.166617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c751e-883c-4540-9e0d-b0c4e3979995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:08.167708 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c751e-883c-4540-9e0d-b0c4e3979995 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:08.168220 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c751e-883c-4540-9e0d-b0c4e3979995 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:08.168730 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c751e-883c-4540-9e0d-b0c4e3979995 None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:08.169684 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c751e-883c-4540-9e0d-b0c4e3979995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:08.171876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c751e-883c-4540-9e0d-b0c4e3979995 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:08.184089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 440/885] 10.222.0.17 () {56 vars in 1087 bytes} [Tue Jul 12 13:05:07 2022] GET /identity/v3/services => generated 1011 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:05:08.311213 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92679477-04a3-459f-be59-25773097317b None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:08.311522 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92679477-04a3-459f-be59-25773097317b None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:08.311711 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92679477-04a3-459f-be59-25773097317b None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:08.313444 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 446/886] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:08.319272 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0133ee-52bd-482c-9e6a-70da90af5e11 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:08.319882 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0133ee-52bd-482c-9e6a-70da90af5e11 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:08.320375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0133ee-52bd-482c-9e6a-70da90af5e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:08.328595 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:08.342369 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-0c0133ee-52bd-482c-9e6a-70da90af5e11 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:08.344103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-0c0133ee-52bd-482c-9e6a-70da90af5e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:08.425194 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 441/887] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:08 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:08.448667 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92679477-04a3-459f-be59-25773097317b None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:08.569344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92679477-04a3-459f-be59-25773097317b None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:08.606543 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5d8e0-c8c8-493f-a2be-805daf249185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:08.607231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5d8e0-c8c8-493f-a2be-805daf249185 None admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:08.607517 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5d8e0-c8c8-493f-a2be-805daf249185 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:08.607794 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5d8e0-c8c8-493f-a2be-805daf249185 None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:08.608525 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5d8e0-c8c8-493f-a2be-805daf249185 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:08.609901 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5d8e0-c8c8-493f-a2be-805daf249185 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:08.628008 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 447/888] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Jul 12 13:05:08 2022] POST /identity/v3/services => generated 269 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:05:08.957684 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80771b89-c976-4086-81c0-4c261b30bea1 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:08.958081 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80771b89-c976-4086-81c0-4c261b30bea1 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:08.958292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80771b89-c976-4086-81c0-4c261b30bea1 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:08.960467 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 442/889] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:08.966082 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372667c-111a-4aa3-8fd2-81d5ceb09385 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:08.966607 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372667c-111a-4aa3-8fd2-81d5ceb09385 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:08.966699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372667c-111a-4aa3-8fd2-81d5ceb09385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:08.984493 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-7372667c-111a-4aa3-8fd2-81d5ceb09385 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:08.985697 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-7372667c-111a-4aa3-8fd2-81d5ceb09385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:08.997438 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:09.066258 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 448/890] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:09.089416 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80771b89-c976-4086-81c0-4c261b30bea1 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:09.227509 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80771b89-c976-4086-81c0-4c261b30bea1 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:09.264106 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3dcdc-d666-4539-803c-6ec230763aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:09.264946 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3dcdc-d666-4539-803c-6ec230763aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:09.265231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3dcdc-d666-4539-803c-6ec230763aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:09.265508 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3dcdc-d666-4539-803c-6ec230763aa1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:09.267554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:09.278213 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3dcdc-d666-4539-803c-6ec230763aa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:05:09.287024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-fcc3dcdc-d666-4539-803c-6ec230763aa1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 13:05:09.287024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:09.287024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:09.287024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:09.287024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:09.287024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:09.287024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:09.287024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:09.287024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:09.287024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:09.287024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:09.287024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:09.287024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:05:09.287024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:05:09.287024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:05:09.287024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:05:09.288013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:05:09.288013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:05:09.288013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:05:09.288013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:05:09.288013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:09.288013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:09.288013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:09.288013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:09.288013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:09.288013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:09.288013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:09.288013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:09.288013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:09.288013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:09.288013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:09.288013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:09.288858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:09.288858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:09.288858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:09.288858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:09.288858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:05:09.288858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:05:09.288858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:05:09.288858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:05:09.288858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:05:09.288858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:05:09.288858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 13:05:09.288858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:09.288858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 443/891] 10.222.0.17 () {56 vars in 1120 bytes} [Tue Jul 12 13:05:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:09.295771 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372667c-111a-4aa3-8fd2-81d5ceb09385 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:09.415967 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372667c-111a-4aa3-8fd2-81d5ceb09385 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:09.454710 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fba7c-b800-4605-bd95-621106f5435b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:09.455777 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fba7c-b800-4605-bd95-621106f5435b None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:09.456270 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fba7c-b800-4605-bd95-621106f5435b None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:09.456751 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fba7c-b800-4605-bd95-621106f5435b None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:09.457703 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6fba7c-b800-4605-bd95-621106f5435b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:09.458277 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6fba7c-b800-4605-bd95-621106f5435b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:09.460530 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6fba7c-b800-4605-bd95-621106f5435b None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:09.469749 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 449/892] 10.222.0.17 () {56 vars in 1115 bytes} [Tue Jul 12 13:05:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:09.475172 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3dcdc-d666-4539-803c-6ec230763aa1 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:09.579520 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3dcdc-d666-4539-803c-6ec230763aa1 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:09.621921 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03c9c2-fdf5-4d1b-a79f-ef0a1888be0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:09.622795 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03c9c2-fdf5-4d1b-a79f-ef0a1888be0e None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:09.623086 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03c9c2-fdf5-4d1b-a79f-ef0a1888be0e None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:09.623370 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03c9c2-fdf5-4d1b-a79f-ef0a1888be0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:09.637026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03c9c2-fdf5-4d1b-a79f-ef0a1888be0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:09.638575 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03c9c2-fdf5-4d1b-a79f-ef0a1888be0e None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:09.657563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-6e03c9c2-fdf5-4d1b-a79f-ef0a1888be0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:09.657563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:09.657563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:09.657563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:09.657563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:09.657563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:09.657563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:09.657563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:09.657563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:09.657563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:09.657563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:09.657563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:09.657563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:05:09.657563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:05:09.657563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:05:09.658593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:05:09.658593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:09.658593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:09.658593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:09.658593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:09.658593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:09.658593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:09.658593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:09.658593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:09.658593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:09.658593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:09.658593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:09.658593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:09.658593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:09.658593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:09.658593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:09.658593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:09.659962 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:05:09.659962 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:05:09.659962 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:09.659962 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:09.659962 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 444/893] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:09.665073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fba7c-b800-4605-bd95-621106f5435b None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:09.682510 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:09.795248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fba7c-b800-4605-bd95-621106f5435b None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:09.831660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdeef5-ec83-49a5-9859-396304dc07ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:09.832262 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdeef5-ec83-49a5-9859-396304dc07ea None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:09.832617 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdeef5-ec83-49a5-9859-396304dc07ea None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:09.832897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdeef5-ec83-49a5-9859-396304dc07ea None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:09.833683 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cdeef5-ec83-49a5-9859-396304dc07ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:09.834003 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cdeef5-ec83-49a5-9859-396304dc07ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:09.835972 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cdeef5-ec83-49a5-9859-396304dc07ea None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:09.849599 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 450/894] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:09.855848 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03c9c2-fdf5-4d1b-a79f-ef0a1888be0e None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:09.914265 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:09.970873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03c9c2-fdf5-4d1b-a79f-ef0a1888be0e None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:10.005787 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da38f2-a055-4756-b501-fccf09de247e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:10.007164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da38f2-a055-4756-b501-fccf09de247e None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:10.007445 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da38f2-a055-4756-b501-fccf09de247e None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:10.007718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da38f2-a055-4756-b501-fccf09de247e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:10.016057 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da38f2-a055-4756-b501-fccf09de247e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:10.017509 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da38f2-a055-4756-b501-fccf09de247e None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:10.033181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-44da38f2-a055-4756-b501-fccf09de247e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 13:05:10.033181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:10.033181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:10.033181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:10.033181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:10.033181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:10.033181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:10.033181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:10.033181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:10.033181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:10.033181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:10.033181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:10.033181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:05:10.033181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:05:10.033181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:05:10.033181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:05:10.034275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:10.034275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:10.034275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:05:10.034275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:05:10.034275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:05:10.034275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:05:10.034275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:10.034275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:10.034275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:10.034275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:10.034275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:10.034275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:10.034275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:10.034275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:10.034275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:10.034275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:10.034275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:10.034275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:10.035309 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:10.035309 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:10.035309 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:05:10.035309 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:05:10.035309 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:05:10.035309 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:05:10.035309 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:05:10.035309 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:05:10.035309 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 13:05:10.035309 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:10.035309 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 445/895] 10.222.0.17 () {56 vars in 1117 bytes} [Tue Jul 12 13:05:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:10.040626 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdeef5-ec83-49a5-9859-396304dc07ea None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:10.114993 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:10.157998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdeef5-ec83-49a5-9859-396304dc07ea None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:10.194290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9eebc5-a3e2-4dc6-afaa-2d7be09903e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:10.194986 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9eebc5-a3e2-4dc6-afaa-2d7be09903e7 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:10.195273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9eebc5-a3e2-4dc6-afaa-2d7be09903e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:10.195555 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9eebc5-a3e2-4dc6-afaa-2d7be09903e7 None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:10.196408 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9eebc5-a3e2-4dc6-afaa-2d7be09903e7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:10.196723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9eebc5-a3e2-4dc6-afaa-2d7be09903e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:10.198187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9eebc5-a3e2-4dc6-afaa-2d7be09903e7 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:10.217791 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 451/896] 10.222.0.17 () {56 vars in 1149 bytes} [Tue Jul 12 13:05:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:10.227076 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da38f2-a055-4756-b501-fccf09de247e None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:10.312013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80238d05-c50a-448e-b76b-c8b5ba76b4e4 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:10.312313 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80238d05-c50a-448e-b76b-c8b5ba76b4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:10.312593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80238d05-c50a-448e-b76b-c8b5ba76b4e4 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:10.314242 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 452/897] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:05:10.319407 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3f755-1eed-4156-bae0-a4caa0bfb091 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:10.319701 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3f755-1eed-4156-bae0-a4caa0bfb091 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:10.319986 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3f755-1eed-4156-bae0-a4caa0bfb091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:10.337493 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-82c3f755-1eed-4156-bae0-a4caa0bfb091 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:10.338738 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-82c3f755-1eed-4156-bae0-a4caa0bfb091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:10.339904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da38f2-a055-4756-b501-fccf09de247e None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:10.355508 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:10.395394 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d0292-b659-499c-907a-0343425a6289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:10.396121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d0292-b659-499c-907a-0343425a6289 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:10.396484 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d0292-b659-499c-907a-0343425a6289 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:10.396837 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d0292-b659-499c-907a-0343425a6289 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:10.426488 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 453/898] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:05:10.449253 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3f755-1eed-4156-bae0-a4caa0bfb091 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:10.491890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d0292-b659-499c-907a-0343425a6289 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:10.493499 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d0292-b659-499c-907a-0343425a6289 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:10.516980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:10.575541 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3f755-1eed-4156-bae0-a4caa0bfb091 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:10.610790 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 446/899] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:05:10 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:05:10.612690 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39cf57-7822-4eb1-afa9-3cf2a18bd7ee None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:10.613054 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39cf57-7822-4eb1-afa9-3cf2a18bd7ee None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:10.613414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39cf57-7822-4eb1-afa9-3cf2a18bd7ee None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:10.614264 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42b583-0a26-4b13-b514-fdaf567426f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:10.615007 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 447/900] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:10.615556 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39cf57-7822-4eb1-afa9-3cf2a18bd7ee None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:10.619701 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42b583-0a26-4b13-b514-fdaf567426f3 None admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:10.620051 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42b583-0a26-4b13-b514-fdaf567426f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:10.620347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42b583-0a26-4b13-b514-fdaf567426f3 None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:10.621112 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42b583-0a26-4b13-b514-fdaf567426f3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:10.622539 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42b583-0a26-4b13-b514-fdaf567426f3 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:10.626408 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:10.646239 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 454/901] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Jul 12 13:05:10 2022] POST /identity/v3/services => generated 241 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:05:10.646239 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6c65f-e56f-4467-a970-c5af8ace9ff4 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:10.646239 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6c65f-e56f-4467-a970-c5af8ace9ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:10.646239 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6c65f-e56f-4467-a970-c5af8ace9ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:10.657982 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-8fc6c65f-e56f-4467-a970-c5af8ace9ff4 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:10.659262 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-8fc6c65f-e56f-4467-a970-c5af8ace9ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:10.758560 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 455/902] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:10.773411 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39cf57-7822-4eb1-afa9-3cf2a18bd7ee None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:10.777268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6c65f-e56f-4467-a970-c5af8ace9ff4 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:10.821340 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d72518-8ebb-4a7c-b072-a09e639aa441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:10.822202 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d72518-8ebb-4a7c-b072-a09e639aa441 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:10.822491 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d72518-8ebb-4a7c-b072-a09e639aa441 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:10.822767 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d72518-8ebb-4a7c-b072-a09e639aa441 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:10.835493 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d72518-8ebb-4a7c-b072-a09e639aa441 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:10.836579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:10.836977 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d72518-8ebb-4a7c-b072-a09e639aa441 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:10.859726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-e3d72518-8ebb-4a7c-b072-a09e639aa441 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:10.859726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:10.859726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:10.859726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:10.859726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:10.859726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:10.859726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:10.859726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:10.859726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:10.859726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:10.859726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:10.859726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:10.859726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:05:10.859726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:05:10.859726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:05:10.860698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:05:10.860698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:10.860698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:10.860698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:10.860698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:10.860698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:10.860698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:10.860698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:10.860698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:10.860698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:10.860698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:10.860698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:10.860698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:10.860698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:10.860698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:10.860698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:10.860698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:10.861587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:05:10.861587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:05:10.861587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:10.861587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:10.861587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 448/903] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:10.865935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f7c84-6f49-45ac-bbed-0136d1b03d01 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:10.866806 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f7c84-6f49-45ac-bbed-0136d1b03d01 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:10.867153 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f7c84-6f49-45ac-bbed-0136d1b03d01 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:10.868548 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 449/904] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:10.871716 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f7c84-6f49-45ac-bbed-0136d1b03d01 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:10.909743 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6c65f-e56f-4467-a970-c5af8ace9ff4 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:10.935381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:10.948610 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c0340-a1a9-4087-a4cd-384eabe5db0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:10.949526 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c0340-a1a9-4087-a4cd-384eabe5db0c None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:10.949820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c0340-a1a9-4087-a4cd-384eabe5db0c None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:10.950102 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c0340-a1a9-4087-a4cd-384eabe5db0c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:10.950795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c0340-a1a9-4087-a4cd-384eabe5db0c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:10.952190 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c0340-a1a9-4087-a4cd-384eabe5db0c None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:10.964951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-f84c0340-a1a9-4087-a4cd-384eabe5db0c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 13:05:10.964951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:10.964951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:05:10.964951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:05:10.964951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:05:10.964951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:05:10.964951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:05:10.964951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:10.964951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 13:05:10.964951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:10.964951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:05:10.964951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:10.964951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:10.964951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:10.964951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:10.964951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:10.964951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:10.966056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:10.966056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:10.966056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:10.966056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:10.966056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:10.966056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:10.966056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:05:10.966056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:05:10.966056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:05:10.966056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:05:10.966056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:10.966056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:10.966056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:10.966056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:10.966056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:10.966056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:10.967273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:10.967273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:10.967273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:10.967273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:10.967273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:10.967273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:10.967273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:10.967273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:10.967273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:10.967273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:10.967273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:05:10.967273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:10.967273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 13:05:10.967273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:10.967273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 456/905] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Jul 12 13:05:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:10.968107 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d49d26-0d17-428e-9ba4-29830551c5c0 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:10.968107 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d49d26-0d17-428e-9ba4-29830551c5c0 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:10.968107 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d49d26-0d17-428e-9ba4-29830551c5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:10.985929 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-30d49d26-0d17-428e-9ba4-29830551c5c0 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:10.987183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-30d49d26-0d17-428e-9ba4-29830551c5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:10.990813 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f7c84-6f49-45ac-bbed-0136d1b03d01 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:11.027042 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f142c-9f97-4a20-bc00-a843e2971652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:11.027816 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f142c-9f97-4a20-bc00-a843e2971652 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:11.028176 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f142c-9f97-4a20-bc00-a843e2971652 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:11.028529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f142c-9f97-4a20-bc00-a843e2971652 None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:11.029334 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f142c-9f97-4a20-bc00-a843e2971652 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:11.029654 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f142c-9f97-4a20-bc00-a843e2971652 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:11.031071 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f142c-9f97-4a20-bc00-a843e2971652 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:11.045024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 450/906] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:11.045884 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f142c-9f97-4a20-bc00-a843e2971652 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:11.065745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 457/907] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:11.065745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d49d26-0d17-428e-9ba4-29830551c5c0 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:11.096472 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:11.166513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f142c-9f97-4a20-bc00-a843e2971652 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:11.175100 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d49d26-0d17-428e-9ba4-29830551c5c0 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:11.187310 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:11.206724 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24c5d1-c0c5-458c-ae57-c127b322a4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:11.207403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24c5d1-c0c5-458c-ae57-c127b322a4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:11.207689 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24c5d1-c0c5-458c-ae57-c127b322a4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:11.207964 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24c5d1-c0c5-458c-ae57-c127b322a4f7 None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:11.208681 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24c5d1-c0c5-458c-ae57-c127b322a4f7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:11.208993 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24c5d1-c0c5-458c-ae57-c127b322a4f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:11.210890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24c5d1-c0c5-458c-ae57-c127b322a4f7 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:11.213030 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bc709-6fa7-4b5a-90eb-d6b91dd287db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:11.213841 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bc709-6fa7-4b5a-90eb-d6b91dd287db None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:11.214147 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bc709-6fa7-4b5a-90eb-d6b91dd287db None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:11.214432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bc709-6fa7-4b5a-90eb-d6b91dd287db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:11.216681 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 451/908] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Jul 12 13:05:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:11.217394 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24c5d1-c0c5-458c-ae57-c127b322a4f7 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:11.227015 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bc709-6fa7-4b5a-90eb-d6b91dd287db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:11.228477 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bc709-6fa7-4b5a-90eb-d6b91dd287db None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:11.243427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-706bc709-6fa7-4b5a-90eb-d6b91dd287db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:05:11.243427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:11.243427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:11.243427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:11.243427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:11.243427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:11.243427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:11.243427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:11.243427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:11.243427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:11.243427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:11.243427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:11.243427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:05:11.243427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:05:11.243427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:05:11.244624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:05:11.244624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:11.244624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:11.244624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:11.244624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:11.244624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:11.244624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:11.244624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:11.244624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:11.244624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:11.244624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:11.244624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:11.244624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:11.244624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:11.244624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:11.244624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:11.244624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:11.245749 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:05:11.245749 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:05:11.245749 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:05:11.245749 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:05:11.245749 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:05:11.245749 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:05:11.245749 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:05:11.245749 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:11.249492 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 458/909] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:05:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:11.250422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bc709-6fa7-4b5a-90eb-d6b91dd287db None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:11.328400 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24c5d1-c0c5-458c-ae57-c127b322a4f7 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:11.365314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c7a8f-9b03-4dd1-a3ec-0e3c95b36115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:11.366227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c7a8f-9b03-4dd1-a3ec-0e3c95b36115 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:11.366523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c7a8f-9b03-4dd1-a3ec-0e3c95b36115 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:11.366806 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c7a8f-9b03-4dd1-a3ec-0e3c95b36115 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:11.367469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c7a8f-9b03-4dd1-a3ec-0e3c95b36115 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:11.368876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c7a8f-9b03-4dd1-a3ec-0e3c95b36115 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:11.370675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:11.382506 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-349c7a8f-9b03-4dd1-a3ec-0e3c95b36115 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 13:05:11.382506 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:11.382506 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:05:11.382506 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:05:11.382506 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:05:11.382506 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:05:11.382506 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:05:11.382506 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:11.382506 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 13:05:11.382506 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:11.382506 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:05:11.382506 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:11.382506 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:11.382506 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:11.382506 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:11.382506 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:11.383728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:11.383728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:11.383728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:11.383728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:11.383728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:11.383728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:11.383728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:11.383728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:05:11.383728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:05:11.383728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:05:11.383728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:05:11.383728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:11.383728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:11.383728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:11.383728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:11.383728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:11.384858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:11.384858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:11.384858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:11.384858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:11.384858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:11.384858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:11.384858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:11.384858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:11.384858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:11.384858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:11.384858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:11.384858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:05:11.384858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:11.384858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 13:05:11.384858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:11.386959 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bc709-6fa7-4b5a-90eb-d6b91dd287db None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:11.389168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 452/910] 10.222.0.17 () {56 vars in 1132 bytes} [Tue Jul 12 13:05:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:11.390039 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c7a8f-9b03-4dd1-a3ec-0e3c95b36115 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:11.423023 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c1bc7-eb3d-4fec-b516-6408d75ac367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:11.423621 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c1bc7-eb3d-4fec-b516-6408d75ac367 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:11.423906 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c1bc7-eb3d-4fec-b516-6408d75ac367 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:11.424413 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c1bc7-eb3d-4fec-b516-6408d75ac367 None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:11.424881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c1bc7-eb3d-4fec-b516-6408d75ac367 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:11.425192 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c1bc7-eb3d-4fec-b516-6408d75ac367 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:11.426626 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c1bc7-eb3d-4fec-b516-6408d75ac367 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:11.432755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 459/911] 10.222.0.17 () {56 vars in 1114 bytes} [Tue Jul 12 13:05:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:11.435056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c1bc7-eb3d-4fec-b516-6408d75ac367 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:11.442997 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:11.505534 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c7a8f-9b03-4dd1-a3ec-0e3c95b36115 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:11.544557 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c590d-b80c-4d42-be9b-359c7facac89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:11.545227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c590d-b80c-4d42-be9b-359c7facac89 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:11.545511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c590d-b80c-4d42-be9b-359c7facac89 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:11.545790 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c590d-b80c-4d42-be9b-359c7facac89 None admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:11.546162 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c1bc7-eb3d-4fec-b516-6408d75ac367 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:11.546609 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c590d-b80c-4d42-be9b-359c7facac89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:11.546920 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c590d-b80c-4d42-be9b-359c7facac89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:11.548357 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c590d-b80c-4d42-be9b-359c7facac89 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:11.561236 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 453/912] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:05:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:11.561972 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c590d-b80c-4d42-be9b-359c7facac89 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:11.588200 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86764119-33d5-467d-868d-4d649961e312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:11.588889 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86764119-33d5-467d-868d-4d649961e312 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:11.589183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86764119-33d5-467d-868d-4d649961e312 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:11.589467 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86764119-33d5-467d-868d-4d649961e312 None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:11.590214 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86764119-33d5-467d-868d-4d649961e312 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:11.590531 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86764119-33d5-467d-868d-4d649961e312 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:11.591929 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86764119-33d5-467d-868d-4d649961e312 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:11.596831 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 460/913] 10.222.0.17 () {56 vars in 1126 bytes} [Tue Jul 12 13:05:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:11.602265 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86764119-33d5-467d-868d-4d649961e312 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:11.625785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:11.680858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c590d-b80c-4d42-be9b-359c7facac89 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:11.692036 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:11.713593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86764119-33d5-467d-868d-4d649961e312 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:11.728194 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0826d-4fc9-4ace-acfa-b4c90978bbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:11.728982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0826d-4fc9-4ace-acfa-b4c90978bbbe None admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:11.729268 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0826d-4fc9-4ace-acfa-b4c90978bbbe None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:11.729553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0826d-4fc9-4ace-acfa-b4c90978bbbe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:11.730486 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0826d-4fc9-4ace-acfa-b4c90978bbbe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:11.731877 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0826d-4fc9-4ace-acfa-b4c90978bbbe None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:11.750410 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e582e8c-c6ab-435b-9dcf-bbd84228f8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:11.751159 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e582e8c-c6ab-435b-9dcf-bbd84228f8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:11.751455 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e582e8c-c6ab-435b-9dcf-bbd84228f8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:11.751760 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e582e8c-c6ab-435b-9dcf-bbd84228f8d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:11.752602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e582e8c-c6ab-435b-9dcf-bbd84228f8d1 None admin] RBAC: Adding query filter params (role.id=ce2d01c208f54cb38480ddb8127babc8, scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2, user.id=72f556aac45c460cb573498aab7590fe) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:11.762400 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e582e8c-c6ab-435b-9dcf-bbd84228f8d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:11.762595 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 454/914] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Jul 12 13:05:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:05:11.762595 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0826d-4fc9-4ace-acfa-b4c90978bbbe None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:11.762734 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e582e8c-c6ab-435b-9dcf-bbd84228f8d1 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:11.762734 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 461/915] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:05:11 2022] GET /identity/v3/role_assignments?user.id=72f556aac45c460cb573498aab7590fe&scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2&role.id=ce2d01c208f54cb38480ddb8127babc8 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:11.901367 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0826d-4fc9-4ace-acfa-b4c90978bbbe None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:11.943137 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b684b84-d97f-4ce5-95a1-30155bb514dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:11.944028 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b684b84-d97f-4ce5-95a1-30155bb514dc None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:11.944272 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b684b84-d97f-4ce5-95a1-30155bb514dc None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:11.944504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b684b84-d97f-4ce5-95a1-30155bb514dc None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:11.945241 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b684b84-d97f-4ce5-95a1-30155bb514dc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:11.945551 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b684b84-d97f-4ce5-95a1-30155bb514dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:11.947173 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b684b84-d97f-4ce5-95a1-30155bb514dc None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:11.953294 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 455/916] 10.222.0.17 () {56 vars in 1126 bytes} [Tue Jul 12 13:05:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:11.959031 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e582e8c-c6ab-435b-9dcf-bbd84228f8d1 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:12.055045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:12.072500 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e582e8c-c6ab-435b-9dcf-bbd84228f8d1 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:12.108012 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946e328-4c1a-4c19-a98a-91117c7a776a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:12.108690 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946e328-4c1a-4c19-a98a-91117c7a776a None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:12.109119 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946e328-4c1a-4c19-a98a-91117c7a776a None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:12.109406 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946e328-4c1a-4c19-a98a-91117c7a776a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:12.110233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946e328-4c1a-4c19-a98a-91117c7a776a None admin] RBAC: Adding query filter params (interface=public, service_id=1792cab648c6462390274c93358751eb, region_id=RegionOne) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:12.110609 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946e328-4c1a-4c19-a98a-91117c7a776a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:12.112063 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946e328-4c1a-4c19-a98a-91117c7a776a None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:12.117859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 462/917] 10.222.0.17 () {56 vars in 1251 bytes} [Tue Jul 12 13:05:11 2022] GET /identity/v3/endpoints?service_id=1792cab648c6462390274c93358751eb&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:12.123106 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b684b84-d97f-4ce5-95a1-30155bb514dc None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:12.151905 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:12.237563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b684b84-d97f-4ce5-95a1-30155bb514dc None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:12.274154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b26240-4954-4c12-8f3b-a33796adcf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:12.275103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b26240-4954-4c12-8f3b-a33796adcf20 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:12.275545 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b26240-4954-4c12-8f3b-a33796adcf20 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:12.276004 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b26240-4954-4c12-8f3b-a33796adcf20 None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:12.276845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b26240-4954-4c12-8f3b-a33796adcf20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:12.278403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b26240-4954-4c12-8f3b-a33796adcf20 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:12.285258 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 456/918] 10.222.0.17 () {56 vars in 1087 bytes} [Tue Jul 12 13:05:12 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:05:12.813471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b56fbf-3019-4d1f-9737-182d96362a33 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:12.813802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b56fbf-3019-4d1f-9737-182d96362a33 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:12.814050 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b56fbf-3019-4d1f-9737-182d96362a33 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:12.815747 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 463/919] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:12.821268 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357d901-b72d-4e34-94fe-c1e74bc328c5 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:12.821768 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357d901-b72d-4e34-94fe-c1e74bc328c5 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:12.821850 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357d901-b72d-4e34-94fe-c1e74bc328c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:12.839569 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-c357d901-b72d-4e34-94fe-c1e74bc328c5 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:12.840798 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-c357d901-b72d-4e34-94fe-c1e74bc328c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:12.918228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 457/920] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:12.935297 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b56fbf-3019-4d1f-9737-182d96362a33 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:13.058499 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b56fbf-3019-4d1f-9737-182d96362a33 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:13.096777 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e8e6f-365e-42a2-9ecb-94de31cc476c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:13.097600 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e8e6f-365e-42a2-9ecb-94de31cc476c None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:13.097895 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e8e6f-365e-42a2-9ecb-94de31cc476c None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:13.098198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e8e6f-365e-42a2-9ecb-94de31cc476c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:13.098862 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e8e6f-365e-42a2-9ecb-94de31cc476c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:13.100930 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e8e6f-365e-42a2-9ecb-94de31cc476c None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:13.113447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-417e8e6f-365e-42a2-9ecb-94de31cc476c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:05:13.113447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:13.113447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:05:13.113447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:05:13.113447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:05:13.113447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:05:13.113447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:05:13.113447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:13.113447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:05:13.113447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:13.113447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:05:13.113447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:13.113447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:13.113447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:13.113447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:13.113447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:13.113447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:13.114503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:13.114503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:13.114503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:13.114503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:13.114503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:13.114503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:13.114503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:05:13.114503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:05:13.114503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:05:13.114503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:05:13.114503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:13.114503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:13.114503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:13.114503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:13.114503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:13.114503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:13.115325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:13.115325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:13.115325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:13.115325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:13.115325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:13.115325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:13.115325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:13.115325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:13.115325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:13.115325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:13.115325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:05:13.115325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:13.115325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:05:13.115325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:13.120412 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 464/921] 10.222.0.17 () {56 vars in 1126 bytes} [Tue Jul 12 13:05:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:13.121812 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357d901-b72d-4e34-94fe-c1e74bc328c5 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:13.154489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:13.236407 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357d901-b72d-4e34-94fe-c1e74bc328c5 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:13.271016 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209d6e3-6af8-4585-921a-062262fce410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:13.272451 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209d6e3-6af8-4585-921a-062262fce410 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:13.272883 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209d6e3-6af8-4585-921a-062262fce410 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:13.273301 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209d6e3-6af8-4585-921a-062262fce410 None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:13.274188 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209d6e3-6af8-4585-921a-062262fce410 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:13.274672 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209d6e3-6af8-4585-921a-062262fce410 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:13.276176 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209d6e3-6af8-4585-921a-062262fce410 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:13.281454 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 458/922] 10.222.0.17 () {56 vars in 1122 bytes} [Tue Jul 12 13:05:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:13.287145 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e8e6f-365e-42a2-9ecb-94de31cc476c None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:13.305000 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:13.409202 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e8e6f-365e-42a2-9ecb-94de31cc476c None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:13.446271 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9abe7-53ec-49cd-8c54-ccec5293b361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:13.446961 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9abe7-53ec-49cd-8c54-ccec5293b361 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:13.447251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9abe7-53ec-49cd-8c54-ccec5293b361 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:13.447533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9abe7-53ec-49cd-8c54-ccec5293b361 None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:13.448262 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9abe7-53ec-49cd-8c54-ccec5293b361 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:13.448576 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9abe7-53ec-49cd-8c54-ccec5293b361 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:13.449965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9abe7-53ec-49cd-8c54-ccec5293b361 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:13.456017 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 465/923] 10.222.0.17 () {56 vars in 1122 bytes} [Tue Jul 12 13:05:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:13.462444 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209d6e3-6af8-4585-921a-062262fce410 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:13.553342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:13.575941 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209d6e3-6af8-4585-921a-062262fce410 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:13.613477 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c089da9-86ad-45fd-ae6b-7cff913fea62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:13.614558 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c089da9-86ad-45fd-ae6b-7cff913fea62 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:13.615071 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c089da9-86ad-45fd-ae6b-7cff913fea62 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:13.615557 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c089da9-86ad-45fd-ae6b-7cff913fea62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:13.616633 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c089da9-86ad-45fd-ae6b-7cff913fea62 None admin] RBAC: Adding query filter params (interface=public, service_id=5c9f29d85d2549e4925e8e64796e2e0e, region_id=RegionOne) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:13.617163 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c089da9-86ad-45fd-ae6b-7cff913fea62 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:13.618784 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c089da9-86ad-45fd-ae6b-7cff913fea62 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:13.629267 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 459/924] 10.222.0.17 () {56 vars in 1251 bytes} [Tue Jul 12 13:05:13 2022] GET /identity/v3/endpoints?service_id=5c9f29d85d2549e4925e8e64796e2e0e&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:13.630943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9abe7-53ec-49cd-8c54-ccec5293b361 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:13.714991 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:13.739228 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9abe7-53ec-49cd-8c54-ccec5293b361 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:13.775416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c3912-9dec-4921-acae-1999031d44f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:13.776104 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c3912-9dec-4921-acae-1999031d44f1 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:13.776393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c3912-9dec-4921-acae-1999031d44f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:13.776681 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c3912-9dec-4921-acae-1999031d44f1 None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:13.777368 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c3912-9dec-4921-acae-1999031d44f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:13.778782 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c3912-9dec-4921-acae-1999031d44f1 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:13.785350 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 466/925] 10.222.0.17 () {56 vars in 1087 bytes} [Tue Jul 12 13:05:13 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:05:13.926831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07810e-271e-4076-aac1-095ec348c227 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:13.927816 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07810e-271e-4076-aac1-095ec348c227 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:13.928366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07810e-271e-4076-aac1-095ec348c227 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:13.930487 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 460/926] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:13.935725 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38537d2a-114d-498e-b310-541f729c3c50 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:13.936284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38537d2a-114d-498e-b310-541f729c3c50 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:13.936785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38537d2a-114d-498e-b310-541f729c3c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:13.956857 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-38537d2a-114d-498e-b310-541f729c3c50 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:13.958076 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-38537d2a-114d-498e-b310-541f729c3c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:14.046016 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 467/927] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:14.068671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07810e-271e-4076-aac1-095ec348c227 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:14.077737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7b05a-1235-4d41-a099-9cf25344c231 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:14.078041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7b05a-1235-4d41-a099-9cf25344c231 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:14.078367 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7b05a-1235-4d41-a099-9cf25344c231 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:14.080021 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 468/928] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:14.085569 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1fd72-5f74-49bd-8700-5030d96dca33 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:14.085858 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1fd72-5f74-49bd-8700-5030d96dca33 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:14.086170 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1fd72-5f74-49bd-8700-5030d96dca33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:14.103586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-f0b1fd72-5f74-49bd-8700-5030d96dca33 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:14.105010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-f0b1fd72-5f74-49bd-8700-5030d96dca33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:14.173928 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:14.180834 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 469/929] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:05:14.186852 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07810e-271e-4076-aac1-095ec348c227 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:14.204665 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1fd72-5f74-49bd-8700-5030d96dca33 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:14.226388 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef35da-21e8-4f1a-ba67-4d9e936c7380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:14.227294 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef35da-21e8-4f1a-ba67-4d9e936c7380 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:14.227580 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef35da-21e8-4f1a-ba67-4d9e936c7380 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:14.227852 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef35da-21e8-4f1a-ba67-4d9e936c7380 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:14.239803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef35da-21e8-4f1a-ba67-4d9e936c7380 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:05:14.248795 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-f2ef35da-21e8-4f1a-ba67-4d9e936c7380 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 13:05:14.248795 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:14.248795 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:14.248795 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:14.248795 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:14.248795 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:14.248795 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:14.248795 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:14.248795 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:14.248795 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:14.248795 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:14.248795 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:14.248795 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:05:14.248795 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:05:14.248795 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:05:14.248795 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:05:14.249763 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:05:14.249763 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:05:14.249763 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:05:14.249763 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:05:14.249763 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:14.249763 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:14.249763 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:14.249763 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:14.249763 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:14.249763 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:14.249763 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:14.249763 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:14.249763 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:14.249763 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:14.249763 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:14.249763 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:14.250721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:14.250721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:14.250721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:14.250721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:14.250721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:05:14.250721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:05:14.250721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:05:14.250721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:05:14.250721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:05:14.250721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:05:14.250721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 13:05:14.250721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:14.250721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 461/930] 10.222.0.17 () {56 vars in 1120 bytes} [Tue Jul 12 13:05:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:14.255996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef35da-21e8-4f1a-ba67-4d9e936c7380 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:14.261503 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:14.331886 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1fd72-5f74-49bd-8700-5030d96dca33 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:14.370475 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0d9a3-f45d-4d5e-b883-2edb0bdecc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:14.371164 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0d9a3-f45d-4d5e-b883-2edb0bdecc09 None admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:14.371448 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0d9a3-f45d-4d5e-b883-2edb0bdecc09 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:14.371732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0d9a3-f45d-4d5e-b883-2edb0bdecc09 None admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:14.372458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0d9a3-f45d-4d5e-b883-2edb0bdecc09 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:14.373967 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0d9a3-f45d-4d5e-b883-2edb0bdecc09 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:14.375448 dv-cinder-797608-55-smb devstack@keystone.service[80628]: WARNING keystone.server.flask.common [None req-8ce0d9a3-f45d-4d5e-b883-2edb0bdecc09 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 12 13:05:14.395140 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef35da-21e8-4f1a-ba67-4d9e936c7380 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:14.395749 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.sql.core [None req-8ce0d9a3-f45d-4d5e-b883-2edb0bdecc09 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 13:05:14.395749 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 12 13:05:14.395749 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [parameters: {'id': '6690acec48c04f68a2a8d038101463f8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 12 13:05:14.395749 dv-cinder-797608-55-smb devstack@keystone.service[80628]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80628) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 13:05:14.417387 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-8ce0d9a3-f45d-4d5e-b883-2edb0bdecc09 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6690acec48c04f68a2a8d038101463f8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6690acec48c04f68a2a8d038101463f8. Jul 12 13:05:14.417387 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:14.417387 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 13:05:14.417387 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 13:05:14.417387 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 13:05:14.417387 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 13:05:14.417387 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 13:05:14.417387 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 13:05:14.417387 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 13:05:14.417387 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application conn.query(q) Jul 12 13:05:14.417387 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 13:05:14.417387 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 13:05:14.417387 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 13:05:14.418331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application result.read() Jul 12 13:05:14.418331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 13:05:14.418331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 13:05:14.418331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 13:05:14.418331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 13:05:14.418331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 13:05:14.418331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 13:05:14.418331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 13:05:14.418331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 13:05:14.418331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 13:05:14.418331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:14.418331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 13:05:14.418331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:14.418331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:14.418331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 13:05:14.418331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 13:05:14.418331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 12 13:05:14.418331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 12 13:05:14.419290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 13:05:14.419290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application next(self.gen) Jul 12 13:05:14.419290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 13:05:14.419290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application yield resource Jul 12 13:05:14.419290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 13:05:14.419290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application next(self.gen) Jul 12 13:05:14.419290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 13:05:14.419290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 13:05:14.419290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 13:05:14.419290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 13:05:14.419290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 13:05:14.419290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise self.value Jul 12 13:05:14.419290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 13:05:14.419290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 13:05:14.419290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 13:05:14.419290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application session.commit() Jul 12 13:05:14.419290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 13:05:14.420198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 13:05:14.420198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 13:05:14.420198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 13:05:14.420198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 13:05:14.420198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self.session.flush() Jul 12 13:05:14.420198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 13:05:14.420198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 13:05:14.420198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 13:05:14.420198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 13:05:14.420198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 13:05:14.420198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application compat.raise_( Jul 12 13:05:14.420198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 13:05:14.420198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception Jul 12 13:05:14.420198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 13:05:14.420198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 13:05:14.420198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 13:05:14.420198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 13:05:14.421118 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 13:05:14.421118 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 13:05:14.421118 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 13:05:14.421118 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 13:05:14.421118 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 12 13:05:14.421118 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 12 13:05:14.421118 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 13:05:14.421118 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 13:05:14.421118 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 13:05:14.421118 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 13:05:14.421118 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 13:05:14.421118 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 13:05:14.421118 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 13:05:14.421118 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 13:05:14.421118 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 13:05:14.421934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 13:05:14.421934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 13:05:14.421934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception Jul 12 13:05:14.421934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 13:05:14.421934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 13:05:14.421934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 13:05:14.421934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 13:05:14.421934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 13:05:14.421934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 13:05:14.421934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 13:05:14.421934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application conn.query(q) Jul 12 13:05:14.421934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 13:05:14.421934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 13:05:14.421934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 13:05:14.421934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application result.read() Jul 12 13:05:14.421934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 13:05:14.421934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 13:05:14.422866 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 13:05:14.422866 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 13:05:14.422866 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 13:05:14.422866 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 13:05:14.422866 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 13:05:14.422866 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 13:05:14.422866 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 13:05:14.422866 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 12 13:05:14.422866 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [parameters: {'id': '6690acec48c04f68a2a8d038101463f8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 12 13:05:14.422866 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 13:05:14.422866 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:14.422866 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:05:14.422866 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:14.422866 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:14.422866 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 12 13:05:14.425939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 12 13:05:14.425939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 13:05:14.425939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 13:05:14.425939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 12 13:05:14.425939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:14.425939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:05:14.425939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:14.425939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:14.425939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:14.425939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:14.425939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:14.425939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:14.425939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:14.425939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:14.425939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:14.425939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:14.425939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:14.428946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:14.428946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 12 13:05:14.428946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 12 13:05:14.428946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:14.428946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:14.428946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 12 13:05:14.428946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 12 13:05:14.428946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6690acec48c04f68a2a8d038101463f8. Jul 12 13:05:14.428946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:14.428946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 470/931] 10.222.0.17 () {60 vars in 1140 bytes} [Tue Jul 12 13:05:14 2022] POST /identity/v3/projects => generated 262 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:05:14.428946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0d9a3-f45d-4d5e-b883-2edb0bdecc09 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:14.444395 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5dee3-cfe4-4ff6-924c-a01e73979b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:14.445435 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5dee3-cfe4-4ff6-924c-a01e73979b5b None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:14.445941 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5dee3-cfe4-4ff6-924c-a01e73979b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:14.446571 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5dee3-cfe4-4ff6-924c-a01e73979b5b None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:14.447620 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5dee3-cfe4-4ff6-924c-a01e73979b5b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:14.448106 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5dee3-cfe4-4ff6-924c-a01e73979b5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:14.449767 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5dee3-cfe4-4ff6-924c-a01e73979b5b None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:14.460784 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 462/932] 10.222.0.17 () {56 vars in 1115 bytes} [Tue Jul 12 13:05:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:14.466595 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5dee3-cfe4-4ff6-924c-a01e73979b5b None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:14.498307 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:14.545734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:14.551917 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0d9a3-f45d-4d5e-b883-2edb0bdecc09 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:14.585067 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5dee3-cfe4-4ff6-924c-a01e73979b5b None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:14.593578 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aca5eb-b796-4e45-992b-7e32f39f1944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:14.594435 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aca5eb-b796-4e45-992b-7e32f39f1944 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:14.594756 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aca5eb-b796-4e45-992b-7e32f39f1944 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:14.595038 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aca5eb-b796-4e45-992b-7e32f39f1944 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:14.602212 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aca5eb-b796-4e45-992b-7e32f39f1944 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:14.603912 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aca5eb-b796-4e45-992b-7e32f39f1944 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:14.619294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-d8aca5eb-b796-4e45-992b-7e32f39f1944 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:05:14.619294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:14.619294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:14.619294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:14.619294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:14.619294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:14.619294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:14.619294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:14.619294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:14.619294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:14.619294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:14.619294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:14.619294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:05:14.619294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:05:14.619294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:05:14.620245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:05:14.620245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:14.620245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:14.620245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:14.620245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:14.620245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:14.620245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:14.620245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:14.620245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:14.620245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:14.620245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:14.620245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:14.620245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:14.620245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:14.620245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:14.620245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:14.620245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:14.621138 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:05:14.621138 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:05:14.621138 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:05:14.621138 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:05:14.621138 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:05:14.621138 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:05:14.621138 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:05:14.621138 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:14.621138 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 471/933] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:05:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:05:14.621943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b697819-3428-47bd-b49b-407e83ca14f4 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:14.622169 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b697819-3428-47bd-b49b-407e83ca14f4 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:14.622456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b697819-3428-47bd-b49b-407e83ca14f4 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:14.626580 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 472/934] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:14.627243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae7bc0-5417-41f3-a818-c09050c89386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:14.627378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b697819-3428-47bd-b49b-407e83ca14f4 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:14.628417 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae7bc0-5417-41f3-a818-c09050c89386 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:14.628709 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae7bc0-5417-41f3-a818-c09050c89386 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:14.628988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae7bc0-5417-41f3-a818-c09050c89386 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:14.642747 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae7bc0-5417-41f3-a818-c09050c89386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:14.644215 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae7bc0-5417-41f3-a818-c09050c89386 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:14.662916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-e1ae7bc0-5417-41f3-a818-c09050c89386 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:14.662916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:14.662916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:14.662916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:14.662916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:14.662916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:14.662916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:14.662916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:14.662916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:14.662916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:14.662916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:14.662916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:14.662916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:05:14.662916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:05:14.662916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:05:14.663873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:05:14.663873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:14.663873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:14.663873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:14.663873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:14.663873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:14.663873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:14.663873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:14.663873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:14.663873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:14.663873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:14.663873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:14.663873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:14.663873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:14.663873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:14.663873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:14.663873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:14.664767 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:05:14.664767 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:05:14.664767 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:14.664767 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:14.666481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 463/935] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:14.668237 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e427065-bbf4-49d6-b24e-929275bd8243 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:14.669005 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e427065-bbf4-49d6-b24e-929275bd8243 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:14.669402 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e427065-bbf4-49d6-b24e-929275bd8243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:14.686782 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-8e427065-bbf4-49d6-b24e-929275bd8243 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:14.687787 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-8e427065-bbf4-49d6-b24e-929275bd8243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:14.749648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b697819-3428-47bd-b49b-407e83ca14f4 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:14.767680 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:14.768315 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 464/936] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:14.770306 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e427065-bbf4-49d6-b24e-929275bd8243 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:14.786605 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c027487-8be2-4bb6-b6a9-1f41c6721038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:14.787282 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c027487-8be2-4bb6-b6a9-1f41c6721038 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:14.787614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c027487-8be2-4bb6-b6a9-1f41c6721038 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:14.787894 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c027487-8be2-4bb6-b6a9-1f41c6721038 None admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:14.788658 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c027487-8be2-4bb6-b6a9-1f41c6721038 None admin] RBAC: Adding query filter params (name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:14.788968 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c027487-8be2-4bb6-b6a9-1f41c6721038 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:14.790443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c027487-8be2-4bb6-b6a9-1f41c6721038 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:14.808735 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 473/937] 10.222.0.17 () {56 vars in 1112 bytes} [Tue Jul 12 13:05:14 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:14.809579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c027487-8be2-4bb6-b6a9-1f41c6721038 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:14.843191 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:14.918142 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e427065-bbf4-49d6-b24e-929275bd8243 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:14.936481 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c027487-8be2-4bb6-b6a9-1f41c6721038 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:14.966483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a0724-11c7-4c9d-a2db-65d51107122b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:14.968373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a0724-11c7-4c9d-a2db-65d51107122b None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:14.968875 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a0724-11c7-4c9d-a2db-65d51107122b None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:14.969629 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a0724-11c7-4c9d-a2db-65d51107122b None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:14.970845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a0724-11c7-4c9d-a2db-65d51107122b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:14.971347 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a0724-11c7-4c9d-a2db-65d51107122b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:14.973729 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a0724-11c7-4c9d-a2db-65d51107122b None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:14.977574 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437d31d-8233-4db2-8bb3-3d4060e9383c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:14.978475 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437d31d-8233-4db2-8bb3-3d4060e9383c None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:14.978781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437d31d-8233-4db2-8bb3-3d4060e9383c None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:14.979060 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437d31d-8233-4db2-8bb3-3d4060e9383c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:14.979735 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437d31d-8233-4db2-8bb3-3d4060e9383c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:14.981156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437d31d-8233-4db2-8bb3-3d4060e9383c None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:14.994338 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 465/938] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:14.995073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-9437d31d-8233-4db2-8bb3-3d4060e9383c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 13:05:14.995073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:14.995073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:05:14.995073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:05:14.995073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:05:14.995073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:05:14.995073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:05:14.995073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:14.995073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 13:05:14.995073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:14.995073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:05:14.995073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:14.995073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:14.995073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:14.995073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:14.995073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:14.996176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:14.996176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:14.996176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:14.996176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:14.996176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:14.996176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:14.996176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:14.996176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:05:14.996176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:05:14.996176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:05:14.996176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:05:14.996176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:14.996176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:14.996176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:14.996176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:14.996176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:14.997202 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:14.997202 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:14.997202 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:14.997202 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:14.997202 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:14.997202 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:14.997202 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:14.997202 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:14.997202 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:14.997202 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:14.997202 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:14.997202 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:05:14.997202 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:14.997202 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 13:05:14.997202 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:14.999328 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a0724-11c7-4c9d-a2db-65d51107122b None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:15.002348 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 474/939] 10.222.0.17 () {56 vars in 1132 bytes} [Tue Jul 12 13:05:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:15.003315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437d31d-8233-4db2-8bb3-3d4060e9383c None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:15.060288 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:15.134469 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437d31d-8233-4db2-8bb3-3d4060e9383c None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:15.138959 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a0724-11c7-4c9d-a2db-65d51107122b None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:15.151865 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:15.173576 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83b47e-8e8c-447d-902e-da110d9cf0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:15.174651 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83b47e-8e8c-447d-902e-da110d9cf0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:15.175176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83b47e-8e8c-447d-902e-da110d9cf0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:15.175672 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83b47e-8e8c-447d-902e-da110d9cf0c9 None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:15.176751 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83b47e-8e8c-447d-902e-da110d9cf0c9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:15.177282 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83b47e-8e8c-447d-902e-da110d9cf0c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:15.178978 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83b47e-8e8c-447d-902e-da110d9cf0c9 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:15.184198 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889cb0f-c876-4a72-b99d-7fc5383574c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:15.185074 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889cb0f-c876-4a72-b99d-7fc5383574c9 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:15.185365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889cb0f-c876-4a72-b99d-7fc5383574c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:15.185645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889cb0f-c876-4a72-b99d-7fc5383574c9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:15.186381 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 475/940] 10.222.0.17 () {56 vars in 1126 bytes} [Tue Jul 12 13:05:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:15.191548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83b47e-8e8c-447d-902e-da110d9cf0c9 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:15.194617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889cb0f-c876-4a72-b99d-7fc5383574c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:15.196442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889cb0f-c876-4a72-b99d-7fc5383574c9 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:15.221656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-0889cb0f-c876-4a72-b99d-7fc5383574c9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 13:05:15.221656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:15.221656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:15.221656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:15.221656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:15.221656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:15.221656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:15.221656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:15.221656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:15.221656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:15.221656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:15.221656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:15.221656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:05:15.221656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:05:15.221656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:05:15.221656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:05:15.222780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:15.222780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:15.222780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:05:15.222780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:05:15.222780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:05:15.222780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:05:15.222780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:15.222780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:15.222780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:15.222780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:15.222780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:15.222780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:15.222780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:15.222780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:15.222780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:15.222780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:15.222780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:15.222780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:15.223723 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:15.223723 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:15.223723 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:05:15.223723 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:05:15.223723 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:05:15.223723 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:05:15.223723 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:05:15.223723 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:05:15.223723 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 13:05:15.223723 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:15.226194 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 466/941] 10.222.0.17 () {56 vars in 1117 bytes} [Tue Jul 12 13:05:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:05:15.228753 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889cb0f-c876-4a72-b99d-7fc5383574c9 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:15.327249 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83b47e-8e8c-447d-902e-da110d9cf0c9 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:15.330450 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:15.368067 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889cb0f-c876-4a72-b99d-7fc5383574c9 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:15.376805 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bca04d-a8f7-469e-b108-c2cc3028c8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:15.377621 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bca04d-a8f7-469e-b108-c2cc3028c8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:15.378234 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bca04d-a8f7-469e-b108-c2cc3028c8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:15.380275 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bca04d-a8f7-469e-b108-c2cc3028c8f2 None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:15.381709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bca04d-a8f7-469e-b108-c2cc3028c8f2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:15.382044 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bca04d-a8f7-469e-b108-c2cc3028c8f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:15.383486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bca04d-a8f7-469e-b108-c2cc3028c8f2 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:15.393551 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 476/942] 10.222.0.17 () {56 vars in 1126 bytes} [Tue Jul 12 13:05:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:15.402029 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bca04d-a8f7-469e-b108-c2cc3028c8f2 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:15.426140 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2905c73-a2a5-4fa9-ac6d-a55f31228e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:15.426140 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2905c73-a2a5-4fa9-ac6d-a55f31228e4d None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:15.426140 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2905c73-a2a5-4fa9-ac6d-a55f31228e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:15.426140 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2905c73-a2a5-4fa9-ac6d-a55f31228e4d None admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:15.426568 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2905c73-a2a5-4fa9-ac6d-a55f31228e4d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:15.426568 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2905c73-a2a5-4fa9-ac6d-a55f31228e4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:15.426568 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2905c73-a2a5-4fa9-ac6d-a55f31228e4d None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:15.454078 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 467/943] 10.222.0.17 () {56 vars in 1149 bytes} [Tue Jul 12 13:05:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:15.455027 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2905c73-a2a5-4fa9-ac6d-a55f31228e4d None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:15.495161 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:15.526420 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bca04d-a8f7-469e-b108-c2cc3028c8f2 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:15.566524 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c6c7f-4714-4b02-a7a6-ab62ad377388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:15.567656 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c6c7f-4714-4b02-a7a6-ab62ad377388 None admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:15.568167 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c6c7f-4714-4b02-a7a6-ab62ad377388 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:15.568741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c6c7f-4714-4b02-a7a6-ab62ad377388 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:15.570388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c6c7f-4714-4b02-a7a6-ab62ad377388 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:15.572027 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c6c7f-4714-4b02-a7a6-ab62ad377388 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:15.589198 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2905c73-a2a5-4fa9-ac6d-a55f31228e4d None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:15.606679 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 477/944] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Jul 12 13:05:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:05:15.638717 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e12880-d357-448f-856c-02646295a650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:15.639542 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e12880-d357-448f-856c-02646295a650 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:15.639827 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e12880-d357-448f-856c-02646295a650 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:15.640106 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e12880-d357-448f-856c-02646295a650 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:15.653623 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e12880-d357-448f-856c-02646295a650 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:15.655300 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e12880-d357-448f-856c-02646295a650 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:15.676671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-39e12880-d357-448f-856c-02646295a650 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:15.676671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:15.676671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:15.676671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:15.676671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:15.676671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:15.676671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:15.676671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:15.676671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:15.676671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:15.676671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:15.676671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:15.676671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:05:15.676671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:05:15.676671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:05:15.677652 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:05:15.677652 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:15.677652 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:15.677652 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:15.677652 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:15.677652 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:15.677652 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:15.677652 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:15.677652 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:15.677652 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:15.677652 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:15.677652 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:15.677652 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:15.677652 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:15.677652 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:15.677652 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:15.677652 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:15.679484 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:05:15.679484 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:05:15.679484 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:15.679484 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:15.679484 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 468/945] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:15.692341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c6c7f-4714-4b02-a7a6-ab62ad377388 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:15.723364 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:15.813645 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c6c7f-4714-4b02-a7a6-ab62ad377388 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:15.851887 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8c77b-e6fc-49ea-938d-1ab404052a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:15.852497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8c77b-e6fc-49ea-938d-1ab404052a1b None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:15.852782 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8c77b-e6fc-49ea-938d-1ab404052a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:15.853060 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8c77b-e6fc-49ea-938d-1ab404052a1b None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:15.853796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e8c77b-e6fc-49ea-938d-1ab404052a1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:15.854106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e8c77b-e6fc-49ea-938d-1ab404052a1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:15.855550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e8c77b-e6fc-49ea-938d-1ab404052a1b None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:15.868967 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 478/946] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:15.874657 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e12880-d357-448f-856c-02646295a650 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:15.956013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:15.984783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e12880-d357-448f-856c-02646295a650 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:16.007071 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cd386-54c5-44f6-a533-0f45934984d9 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:16.007367 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cd386-54c5-44f6-a533-0f45934984d9 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:16.007645 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cd386-54c5-44f6-a533-0f45934984d9 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:16.014137 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 479/947] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:16.015952 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d90558-31ea-4deb-9d02-5c9fdb3e1936 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:16.016467 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d90558-31ea-4deb-9d02-5c9fdb3e1936 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:16.017068 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d90558-31ea-4deb-9d02-5c9fdb3e1936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:16.023284 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9f3d0-732b-46ed-81f4-a9a21fd39fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:16.024100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9f3d0-732b-46ed-81f4-a9a21fd39fbe None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:16.024392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9f3d0-732b-46ed-81f4-a9a21fd39fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:16.024675 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9f3d0-732b-46ed-81f4-a9a21fd39fbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:16.032733 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9f3d0-732b-46ed-81f4-a9a21fd39fbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:16.034248 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9f3d0-732b-46ed-81f4-a9a21fd39fbe None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:16.038811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-77d90558-31ea-4deb-9d02-5c9fdb3e1936 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:16.040670 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-77d90558-31ea-4deb-9d02-5c9fdb3e1936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:16.050152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-bcf9f3d0-732b-46ed-81f4-a9a21fd39fbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:05:16.050152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:16.050152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:16.050152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:16.050152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:16.050152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:16.050152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:16.050152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:16.050152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:16.050152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:16.050152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:16.050152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:16.050152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:05:16.050152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:05:16.050152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:05:16.051121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:05:16.051121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:16.051121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:16.051121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:16.051121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:16.051121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:16.051121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:16.051121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:16.051121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:16.051121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:16.051121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:16.051121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:16.051121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:16.051121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:16.051121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:16.051121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:16.051121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:16.052044 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:05:16.052044 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:05:16.052044 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:05:16.052044 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:05:16.052044 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:05:16.052044 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:05:16.052044 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:05:16.052044 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:16.052044 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 469/948] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:05:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:16.058780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9f3d0-732b-46ed-81f4-a9a21fd39fbe None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:16.130460 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 480/949] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:16.149732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d90558-31ea-4deb-9d02-5c9fdb3e1936 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:16.168560 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:16.176690 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9f3d0-732b-46ed-81f4-a9a21fd39fbe None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:16.214422 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070aa055-c715-45da-bb48-10ccc57d0c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:16.215727 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070aa055-c715-45da-bb48-10ccc57d0c2e None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:16.216036 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070aa055-c715-45da-bb48-10ccc57d0c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:16.216302 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070aa055-c715-45da-bb48-10ccc57d0c2e None admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:16.217102 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070aa055-c715-45da-bb48-10ccc57d0c2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:16.217415 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070aa055-c715-45da-bb48-10ccc57d0c2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:16.219598 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070aa055-c715-45da-bb48-10ccc57d0c2e None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:16.221622 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:16.236243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 470/950] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:05:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:16.241931 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070aa055-c715-45da-bb48-10ccc57d0c2e None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:16.272748 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d90558-31ea-4deb-9d02-5c9fdb3e1936 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:16.317677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ca893-9a9f-4b8c-a5c4-f73494ec1c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:16.318992 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ca893-9a9f-4b8c-a5c4-f73494ec1c8c None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:16.319384 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ca893-9a9f-4b8c-a5c4-f73494ec1c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:16.319769 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ca893-9a9f-4b8c-a5c4-f73494ec1c8c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:16.320538 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ca893-9a9f-4b8c-a5c4-f73494ec1c8c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:16.322185 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ca893-9a9f-4b8c-a5c4-f73494ec1c8c None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:16.335984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-e19ca893-9a9f-4b8c-a5c4-f73494ec1c8c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:05:16.335984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:16.335984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:05:16.335984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:05:16.335984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:05:16.335984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:05:16.335984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:05:16.335984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:16.335984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:05:16.335984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:16.335984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:05:16.335984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:16.335984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:16.335984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:16.335984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:16.335984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:16.335984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:16.337250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:16.337250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:16.337250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:16.337250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:16.337250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:16.337250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:16.337250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:05:16.337250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:05:16.337250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:05:16.337250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:05:16.337250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:16.337250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:16.337250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:16.337250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:16.337250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:16.337250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:16.338351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:16.338351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:16.338351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:16.338351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:16.338351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:16.338351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:16.338351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:16.338351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:16.338351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:16.338351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:16.338351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:05:16.338351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:16.338351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:05:16.338351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:16.345439 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 481/951] 10.222.0.17 () {56 vars in 1126 bytes} [Tue Jul 12 13:05:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:16.346652 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ca893-9a9f-4b8c-a5c4-f73494ec1c8c None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:16.361977 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070aa055-c715-45da-bb48-10ccc57d0c2e None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:16.407376 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d725f1-e75e-4e69-83c5-ef3cfc006602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:16.408593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d725f1-e75e-4e69-83c5-ef3cfc006602 None admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:16.408877 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d725f1-e75e-4e69-83c5-ef3cfc006602 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:16.409150 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d725f1-e75e-4e69-83c5-ef3cfc006602 None admin] PATH_INFO: `/v3/projects/cd70432d4e5a4e25a4a6def32ffc6ee2/users/72f556aac45c460cb573498aab7590fe/roles/ce2d01c208f54cb38480ddb8127babc8` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:16.412072 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d725f1-e75e-4e69-83c5-ef3cfc006602 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd70432d4e5a4e25a4a6def32ffc6ee2, user_id=72f556aac45c460cb573498aab7590fe, role_id=ce2d01c208f54cb38480ddb8127babc8)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:16.414332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d725f1-e75e-4e69-83c5-ef3cfc006602 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:16.436866 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 471/952] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Jul 12 13:05:16 2022] PUT /identity/v3/projects/cd70432d4e5a4e25a4a6def32ffc6ee2/users/72f556aac45c460cb573498aab7590fe/roles/ce2d01c208f54cb38480ddb8127babc8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:05:16.470782 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:16.500966 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ca893-9a9f-4b8c-a5c4-f73494ec1c8c None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:16.545014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637da76-d32d-412f-a68b-e92c16d97397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:16.545785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637da76-d32d-412f-a68b-e92c16d97397 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:16.546081 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637da76-d32d-412f-a68b-e92c16d97397 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:16.546387 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637da76-d32d-412f-a68b-e92c16d97397 None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:16.547166 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637da76-d32d-412f-a68b-e92c16d97397 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:16.547486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637da76-d32d-412f-a68b-e92c16d97397 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:16.548905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637da76-d32d-412f-a68b-e92c16d97397 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:16.555266 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 482/953] 10.222.0.17 () {56 vars in 1122 bytes} [Tue Jul 12 13:05:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:16.560990 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d725f1-e75e-4e69-83c5-ef3cfc006602 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:16.629682 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:16.687553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d725f1-e75e-4e69-83c5-ef3cfc006602 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:16.726065 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9f756-b0f3-4792-b7c9-db52c1ac717b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:16.727050 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9f756-b0f3-4792-b7c9-db52c1ac717b None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:16.727504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9f756-b0f3-4792-b7c9-db52c1ac717b None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:16.727927 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9f756-b0f3-4792-b7c9-db52c1ac717b None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:16.728820 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9f756-b0f3-4792-b7c9-db52c1ac717b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:16.729274 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9f756-b0f3-4792-b7c9-db52c1ac717b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:16.730884 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9f756-b0f3-4792-b7c9-db52c1ac717b None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:16.737149 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 472/954] 10.222.0.17 () {56 vars in 1122 bytes} [Tue Jul 12 13:05:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:16.742839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637da76-d32d-412f-a68b-e92c16d97397 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:16.854722 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637da76-d32d-412f-a68b-e92c16d97397 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:16.892713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893864d-8dcd-44f3-a54a-4a7c12dfc6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:16.893762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893864d-8dcd-44f3-a54a-4a7c12dfc6dd None admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:16.894245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893864d-8dcd-44f3-a54a-4a7c12dfc6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:16.894696 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893864d-8dcd-44f3-a54a-4a7c12dfc6dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:16.895721 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893864d-8dcd-44f3-a54a-4a7c12dfc6dd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:16.897901 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893864d-8dcd-44f3-a54a-4a7c12dfc6dd None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:16.913956 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:16.925053 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 483/955] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Jul 12 13:05:16 2022] POST /identity/v3/endpoints => generated 349 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:05:17.076023 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf46ef-5cf5-4b29-8ef6-7b2042a02df2 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:17.076593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf46ef-5cf5-4b29-8ef6-7b2042a02df2 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:17.076593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf46ef-5cf5-4b29-8ef6-7b2042a02df2 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:17.078259 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 473/956] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:17.083670 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576b3fa-8f99-4ed1-a6ec-be35e20e5db5 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:17.084000 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576b3fa-8f99-4ed1-a6ec-be35e20e5db5 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:17.084302 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576b3fa-8f99-4ed1-a6ec-be35e20e5db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:17.102040 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-6576b3fa-8f99-4ed1-a6ec-be35e20e5db5 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:17.103283 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-6576b3fa-8f99-4ed1-a6ec-be35e20e5db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:17.180442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 484/957] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:17.205305 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf46ef-5cf5-4b29-8ef6-7b2042a02df2 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:17.316238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf46ef-5cf5-4b29-8ef6-7b2042a02df2 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:17.335662 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:17.353956 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26ee87-189f-459a-a8f1-faa171cf5b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:17.354692 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26ee87-189f-459a-a8f1-faa171cf5b73 None admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:17.354976 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26ee87-189f-459a-a8f1-faa171cf5b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:17.355254 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26ee87-189f-459a-a8f1-faa171cf5b73 None admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:17.355964 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26ee87-189f-459a-a8f1-faa171cf5b73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:17.357398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26ee87-189f-459a-a8f1-faa171cf5b73 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:17.358819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: WARNING keystone.server.flask.common [None req-df26ee87-189f-459a-a8f1-faa171cf5b73 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 12 13:05:17.372984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.sql.core [None req-df26ee87-189f-459a-a8f1-faa171cf5b73 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 13:05:17.372984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 12 13:05:17.372984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [parameters: {'user_id': '944a6884dde349a4971e9387d2d501d9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 12 13:05:17.372984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80627) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 13:05:17.380880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-df26ee87-189f-459a-a8f1-faa171cf5b73 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 12 13:05:17.380880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:17.380880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 13:05:17.380880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 13:05:17.380880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 13:05:17.380880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 13:05:17.380880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 13:05:17.380880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 13:05:17.380880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 13:05:17.380880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application conn.query(q) Jul 12 13:05:17.380880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 13:05:17.380880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 13:05:17.380880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 13:05:17.380880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application result.read() Jul 12 13:05:17.380880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 13:05:17.381830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 13:05:17.381830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 13:05:17.381830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 13:05:17.381830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 13:05:17.381830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 13:05:17.381830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 13:05:17.381830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 13:05:17.381830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 13:05:17.381830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:17.381830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 13:05:17.381830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:17.381830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:17.381830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 13:05:17.381830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 13:05:17.381830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 12 13:05:17.381830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 12 13:05:17.381830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 13:05:17.381830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application next(self.gen) Jul 12 13:05:17.383146 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 13:05:17.383146 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application yield resource Jul 12 13:05:17.383146 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 13:05:17.383146 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application next(self.gen) Jul 12 13:05:17.383146 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 13:05:17.383146 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 13:05:17.383146 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 13:05:17.383146 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 13:05:17.383146 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 13:05:17.383146 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise self.value Jul 12 13:05:17.383146 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 13:05:17.383146 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 13:05:17.383146 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 13:05:17.383146 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application session.commit() Jul 12 13:05:17.383146 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 13:05:17.383146 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 13:05:17.383146 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 13:05:17.384642 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 13:05:17.384642 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 13:05:17.384642 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self.session.flush() Jul 12 13:05:17.384642 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 13:05:17.384642 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 13:05:17.384642 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 13:05:17.384642 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 13:05:17.384642 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 13:05:17.384642 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application compat.raise_( Jul 12 13:05:17.384642 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 13:05:17.384642 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception Jul 12 13:05:17.384642 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 13:05:17.384642 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 13:05:17.384642 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 13:05:17.384642 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 13:05:17.384642 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 13:05:17.384642 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 13:05:17.386464 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 13:05:17.386464 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 13:05:17.386464 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 12 13:05:17.386464 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 12 13:05:17.386464 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 13:05:17.386464 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 13:05:17.386464 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 13:05:17.386464 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 13:05:17.386464 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 13:05:17.386464 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 13:05:17.386464 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 13:05:17.386464 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 13:05:17.386464 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 13:05:17.386464 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 13:05:17.386464 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 13:05:17.386464 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception Jul 12 13:05:17.387349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 13:05:17.387349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 13:05:17.387349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 13:05:17.387349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 13:05:17.387349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 13:05:17.387349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 13:05:17.387349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 13:05:17.387349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application conn.query(q) Jul 12 13:05:17.387349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 13:05:17.387349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 13:05:17.387349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 13:05:17.387349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application result.read() Jul 12 13:05:17.387349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 13:05:17.387349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 13:05:17.387349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 13:05:17.387349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 13:05:17.388218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 13:05:17.388218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 13:05:17.388218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 13:05:17.388218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 13:05:17.388218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 13:05:17.388218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 12 13:05:17.388218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [parameters: {'user_id': '944a6884dde349a4971e9387d2d501d9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 12 13:05:17.388218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 13:05:17.388218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:17.388218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:05:17.388218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:17.388218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:17.388218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:17.388218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:17.388218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:17.389104 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:17.389104 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:17.389104 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:17.389104 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:17.389104 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:17.389104 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:17.389104 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:17.389104 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 12 13:05:17.389104 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 12 13:05:17.389104 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:17.389104 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:17.389104 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:05:17.389104 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:05:17.389104 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:05:17.389104 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:05:17.389104 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 12 13:05:17.389104 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 12 13:05:17.390340 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 12 13:05:17.390340 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 12 13:05:17.390340 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 13:05:17.390340 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 13:05:17.390340 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 12 13:05:17.390340 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:17.390340 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 474/958] 10.222.0.17 () {60 vars in 1131 bytes} [Tue Jul 12 13:05:17 2022] POST /identity/v3/users => generated 160 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:17.392067 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576b3fa-8f99-4ed1-a6ec-be35e20e5db5 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:17.503468 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576b3fa-8f99-4ed1-a6ec-be35e20e5db5 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:17.529004 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:17.541207 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0234e75-5088-4639-a72f-c244dec7abbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:17.542031 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0234e75-5088-4639-a72f-c244dec7abbc None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:17.542343 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0234e75-5088-4639-a72f-c244dec7abbc None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:17.542624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0234e75-5088-4639-a72f-c244dec7abbc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:17.550438 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0234e75-5088-4639-a72f-c244dec7abbc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:17.551906 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0234e75-5088-4639-a72f-c244dec7abbc None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:17.567296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-a0234e75-5088-4639-a72f-c244dec7abbc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 13:05:17.567296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:17.567296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:17.567296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:17.567296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:17.567296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:17.567296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:17.567296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:17.567296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:17.567296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:17.567296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:17.567296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:17.567296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:05:17.567296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:05:17.567296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:05:17.567296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:05:17.568272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:17.568272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:17.568272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:05:17.568272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:05:17.568272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:05:17.568272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:05:17.568272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:17.568272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:17.568272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:17.568272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:17.568272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:17.568272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:17.568272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:17.568272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:17.568272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:17.568272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:17.568272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:17.568272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:17.569344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:17.569344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:17.569344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:05:17.569344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:05:17.569344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:05:17.569344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:05:17.569344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:05:17.569344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:05:17.569344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 13:05:17.569344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:17.569344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 485/959] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:05:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:17.574829 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26ee87-189f-459a-a8f1-faa171cf5b73 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:17.689149 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26ee87-189f-459a-a8f1-faa171cf5b73 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:17.725905 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbbde7-8a5e-4d97-b86d-25051e016162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:17.726667 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbbde7-8a5e-4d97-b86d-25051e016162 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:17.727011 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbbde7-8a5e-4d97-b86d-25051e016162 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:17.727300 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbbde7-8a5e-4d97-b86d-25051e016162 None admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:17.728147 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbbde7-8a5e-4d97-b86d-25051e016162 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:17.728459 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbbde7-8a5e-4d97-b86d-25051e016162 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:17.730214 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbbde7-8a5e-4d97-b86d-25051e016162 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:17.774348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 475/960] 10.222.0.17 () {56 vars in 1101 bytes} [Tue Jul 12 13:05:17 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:17.855311 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c9223-2cf8-4cf1-96ec-8e7dcfa1f442 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:17.855616 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c9223-2cf8-4cf1-96ec-8e7dcfa1f442 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:17.855881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c9223-2cf8-4cf1-96ec-8e7dcfa1f442 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:17.857673 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 486/961] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:17.863537 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b7b8e-418a-45b6-8db9-fe1740d5ca8b None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:17.863846 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b7b8e-418a-45b6-8db9-fe1740d5ca8b None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:17.864100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b7b8e-418a-45b6-8db9-fe1740d5ca8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:17.883144 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-340b7b8e-418a-45b6-8db9-fe1740d5ca8b None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:17.884699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-340b7b8e-418a-45b6-8db9-fe1740d5ca8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:17.918866 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:17.964858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 476/962] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:17.987298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c9223-2cf8-4cf1-96ec-8e7dcfa1f442 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:18.101510 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c9223-2cf8-4cf1-96ec-8e7dcfa1f442 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:18.138180 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8608f8a-e51d-4288-af74-17af1852268e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:18.138999 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8608f8a-e51d-4288-af74-17af1852268e None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:18.139286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8608f8a-e51d-4288-af74-17af1852268e None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:18.139567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8608f8a-e51d-4288-af74-17af1852268e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:18.140237 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8608f8a-e51d-4288-af74-17af1852268e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:18.141610 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8608f8a-e51d-4288-af74-17af1852268e None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:18.154378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-c8608f8a-e51d-4288-af74-17af1852268e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 13:05:18.154378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:18.154378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:05:18.154378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:05:18.154378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:05:18.154378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:05:18.154378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:05:18.154378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:18.154378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 13:05:18.154378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:18.154378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:05:18.154378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:18.154378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:18.154378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:18.154378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:18.154378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:18.154378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:18.155498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:18.155498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:18.155498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:18.155498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:18.155498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:18.155498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:18.155498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:05:18.155498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:05:18.155498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:05:18.155498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:05:18.155498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:18.155498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:18.155498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:18.155498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:18.155498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:18.155498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:18.156380 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:18.156380 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:18.156380 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:18.156380 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:18.156380 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:18.156380 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:18.156380 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:18.156380 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:18.156380 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:18.156380 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:18.156380 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:05:18.156380 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:18.156380 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 13:05:18.156380 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:18.156380 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 487/963] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:05:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:18.163983 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b7b8e-418a-45b6-8db9-fe1740d5ca8b None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:18.267406 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b7b8e-418a-45b6-8db9-fe1740d5ca8b None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:18.301589 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65657c14-a122-4d1e-96de-077b33195dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:18.302305 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65657c14-a122-4d1e-96de-077b33195dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:18.302641 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65657c14-a122-4d1e-96de-077b33195dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:18.302862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65657c14-a122-4d1e-96de-077b33195dd3 None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:18.304141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65657c14-a122-4d1e-96de-077b33195dd3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:18.304447 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65657c14-a122-4d1e-96de-077b33195dd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:18.305815 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65657c14-a122-4d1e-96de-077b33195dd3 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:18.311380 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 477/964] 10.222.0.17 () {56 vars in 1112 bytes} [Tue Jul 12 13:05:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:18.316757 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8608f8a-e51d-4288-af74-17af1852268e None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:18.367881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:18.425726 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8608f8a-e51d-4288-af74-17af1852268e None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:18.463174 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244b6fb-8edd-4693-b339-5ca38b147476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:18.463854 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244b6fb-8edd-4693-b339-5ca38b147476 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:18.464142 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244b6fb-8edd-4693-b339-5ca38b147476 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:18.464421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244b6fb-8edd-4693-b339-5ca38b147476 None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:18.465138 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244b6fb-8edd-4693-b339-5ca38b147476 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:18.465447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244b6fb-8edd-4693-b339-5ca38b147476 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:18.466846 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244b6fb-8edd-4693-b339-5ca38b147476 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:18.471793 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 488/965] 10.222.0.17 () {56 vars in 1112 bytes} [Tue Jul 12 13:05:18 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:18.694711 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e655f-548f-4db9-8a84-a68bc9ad384f None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:18.695009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e655f-548f-4db9-8a84-a68bc9ad384f None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:18.695273 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e655f-548f-4db9-8a84-a68bc9ad384f None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:18.696798 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 478/966] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:18.702242 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53380e-e458-41c1-85ff-7f90e0a2b2f0 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:18.702541 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53380e-e458-41c1-85ff-7f90e0a2b2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:18.702823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53380e-e458-41c1-85ff-7f90e0a2b2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:18.721286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-ae53380e-e458-41c1-85ff-7f90e0a2b2f0 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:18.722515 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-ae53380e-e458-41c1-85ff-7f90e0a2b2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:18.794142 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 489/967] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:18.815364 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e655f-548f-4db9-8a84-a68bc9ad384f None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:18.846948 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:18.919458 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e655f-548f-4db9-8a84-a68bc9ad384f None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:18.954179 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f03b1-d54a-49a6-9a26-e80cb530358e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:18.955001 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f03b1-d54a-49a6-9a26-e80cb530358e None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:18.955285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f03b1-d54a-49a6-9a26-e80cb530358e None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:18.955562 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f03b1-d54a-49a6-9a26-e80cb530358e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:18.965776 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f03b1-d54a-49a6-9a26-e80cb530358e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:05:18.973917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-c04f03b1-d54a-49a6-9a26-e80cb530358e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 13:05:18.973917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:18.973917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:18.973917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:18.973917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:18.973917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:18.973917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:18.973917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:18.973917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:18.973917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:18.973917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:18.973917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:18.973917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:05:18.973917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:05:18.973917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:05:18.973917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:05:18.975490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:05:18.975490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:05:18.975490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:05:18.975490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:05:18.975490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:18.975490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:18.975490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:18.975490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:18.975490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:18.975490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:18.975490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:18.975490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:18.975490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:18.975490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:18.975490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:18.975490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:18.976348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:18.976348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:18.976348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:18.976348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:18.976348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:05:18.976348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:05:18.976348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:05:18.976348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:05:18.976348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:05:18.976348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:05:18.976348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 13:05:18.976348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:18.978433 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 479/968] 10.222.0.17 () {56 vars in 1120 bytes} [Tue Jul 12 13:05:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:18.981756 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53380e-e458-41c1-85ff-7f90e0a2b2f0 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:19.026780 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:19.086246 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53380e-e458-41c1-85ff-7f90e0a2b2f0 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:19.088426 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ef97d-de88-4aee-a230-84f511f1357a None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:19.088718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ef97d-de88-4aee-a230-84f511f1357a None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:19.088993 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ef97d-de88-4aee-a230-84f511f1357a None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:19.090410 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 480/969] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:19.095406 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbc470-ad34-4409-80d9-d05d6d5abb0b None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:19.095698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbc470-ad34-4409-80d9-d05d6d5abb0b None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:19.095988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbc470-ad34-4409-80d9-d05d6d5abb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:19.113334 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-cdfbc470-ad34-4409-80d9-d05d6d5abb0b None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:19.114564 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-cdfbc470-ad34-4409-80d9-d05d6d5abb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:19.125900 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9f50a-e54a-4af4-a375-2e890dc69de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:19.127024 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9f50a-e54a-4af4-a375-2e890dc69de2 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:19.127271 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9f50a-e54a-4af4-a375-2e890dc69de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:19.127491 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9f50a-e54a-4af4-a375-2e890dc69de2 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:19.128252 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9f50a-e54a-4af4-a375-2e890dc69de2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:19.128561 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9f50a-e54a-4af4-a375-2e890dc69de2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:19.129952 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9f50a-e54a-4af4-a375-2e890dc69de2 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:19.139183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 490/970] 10.222.0.17 () {56 vars in 1115 bytes} [Tue Jul 12 13:05:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:19.145104 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9f50a-e54a-4af4-a375-2e890dc69de2 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:19.194270 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 481/971] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:05:19.217032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbc470-ad34-4409-80d9-d05d6d5abb0b None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:19.241443 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:19.253038 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9f50a-e54a-4af4-a375-2e890dc69de2 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:19.255466 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:19.291509 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c142514-f78a-4f5e-9047-edd62bfb17c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:19.292324 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c142514-f78a-4f5e-9047-edd62bfb17c9 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:19.292612 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c142514-f78a-4f5e-9047-edd62bfb17c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:19.292887 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c142514-f78a-4f5e-9047-edd62bfb17c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:19.304392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c142514-f78a-4f5e-9047-edd62bfb17c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:19.305856 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c142514-f78a-4f5e-9047-edd62bfb17c9 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:19.323882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-6c142514-f78a-4f5e-9047-edd62bfb17c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:19.323882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:19.323882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:19.323882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:19.323882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:19.323882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:19.323882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:19.323882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:19.323882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:19.323882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:19.323882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:19.323882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:19.323882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:05:19.323882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:05:19.323882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:05:19.325325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:05:19.325325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:19.325325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:19.325325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:19.325325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:19.325325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:19.325325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:19.325325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:19.325325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:19.325325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:19.325325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:19.325325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:19.325325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:19.325325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:19.325325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:19.325325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:19.325325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:19.326828 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:05:19.326828 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:05:19.326828 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:19.326828 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:19.326828 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 491/972] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:05:19.330270 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbc470-ad34-4409-80d9-d05d6d5abb0b None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:19.330607 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c142514-f78a-4f5e-9047-edd62bfb17c9 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:19.368614 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f834c6-91c8-4249-891c-cb79aece77ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:19.369695 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f834c6-91c8-4249-891c-cb79aece77ab None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:19.369907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f834c6-91c8-4249-891c-cb79aece77ab None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:19.370198 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f834c6-91c8-4249-891c-cb79aece77ab None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:19.370860 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f834c6-91c8-4249-891c-cb79aece77ab None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:19.373078 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f834c6-91c8-4249-891c-cb79aece77ab None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:19.393432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-97f834c6-91c8-4249-891c-cb79aece77ab None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:05:19.393432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:19.393432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:05:19.393432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:05:19.393432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:05:19.393432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:05:19.393432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:05:19.393432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:19.393432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:05:19.393432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:19.393432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:05:19.393432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:19.393432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:19.393432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:19.393432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:19.393432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:19.393432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:19.395699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:19.395699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:19.395699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:19.395699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:19.395699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:19.395699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:19.395699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:05:19.395699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:05:19.395699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:05:19.395699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:05:19.395699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:19.395699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:19.395699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:19.395699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:19.395699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:19.395699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:19.397783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:19.397783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:19.397783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:19.397783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:19.397783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:19.397783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:19.397783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:19.397783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:19.397783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:19.397783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:19.397783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:05:19.397783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:19.397783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:05:19.397783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:19.397783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 482/973] 10.222.0.17 () {56 vars in 1126 bytes} [Tue Jul 12 13:05:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:19.401856 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f834c6-91c8-4249-891c-cb79aece77ab None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:19.446185 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c142514-f78a-4f5e-9047-edd62bfb17c9 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:19.481369 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea94dd-f33d-4505-aac5-b9a7a6c4430b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:19.481958 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea94dd-f33d-4505-aac5-b9a7a6c4430b None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:19.482279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea94dd-f33d-4505-aac5-b9a7a6c4430b None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:19.482562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea94dd-f33d-4505-aac5-b9a7a6c4430b None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:19.483289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea94dd-f33d-4505-aac5-b9a7a6c4430b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:19.483603 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea94dd-f33d-4505-aac5-b9a7a6c4430b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:19.484980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea94dd-f33d-4505-aac5-b9a7a6c4430b None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:19.496741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 492/974] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:19.502095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea94dd-f33d-4505-aac5-b9a7a6c4430b None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:19.504193 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:19.520965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:19.523326 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f834c6-91c8-4249-891c-cb79aece77ab None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:19.560896 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37c373-4cb6-468b-8082-30ab2fc83372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:19.561681 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37c373-4cb6-468b-8082-30ab2fc83372 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:19.561972 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37c373-4cb6-468b-8082-30ab2fc83372 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:19.562291 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37c373-4cb6-468b-8082-30ab2fc83372 None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:19.563013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37c373-4cb6-468b-8082-30ab2fc83372 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:19.563321 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37c373-4cb6-468b-8082-30ab2fc83372 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:19.565033 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37c373-4cb6-468b-8082-30ab2fc83372 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:19.570780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 483/975] 10.222.0.17 () {56 vars in 1122 bytes} [Tue Jul 12 13:05:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:19.576684 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37c373-4cb6-468b-8082-30ab2fc83372 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:19.607135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea94dd-f33d-4505-aac5-b9a7a6c4430b None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:19.644843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc832a-925e-4047-9ce5-1cacf738b139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:19.646171 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc832a-925e-4047-9ce5-1cacf738b139 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:19.646464 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc832a-925e-4047-9ce5-1cacf738b139 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:19.647765 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc832a-925e-4047-9ce5-1cacf738b139 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:19.655780 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc832a-925e-4047-9ce5-1cacf738b139 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:19.657231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc832a-925e-4047-9ce5-1cacf738b139 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:19.674329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-67bc832a-925e-4047-9ce5-1cacf738b139 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 13:05:19.674329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:19.674329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:19.674329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:19.674329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:19.674329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:19.674329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:19.674329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:19.674329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:19.674329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:19.674329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:19.674329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:19.674329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:05:19.674329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:05:19.674329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:05:19.674329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:05:19.675341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:19.675341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:19.675341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:05:19.675341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:05:19.675341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:05:19.675341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:05:19.675341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:19.675341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:19.675341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:19.675341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:19.675341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:19.675341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:19.675341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:19.675341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:19.675341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:19.675341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:19.675341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:19.675341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:19.676327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:19.676327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:19.676327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:05:19.676327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:05:19.676327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:05:19.676327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:05:19.676327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:05:19.676327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:05:19.676327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 13:05:19.676327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:19.680808 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 493/976] 10.222.0.17 () {56 vars in 1117 bytes} [Tue Jul 12 13:05:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:05:19.681666 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc832a-925e-4047-9ce5-1cacf738b139 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:19.692383 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37c373-4cb6-468b-8082-30ab2fc83372 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:19.731009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58798a1a-3c24-41db-8843-34f9310e0376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:19.731895 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58798a1a-3c24-41db-8843-34f9310e0376 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:19.732115 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58798a1a-3c24-41db-8843-34f9310e0376 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:19.732394 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58798a1a-3c24-41db-8843-34f9310e0376 None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:19.733096 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58798a1a-3c24-41db-8843-34f9310e0376 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:19.733402 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58798a1a-3c24-41db-8843-34f9310e0376 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:19.734804 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58798a1a-3c24-41db-8843-34f9310e0376 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:19.745490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 484/977] 10.222.0.17 () {56 vars in 1122 bytes} [Tue Jul 12 13:05:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:19.747033 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58798a1a-3c24-41db-8843-34f9310e0376 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:19.766303 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:19.776712 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:19.810994 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc832a-925e-4047-9ce5-1cacf738b139 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:19.846584 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f936d84-32eb-4038-8d20-9aa489d67236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:19.847360 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f936d84-32eb-4038-8d20-9aa489d67236 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:19.847710 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f936d84-32eb-4038-8d20-9aa489d67236 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:19.848052 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f936d84-32eb-4038-8d20-9aa489d67236 None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:19.848964 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f936d84-32eb-4038-8d20-9aa489d67236 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:19.849355 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f936d84-32eb-4038-8d20-9aa489d67236 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:19.851398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f936d84-32eb-4038-8d20-9aa489d67236 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:19.870297 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 494/978] 10.222.0.17 () {56 vars in 1149 bytes} [Tue Jul 12 13:05:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:19.870975 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58798a1a-3c24-41db-8843-34f9310e0376 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:19.875894 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f936d84-32eb-4038-8d20-9aa489d67236 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:19.909339 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55e72b-c717-4d4f-ad56-4d1d04b42289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:19.910020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55e72b-c717-4d4f-ad56-4d1d04b42289 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:19.910332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55e72b-c717-4d4f-ad56-4d1d04b42289 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:19.910617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55e72b-c717-4d4f-ad56-4d1d04b42289 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:19.911476 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55e72b-c717-4d4f-ad56-4d1d04b42289 None admin] RBAC: Adding query filter params (interface=admin, service_id=5c9f29d85d2549e4925e8e64796e2e0e, region_id=RegionOne) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:19.911799 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55e72b-c717-4d4f-ad56-4d1d04b42289 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:19.913664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55e72b-c717-4d4f-ad56-4d1d04b42289 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:19.919229 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 485/979] 10.222.0.17 () {56 vars in 1249 bytes} [Tue Jul 12 13:05:19 2022] GET /identity/v3/endpoints?service_id=5c9f29d85d2549e4925e8e64796e2e0e&interface=admin®ion_id=RegionOne => generated 193 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:19.924560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55e72b-c717-4d4f-ad56-4d1d04b42289 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:19.986442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f936d84-32eb-4038-8d20-9aa489d67236 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:20.014840 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:20.025549 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3996c6-0534-4dcc-8fcd-3611fbb6f5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:20.026245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3996c6-0534-4dcc-8fcd-3611fbb6f5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:20.026537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3996c6-0534-4dcc-8fcd-3611fbb6f5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:20.026818 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3996c6-0534-4dcc-8fcd-3611fbb6f5f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:20.029796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:20.040174 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55e72b-c717-4d4f-ad56-4d1d04b42289 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:20.075846 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73477961-891a-4ed3-b456-1014e4619c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:20.076529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73477961-891a-4ed3-b456-1014e4619c3a None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:20.076819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73477961-891a-4ed3-b456-1014e4619c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:20.077103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73477961-891a-4ed3-b456-1014e4619c3a None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:20.077788 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73477961-891a-4ed3-b456-1014e4619c3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:20.079200 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73477961-891a-4ed3-b456-1014e4619c3a None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:20.094153 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 486/980] 10.222.0.17 () {56 vars in 1087 bytes} [Tue Jul 12 13:05:19 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:05:20.103916 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3996c6-0534-4dcc-8fcd-3611fbb6f5f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:20.105403 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3996c6-0534-4dcc-8fcd-3611fbb6f5f2 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:20.218909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 495/981] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:05:19 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 13:05:20.220399 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73477961-891a-4ed3-b456-1014e4619c3a None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:20.323805 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73477961-891a-4ed3-b456-1014e4619c3a None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:20.357876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc221780-f292-4674-9f1a-83f77d4af107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:20.358745 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc221780-f292-4674-9f1a-83f77d4af107 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:20.359039 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc221780-f292-4674-9f1a-83f77d4af107 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:20.359320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc221780-f292-4674-9f1a-83f77d4af107 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:20.370851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc221780-f292-4674-9f1a-83f77d4af107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:20.372306 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc221780-f292-4674-9f1a-83f77d4af107 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:20.374053 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:20.392366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-fc221780-f292-4674-9f1a-83f77d4af107 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:20.392366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:20.392366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:20.392366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:20.392366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:20.392366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:20.392366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:20.392366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:20.392366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:20.392366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:20.392366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:20.392366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:20.392366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:05:20.392366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:05:20.392366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:05:20.393469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:05:20.393469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:20.393469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:20.393469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:20.393469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:20.393469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:20.393469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:20.393469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:20.393469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:20.393469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:20.393469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:20.393469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:20.393469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:20.393469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:20.393469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:20.393469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:20.393469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:20.394660 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:05:20.394660 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:05:20.394660 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:20.394660 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:20.395597 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 487/982] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:20.402036 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3996c6-0534-4dcc-8fcd-3611fbb6f5f2 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:20.441483 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:20.510977 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f28304-8634-4077-9847-7a97734a3ea9 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:20.511271 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f28304-8634-4077-9847-7a97734a3ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:20.511560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f28304-8634-4077-9847-7a97734a3ea9 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:20.513057 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 488/983] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:05:20.514155 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3996c6-0534-4dcc-8fcd-3611fbb6f5f2 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:20.518176 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5cacd-94ce-4db0-afe2-44a949d824e1 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:20.518474 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5cacd-94ce-4db0-afe2-44a949d824e1 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:20.518759 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5cacd-94ce-4db0-afe2-44a949d824e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:20.535459 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-75d5cacd-94ce-4db0-afe2-44a949d824e1 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:20.536668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-75d5cacd-94ce-4db0-afe2-44a949d824e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:20.550541 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d4745-3a47-4c38-bc77-f8b590ea3376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:20.551302 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d4745-3a47-4c38-bc77-f8b590ea3376 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:20.551650 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d4745-3a47-4c38-bc77-f8b590ea3376 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:20.551999 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d4745-3a47-4c38-bc77-f8b590ea3376 None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:20.552728 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d4745-3a47-4c38-bc77-f8b590ea3376 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:20.553656 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d4745-3a47-4c38-bc77-f8b590ea3376 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:20.555054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d4745-3a47-4c38-bc77-f8b590ea3376 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:20.574059 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 496/984] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:20.575159 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d4745-3a47-4c38-bc77-f8b590ea3376 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:20.615455 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 489/985] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:05:20.637974 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5cacd-94ce-4db0-afe2-44a949d824e1 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:20.680695 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:20.694305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d4745-3a47-4c38-bc77-f8b590ea3376 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:20.731368 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5043d-90c3-4757-b3bc-137bbdfc51ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:20.732182 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5043d-90c3-4757-b3bc-137bbdfc51ec None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:20.732469 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5043d-90c3-4757-b3bc-137bbdfc51ec None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:20.732749 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5043d-90c3-4757-b3bc-137bbdfc51ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:20.739784 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5043d-90c3-4757-b3bc-137bbdfc51ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:20.741292 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5043d-90c3-4757-b3bc-137bbdfc51ec None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:20.755178 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5cacd-94ce-4db0-afe2-44a949d824e1 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:20.756411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-75e5043d-90c3-4757-b3bc-137bbdfc51ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:05:20.756411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:20.756411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:20.756411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:20.756411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:20.756411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:20.756411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:20.756411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:20.756411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:20.756411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:20.756411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:20.756411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:20.756411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:05:20.756411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:05:20.756411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:05:20.757305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:05:20.757305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:20.757305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:20.757305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:20.757305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:20.757305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:20.757305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:20.757305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:20.757305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:20.757305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:20.757305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:20.757305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:20.757305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:20.757305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:20.757305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:20.757305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:20.757305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:20.758623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:05:20.758623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:05:20.758623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:05:20.758623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:05:20.758623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:05:20.758623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:05:20.758623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:05:20.758623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:20.758623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 497/986] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:05:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:05:20.763683 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5043d-90c3-4757-b3bc-137bbdfc51ec None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:20.785994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:20.799500 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eefda4-6ab5-487c-aa13-745054b29637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:20.800180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eefda4-6ab5-487c-aa13-745054b29637 None admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:20.800468 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eefda4-6ab5-487c-aa13-745054b29637 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:20.800747 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eefda4-6ab5-487c-aa13-745054b29637 None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:20.801467 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eefda4-6ab5-487c-aa13-745054b29637 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:20.802890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eefda4-6ab5-487c-aa13-745054b29637 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:20.816256 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 490/987] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Jul 12 13:05:20 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:05:20.878041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5043d-90c3-4757-b3bc-137bbdfc51ec None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:20.926742 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208ae9e-71b5-46cd-a64c-b59b4be2c925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:20.927432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208ae9e-71b5-46cd-a64c-b59b4be2c925 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:20.927717 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208ae9e-71b5-46cd-a64c-b59b4be2c925 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:20.928040 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208ae9e-71b5-46cd-a64c-b59b4be2c925 None admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:20.928844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208ae9e-71b5-46cd-a64c-b59b4be2c925 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:20.929165 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208ae9e-71b5-46cd-a64c-b59b4be2c925 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:20.930678 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208ae9e-71b5-46cd-a64c-b59b4be2c925 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:20.944259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 498/988] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:05:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:20.950298 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eefda4-6ab5-487c-aa13-745054b29637 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:21.058876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eefda4-6ab5-487c-aa13-745054b29637 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:21.094075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299ed95-c495-41b2-a123-f41ab6b1a7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:21.094792 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299ed95-c495-41b2-a123-f41ab6b1a7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:21.095084 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299ed95-c495-41b2-a123-f41ab6b1a7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:21.095368 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299ed95-c495-41b2-a123-f41ab6b1a7b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:21.096212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299ed95-c495-41b2-a123-f41ab6b1a7b8 None admin] RBAC: Adding query filter params (role.id=ce2d01c208f54cb38480ddb8127babc8, scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2, user.id=72f556aac45c460cb573498aab7590fe) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:21.096532 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299ed95-c495-41b2-a123-f41ab6b1a7b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:21.097981 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299ed95-c495-41b2-a123-f41ab6b1a7b8 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:21.110154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 491/989] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:05:20 2022] GET /identity/v3/role_assignments?user.id=72f556aac45c460cb573498aab7590fe&scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2&role.id=ce2d01c208f54cb38480ddb8127babc8 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:22.143707 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51a265-f6ae-4ac0-8da2-e960adc14226 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:22.144234 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51a265-f6ae-4ac0-8da2-e960adc14226 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:22.144234 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51a265-f6ae-4ac0-8da2-e960adc14226 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:22.145766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 499/990] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:22.150918 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c5804-8df4-4fd4-8c55-411a016c5660 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:22.151351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c5804-8df4-4fd4-8c55-411a016c5660 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:22.151517 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c5804-8df4-4fd4-8c55-411a016c5660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:22.168385 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-cc0c5804-8df4-4fd4-8c55-411a016c5660 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:22.169554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-cc0c5804-8df4-4fd4-8c55-411a016c5660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:22.215938 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:22.243450 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 492/991] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:22.266044 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51a265-f6ae-4ac0-8da2-e960adc14226 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:22.280367 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:22.372289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51a265-f6ae-4ac0-8da2-e960adc14226 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:22.408091 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6f6ae-7e08-44b9-88c6-e0b073ec5c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:22.408882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6f6ae-7e08-44b9-88c6-e0b073ec5c30 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:22.409165 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6f6ae-7e08-44b9-88c6-e0b073ec5c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:22.409488 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6f6ae-7e08-44b9-88c6-e0b073ec5c30 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:22.410166 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f6f6ae-7e08-44b9-88c6-e0b073ec5c30 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:22.411527 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f6f6ae-7e08-44b9-88c6-e0b073ec5c30 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:22.424442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-12f6f6ae-7e08-44b9-88c6-e0b073ec5c30 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:05:22.424442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:22.424442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:05:22.424442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:05:22.424442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:05:22.424442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:05:22.424442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:05:22.424442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:22.424442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:05:22.424442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:22.424442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:05:22.424442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:22.424442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:22.424442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:22.424442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:22.424442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:22.424442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:22.425458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:22.425458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:22.425458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:22.425458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:22.425458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:22.425458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:22.425458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:05:22.425458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:05:22.425458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:05:22.425458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:05:22.425458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:22.425458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:22.425458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:22.425458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:22.425458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:22.425458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:22.426321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:22.426321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:22.426321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:22.426321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:22.426321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:22.426321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:22.426321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:22.426321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:22.426321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:22.426321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:22.426321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:05:22.426321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:22.426321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:05:22.426321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:22.430290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 500/992] 10.222.0.17 () {56 vars in 1126 bytes} [Tue Jul 12 13:05:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:22.431838 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c5804-8df4-4fd4-8c55-411a016c5660 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:22.531850 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c5804-8df4-4fd4-8c55-411a016c5660 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:22.565844 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34a619-7347-4bcd-b01a-bfdd8ced0ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:22.566618 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34a619-7347-4bcd-b01a-bfdd8ced0ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:22.566902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34a619-7347-4bcd-b01a-bfdd8ced0ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:22.567175 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34a619-7347-4bcd-b01a-bfdd8ced0ef9 None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:22.567881 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34a619-7347-4bcd-b01a-bfdd8ced0ef9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:22.568187 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34a619-7347-4bcd-b01a-bfdd8ced0ef9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:22.569585 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34a619-7347-4bcd-b01a-bfdd8ced0ef9 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:22.575708 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 493/993] 10.222.0.17 () {56 vars in 1122 bytes} [Tue Jul 12 13:05:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:22.580313 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6f6ae-7e08-44b9-88c6-e0b073ec5c30 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:22.657842 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:22.692438 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6f6ae-7e08-44b9-88c6-e0b073ec5c30 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:22.728100 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab632b59-73b7-484b-982f-7f89f6ee2617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:22.729180 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab632b59-73b7-484b-982f-7f89f6ee2617 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:22.729718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab632b59-73b7-484b-982f-7f89f6ee2617 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:22.730229 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab632b59-73b7-484b-982f-7f89f6ee2617 None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:22.731191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab632b59-73b7-484b-982f-7f89f6ee2617 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:22.731698 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab632b59-73b7-484b-982f-7f89f6ee2617 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:22.733277 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab632b59-73b7-484b-982f-7f89f6ee2617 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:22.743731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 501/994] 10.222.0.17 () {56 vars in 1122 bytes} [Tue Jul 12 13:05:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:22.745300 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34a619-7347-4bcd-b01a-bfdd8ced0ef9 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:22.789314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:22.846929 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34a619-7347-4bcd-b01a-bfdd8ced0ef9 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:22.883069 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736ec53-fb46-41ff-9421-b5c221e3c5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:22.884125 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736ec53-fb46-41ff-9421-b5c221e3c5ba None admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:22.884611 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736ec53-fb46-41ff-9421-b5c221e3c5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:22.885083 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736ec53-fb46-41ff-9421-b5c221e3c5ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:22.886325 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5736ec53-fb46-41ff-9421-b5c221e3c5ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:22.887893 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5736ec53-fb46-41ff-9421-b5c221e3c5ba None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:22.891858 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c63e9-3fc2-4602-a449-266264a49b49 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:22.892160 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c63e9-3fc2-4602-a449-266264a49b49 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:22.892449 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c63e9-3fc2-4602-a449-266264a49b49 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:22.893847 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 502/995] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:22.901149 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530b0f3-c162-453f-8c53-a6ddc351b444 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:22.901464 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530b0f3-c162-453f-8c53-a6ddc351b444 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:22.901733 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530b0f3-c162-453f-8c53-a6ddc351b444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:22.910168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 494/996] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Jul 12 13:05:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:05:22.922458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-b530b0f3-c162-453f-8c53-a6ddc351b444 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:22.924147 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-b530b0f3-c162-453f-8c53-a6ddc351b444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:23.011148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 503/997] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:22 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:05:23.034792 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736ec53-fb46-41ff-9421-b5c221e3c5ba None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:23.150154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736ec53-fb46-41ff-9421-b5c221e3c5ba None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:23.152025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:23.172574 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28bc84-f535-453f-a056-63744fd8db1e None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:23.173092 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28bc84-f535-453f-a056-63744fd8db1e None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:23.173229 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28bc84-f535-453f-a056-63744fd8db1e None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:23.174548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 504/998] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:05:23.180155 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bee52-f3ff-44fe-a18c-3050671c86f8 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:23.180438 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bee52-f3ff-44fe-a18c-3050671c86f8 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:23.180723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bee52-f3ff-44fe-a18c-3050671c86f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:23.189788 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b483c-0128-443b-bf9a-e0d0a6a32a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:23.190643 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b483c-0128-443b-bf9a-e0d0a6a32a43 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:23.190933 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b483c-0128-443b-bf9a-e0d0a6a32a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:23.191235 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b483c-0128-443b-bf9a-e0d0a6a32a43 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:23.191876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b483c-0128-443b-bf9a-e0d0a6a32a43 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:23.193266 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b483c-0128-443b-bf9a-e0d0a6a32a43 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:23.198641 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-572bee52-f3ff-44fe-a18c-3050671c86f8 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:23.199872 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-572bee52-f3ff-44fe-a18c-3050671c86f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:23.206247 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-8f0b483c-0128-443b-bf9a-e0d0a6a32a43 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 13:05:23.206247 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:23.206247 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:05:23.206247 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:05:23.206247 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:05:23.206247 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:05:23.206247 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:05:23.206247 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:23.206247 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 13:05:23.206247 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:23.206247 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:05:23.206247 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:23.206247 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:23.206247 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:23.206247 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:23.206247 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:23.206247 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:23.207320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:23.207320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:23.207320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:23.207320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:23.207320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:23.207320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:23.207320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:05:23.207320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:05:23.207320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:05:23.207320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:05:23.207320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:23.207320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:23.207320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:23.207320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:23.207320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:23.207320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:23.208181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:23.208181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:23.208181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:23.208181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:23.208181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:23.208181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:23.208181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:23.208181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:23.208181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:23.208181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:23.208181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:05:23.208181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:23.208181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 13:05:23.208181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:23.209644 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 495/999] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:05:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:23.213671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b483c-0128-443b-bf9a-e0d0a6a32a43 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:23.265339 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:23.275586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 505/1000] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:23 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:05:23.297305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bee52-f3ff-44fe-a18c-3050671c86f8 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:23.322891 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b483c-0128-443b-bf9a-e0d0a6a32a43 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:23.356693 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e36a21-0e90-448b-89d9-faad585d157d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:23.357371 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e36a21-0e90-448b-89d9-faad585d157d None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:23.357673 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e36a21-0e90-448b-89d9-faad585d157d None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:23.357955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e36a21-0e90-448b-89d9-faad585d157d None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:23.358686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e36a21-0e90-448b-89d9-faad585d157d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:23.358996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e36a21-0e90-448b-89d9-faad585d157d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:23.360362 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e36a21-0e90-448b-89d9-faad585d157d None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:23.366595 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 496/1001] 10.222.0.17 () {56 vars in 1112 bytes} [Tue Jul 12 13:05:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:23.372116 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e36a21-0e90-448b-89d9-faad585d157d None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:23.405756 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:23.410486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bee52-f3ff-44fe-a18c-3050671c86f8 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:23.447143 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb6570-fdf9-4e83-b91a-1bdfd1b27995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:23.448323 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb6570-fdf9-4e83-b91a-1bdfd1b27995 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:23.448916 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb6570-fdf9-4e83-b91a-1bdfd1b27995 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:23.449442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb6570-fdf9-4e83-b91a-1bdfd1b27995 None admin] PATH_INFO: `/v3/services/image` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:23.450415 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb6570-fdf9-4e83-b91a-1bdfd1b27995 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:23.451972 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb6570-fdf9-4e83-b91a-1bdfd1b27995 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:23.465619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-dabb6570-fdf9-4e83-b91a-1bdfd1b27995 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 13:05:23.465619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:23.465619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:05:23.465619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:05:23.465619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:05:23.465619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:05:23.465619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:05:23.465619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:23.465619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 13:05:23.465619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:23.465619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:05:23.465619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:23.465619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:23.465619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:23.465619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:23.465619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:23.465619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:23.466811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:23.466811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:23.466811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:23.466811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:23.466811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:23.466811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:23.466811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:05:23.466811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:05:23.466811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:05:23.466811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:05:23.466811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:23.466811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:23.466811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:23.466811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:23.466811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:23.466811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:23.467718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:23.467718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:23.467718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:23.467718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:23.467718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:23.467718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:23.467718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:23.467718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:23.467718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:23.467718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:23.467718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:05:23.467718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:23.467718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 13:05:23.467718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:23.470263 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 506/1002] 10.222.0.17 () {56 vars in 1105 bytes} [Tue Jul 12 13:05:23 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:05:23.474075 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb6570-fdf9-4e83-b91a-1bdfd1b27995 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:23.486367 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e36a21-0e90-448b-89d9-faad585d157d None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:23.523474 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad906ded-926e-41c1-b13e-130b45902003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:23.524152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad906ded-926e-41c1-b13e-130b45902003 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:23.524443 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad906ded-926e-41c1-b13e-130b45902003 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:23.524721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad906ded-926e-41c1-b13e-130b45902003 None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:23.525527 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad906ded-926e-41c1-b13e-130b45902003 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:23.525837 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad906ded-926e-41c1-b13e-130b45902003 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:23.527233 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad906ded-926e-41c1-b13e-130b45902003 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:23.538213 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 497/1003] 10.222.0.17 () {56 vars in 1112 bytes} [Tue Jul 12 13:05:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:23.538362 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:23.539801 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad906ded-926e-41c1-b13e-130b45902003 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:23.581687 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb6570-fdf9-4e83-b91a-1bdfd1b27995 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:23.617951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698bf30-4513-454a-bb67-98f8c82558cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:23.618709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698bf30-4513-454a-bb67-98f8c82558cf None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:23.619022 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698bf30-4513-454a-bb67-98f8c82558cf None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:23.619325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698bf30-4513-454a-bb67-98f8c82558cf None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:23.620061 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698bf30-4513-454a-bb67-98f8c82558cf None admin] RBAC: Adding query filter params (name=image) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:23.620398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698bf30-4513-454a-bb67-98f8c82558cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:23.621855 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698bf30-4513-454a-bb67-98f8c82558cf None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:23.627157 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 507/1004] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:23.632998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698bf30-4513-454a-bb67-98f8c82558cf None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:23.641590 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:23.651235 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad906ded-926e-41c1-b13e-130b45902003 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:23.690400 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e334c-ca36-4e0e-a564-fe59b00735f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:23.691081 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e334c-ca36-4e0e-a564-fe59b00735f1 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:23.691370 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e334c-ca36-4e0e-a564-fe59b00735f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:23.691649 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e334c-ca36-4e0e-a564-fe59b00735f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:23.692441 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e334c-ca36-4e0e-a564-fe59b00735f1 None admin] RBAC: Adding query filter params (interface=public, service_id=5d35cdea87d34cf5a5b1333ff742ab7f, region_id=RegionOne) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:23.692755 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e334c-ca36-4e0e-a564-fe59b00735f1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:23.694210 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e334c-ca36-4e0e-a564-fe59b00735f1 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:23.699672 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 498/1005] 10.222.0.17 () {56 vars in 1251 bytes} [Tue Jul 12 13:05:23 2022] GET /identity/v3/endpoints?service_id=5d35cdea87d34cf5a5b1333ff742ab7f&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:23.705709 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e334c-ca36-4e0e-a564-fe59b00735f1 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:23.757661 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698bf30-4513-454a-bb67-98f8c82558cf None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:23.784461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:23.801012 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458b4b9-dbe8-41d5-bf1b-e8d6f9a8d420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:23.801883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458b4b9-dbe8-41d5-bf1b-e8d6f9a8d420 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:23.802367 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458b4b9-dbe8-41d5-bf1b-e8d6f9a8d420 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:23.802792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458b4b9-dbe8-41d5-bf1b-e8d6f9a8d420 None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:23.803612 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458b4b9-dbe8-41d5-bf1b-e8d6f9a8d420 None admin] RBAC: Adding query filter params (type=image) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:23.804026 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458b4b9-dbe8-41d5-bf1b-e8d6f9a8d420 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:23.805603 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458b4b9-dbe8-41d5-bf1b-e8d6f9a8d420 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:23.811256 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 508/1006] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:23.816924 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e334c-ca36-4e0e-a564-fe59b00735f1 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:23.857968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44913db6-d56d-4076-9929-ad2ed5c1bf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:23.858784 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44913db6-d56d-4076-9929-ad2ed5c1bf82 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:23.859139 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44913db6-d56d-4076-9929-ad2ed5c1bf82 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:23.859486 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44913db6-d56d-4076-9929-ad2ed5c1bf82 None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:23.860265 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44913db6-d56d-4076-9929-ad2ed5c1bf82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:23.861766 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44913db6-d56d-4076-9929-ad2ed5c1bf82 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:23.869399 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 499/1007] 10.222.0.17 () {56 vars in 1087 bytes} [Tue Jul 12 13:05:23 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:05:24.989510 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f6be0-7595-43fd-a811-3f359fba7ce4 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:24.990084 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f6be0-7595-43fd-a811-3f359fba7ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:24.990084 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f6be0-7595-43fd-a811-3f359fba7ce4 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:24.992125 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 509/1008] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:24.998065 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f38a99-6793-45fd-9fdc-7ea48084d690 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:24.998650 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f38a99-6793-45fd-9fdc-7ea48084d690 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:24.998650 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f38a99-6793-45fd-9fdc-7ea48084d690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:25.015975 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-a5f38a99-6793-45fd-9fdc-7ea48084d690 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:25.017186 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-a5f38a99-6793-45fd-9fdc-7ea48084d690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:25.035095 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:25.089239 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 500/1009] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:24 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:25.112530 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f6be0-7595-43fd-a811-3f359fba7ce4 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:25.216443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f6be0-7595-43fd-a811-3f359fba7ce4 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:25.250283 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a7581-f36b-4c11-a80d-e2a34b3d6a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:25.251009 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a7581-f36b-4c11-a80d-e2a34b3d6a7b None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:25.251298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a7581-f36b-4c11-a80d-e2a34b3d6a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:25.251579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a7581-f36b-4c11-a80d-e2a34b3d6a7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:25.252753 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a7581-f36b-4c11-a80d-e2a34b3d6a7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:25.254215 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a7581-f36b-4c11-a80d-e2a34b3d6a7b None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:25.256648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 510/1010] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:25.262454 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f38a99-6793-45fd-9fdc-7ea48084d690 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:25.361087 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f38a99-6793-45fd-9fdc-7ea48084d690 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:25.397156 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508a85f-557d-4710-9adb-ed2677264e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:25.397829 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508a85f-557d-4710-9adb-ed2677264e33 None admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:25.398139 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508a85f-557d-4710-9adb-ed2677264e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:25.398416 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508a85f-557d-4710-9adb-ed2677264e33 None admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:25.399143 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7508a85f-557d-4710-9adb-ed2677264e33 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:25.400578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7508a85f-557d-4710-9adb-ed2677264e33 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:25.428378 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 501/1011] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Jul 12 13:05:25 2022] POST /identity/v3/projects => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:05:25.876320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd1fe8-346e-49c7-b9e0-079d280d6a47 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:25.876645 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd1fe8-346e-49c7-b9e0-079d280d6a47 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:25.876888 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd1fe8-346e-49c7-b9e0-079d280d6a47 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:25.878447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 511/1012] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:25.883532 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769776a3-1f61-47d4-ab32-dd99ce133a70 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:25.883922 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769776a3-1f61-47d4-ab32-dd99ce133a70 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:25.884281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769776a3-1f61-47d4-ab32-dd99ce133a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:25.890609 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:25.903081 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-769776a3-1f61-47d4-ab32-dd99ce133a70 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:25.904933 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-769776a3-1f61-47d4-ab32-dd99ce133a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:25.924075 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2b206-2f33-45e0-b814-1016dad83904 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:25.924359 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2b206-2f33-45e0-b814-1016dad83904 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:25.924640 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2b206-2f33-45e0-b814-1016dad83904 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:25.926004 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 512/1013] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:05:25.931361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4832240-730d-4e2c-be3d-6da6f1843572 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:25.931585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4832240-730d-4e2c-be3d-6da6f1843572 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:25.931866 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4832240-730d-4e2c-be3d-6da6f1843572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:25.951105 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-a4832240-730d-4e2c-be3d-6da6f1843572 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:25.952657 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a4832240-730d-4e2c-be3d-6da6f1843572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:25.981321 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 502/1014] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:25 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:26.003788 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769776a3-1f61-47d4-ab32-dd99ce133a70 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:26.008130 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:26.026737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 513/1015] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:25 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:05:26.049939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4832240-730d-4e2c-be3d-6da6f1843572 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:26.116154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769776a3-1f61-47d4-ab32-dd99ce133a70 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:26.153590 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4832240-730d-4e2c-be3d-6da6f1843572 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:26.154127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df154bd-94d4-4594-9f49-9a4d87443f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:26.154831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df154bd-94d4-4594-9f49-9a4d87443f76 None admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:26.155121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df154bd-94d4-4594-9f49-9a4d87443f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:26.155412 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df154bd-94d4-4594-9f49-9a4d87443f76 None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:26.156132 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df154bd-94d4-4594-9f49-9a4d87443f76 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:26.157519 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df154bd-94d4-4594-9f49-9a4d87443f76 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:26.159843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:26.173340 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 503/1016] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Jul 12 13:05:26 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:05:26.199770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce67062-3905-499b-8755-224b1d9b13f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:26.200597 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce67062-3905-499b-8755-224b1d9b13f1 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:26.200881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce67062-3905-499b-8755-224b1d9b13f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:26.201157 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce67062-3905-499b-8755-224b1d9b13f1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:26.201818 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce67062-3905-499b-8755-224b1d9b13f1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:26.203358 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce67062-3905-499b-8755-224b1d9b13f1 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:26.216080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-bce67062-3905-499b-8755-224b1d9b13f1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 13:05:26.216080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:26.216080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:05:26.216080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:05:26.216080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:05:26.216080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:05:26.216080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:05:26.216080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:26.216080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 13:05:26.216080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:26.216080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:05:26.216080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:26.216080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:26.216080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:26.216080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:26.216080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:26.216080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:26.217344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:26.217344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:26.217344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:26.217344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:26.217344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:26.217344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:26.217344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:05:26.217344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:05:26.217344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:05:26.217344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:05:26.217344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:26.217344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:26.217344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:26.217344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:26.217344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:26.217344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:26.218492 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:26.218492 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:26.218492 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:26.218492 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:26.218492 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:26.218492 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:26.218492 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:26.218492 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:26.218492 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:26.218492 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:26.218492 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:05:26.218492 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:26.218492 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 13:05:26.218492 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:26.218492 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 514/1017] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:05:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:05:26.225631 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df154bd-94d4-4594-9f49-9a4d87443f76 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:26.336696 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df154bd-94d4-4594-9f49-9a4d87443f76 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:26.371916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64eb09-cffc-4008-a402-467379761228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:26.372586 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64eb09-cffc-4008-a402-467379761228 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:26.372871 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64eb09-cffc-4008-a402-467379761228 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:26.373149 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64eb09-cffc-4008-a402-467379761228 None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:26.373852 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64eb09-cffc-4008-a402-467379761228 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:26.374189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64eb09-cffc-4008-a402-467379761228 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:26.375555 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64eb09-cffc-4008-a402-467379761228 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:26.380626 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 504/1018] 10.222.0.17 () {56 vars in 1112 bytes} [Tue Jul 12 13:05:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:26.386545 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce67062-3905-499b-8755-224b1d9b13f1 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:26.434049 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:26.489261 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce67062-3905-499b-8755-224b1d9b13f1 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:26.525440 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df828a48-56ff-49b2-882a-bfb3f50cac18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:26.526142 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df828a48-56ff-49b2-882a-bfb3f50cac18 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:26.526432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df828a48-56ff-49b2-882a-bfb3f50cac18 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:26.526713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df828a48-56ff-49b2-882a-bfb3f50cac18 None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:26.527425 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df828a48-56ff-49b2-882a-bfb3f50cac18 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:26.527730 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df828a48-56ff-49b2-882a-bfb3f50cac18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:26.529095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df828a48-56ff-49b2-882a-bfb3f50cac18 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:26.534301 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 515/1019] 10.222.0.17 () {56 vars in 1112 bytes} [Tue Jul 12 13:05:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:26.539702 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64eb09-cffc-4008-a402-467379761228 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:26.601752 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:26.647563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64eb09-cffc-4008-a402-467379761228 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:26.691844 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82e0f5-2ed4-4076-8505-d585bab70d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:26.692514 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82e0f5-2ed4-4076-8505-d585bab70d0b None admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:26.692801 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82e0f5-2ed4-4076-8505-d585bab70d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:26.693078 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82e0f5-2ed4-4076-8505-d585bab70d0b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:26.694403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82e0f5-2ed4-4076-8505-d585bab70d0b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:26.695763 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82e0f5-2ed4-4076-8505-d585bab70d0b None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:26.726269 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 505/1020] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Jul 12 13:05:26 2022] POST /identity/v3/endpoints => generated 334 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:05:27.519029 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399abb9-9b7c-4446-b0eb-9db85c99069b None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:27.519553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399abb9-9b7c-4446-b0eb-9db85c99069b None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:27.519669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399abb9-9b7c-4446-b0eb-9db85c99069b None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:27.521102 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 516/1021] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:27.526525 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd749e3-31ca-4118-b6fe-b26da62d5d4a None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:27.526910 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd749e3-31ca-4118-b6fe-b26da62d5d4a None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:27.526910 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd749e3-31ca-4118-b6fe-b26da62d5d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:27.543808 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-6dd749e3-31ca-4118-b6fe-b26da62d5d4a None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:27.544993 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-6dd749e3-31ca-4118-b6fe-b26da62d5d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:27.617405 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 506/1022] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:27.642142 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399abb9-9b7c-4446-b0eb-9db85c99069b None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:27.753223 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399abb9-9b7c-4446-b0eb-9db85c99069b None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:27.762964 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:27.789999 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501f33f-b311-4b2d-b034-e3383bdc18ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:27.790758 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501f33f-b311-4b2d-b034-e3383bdc18ad None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:27.791049 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501f33f-b311-4b2d-b034-e3383bdc18ad None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:27.791328 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501f33f-b311-4b2d-b034-e3383bdc18ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:27.792495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501f33f-b311-4b2d-b034-e3383bdc18ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:27.793925 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501f33f-b311-4b2d-b034-e3383bdc18ad None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:27.803399 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 517/1023] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:27.803544 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd749e3-31ca-4118-b6fe-b26da62d5d4a None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:27.843114 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:27.909504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd749e3-31ca-4118-b6fe-b26da62d5d4a None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:27.944579 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75eef8-696a-4cdf-a675-3d85e7943647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:27.945265 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75eef8-696a-4cdf-a675-3d85e7943647 None admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:27.945551 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75eef8-696a-4cdf-a675-3d85e7943647 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:27.945828 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75eef8-696a-4cdf-a675-3d85e7943647 None admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:27.946602 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75eef8-696a-4cdf-a675-3d85e7943647 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:27.948016 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75eef8-696a-4cdf-a675-3d85e7943647 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:27.969074 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 507/1024] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Jul 12 13:05:27 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:05:28.226078 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6a020-53cf-4400-b9fa-bd89d16b6b6d None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:28.226447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6a020-53cf-4400-b9fa-bd89d16b6b6d None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:28.226663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6a020-53cf-4400-b9fa-bd89d16b6b6d None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:28.228200 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 518/1025] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:28.233419 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac783b7-ebcc-43d1-8732-4d096b7c7426 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:28.233717 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac783b7-ebcc-43d1-8732-4d096b7c7426 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:28.233997 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac783b7-ebcc-43d1-8732-4d096b7c7426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:28.251414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-4ac783b7-ebcc-43d1-8732-4d096b7c7426 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:28.252592 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-4ac783b7-ebcc-43d1-8732-4d096b7c7426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:28.319512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 508/1026] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:28.341585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6a020-53cf-4400-b9fa-bd89d16b6b6d None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:28.445088 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6a020-53cf-4400-b9fa-bd89d16b6b6d None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:28.479463 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3060e2-b266-4b3a-9598-41af1f172477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:28.480184 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3060e2-b266-4b3a-9598-41af1f172477 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:28.480471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3060e2-b266-4b3a-9598-41af1f172477 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:28.480786 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3060e2-b266-4b3a-9598-41af1f172477 None admin] PATH_INFO: `/v3/services/image` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:28.481421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3060e2-b266-4b3a-9598-41af1f172477 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:28.482809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3060e2-b266-4b3a-9598-41af1f172477 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:28.495535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-db3060e2-b266-4b3a-9598-41af1f172477 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 13:05:28.495535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:28.495535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:05:28.495535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:05:28.495535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:05:28.495535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:05:28.495535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:05:28.495535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:28.495535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 13:05:28.495535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:28.495535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:05:28.495535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:28.495535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:28.495535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:28.495535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:28.495535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:28.495535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:28.496548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:28.496548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:28.496548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:28.496548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:28.496548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:28.496548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:28.496548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:05:28.496548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:05:28.496548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:05:28.496548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:05:28.496548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:28.496548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:28.496548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:28.496548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:28.496548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:28.496548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:28.497389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:28.497389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:28.497389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:28.497389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:28.497389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:28.497389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:28.497389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:28.497389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:28.497389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:28.497389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:28.497389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:05:28.497389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:28.497389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 13:05:28.497389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:28.501491 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 519/1027] 10.222.0.17 () {56 vars in 1105 bytes} [Tue Jul 12 13:05:28 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:28.502728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac783b7-ebcc-43d1-8732-4d096b7c7426 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:28.533823 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:28.610941 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac783b7-ebcc-43d1-8732-4d096b7c7426 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:28.646067 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4790567-6de1-4194-917b-ea3f8bca1bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:28.646871 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4790567-6de1-4194-917b-ea3f8bca1bca None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:28.647153 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4790567-6de1-4194-917b-ea3f8bca1bca None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:28.647427 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4790567-6de1-4194-917b-ea3f8bca1bca None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:28.648138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4790567-6de1-4194-917b-ea3f8bca1bca None admin] RBAC: Adding query filter params (name=image) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:28.648442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4790567-6de1-4194-917b-ea3f8bca1bca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:28.649808 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4790567-6de1-4194-917b-ea3f8bca1bca None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:28.655001 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 509/1028] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:28.660444 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3060e2-b266-4b3a-9598-41af1f172477 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:28.707230 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:28.770819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3060e2-b266-4b3a-9598-41af1f172477 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:28.806444 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef090b-7332-4e9c-b86d-852395e80a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:28.807120 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef090b-7332-4e9c-b86d-852395e80a1c None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:28.807404 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef090b-7332-4e9c-b86d-852395e80a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:28.807677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef090b-7332-4e9c-b86d-852395e80a1c None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:28.808386 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef090b-7332-4e9c-b86d-852395e80a1c None admin] RBAC: Adding query filter params (type=image) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:28.808693 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef090b-7332-4e9c-b86d-852395e80a1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:28.810143 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef090b-7332-4e9c-b86d-852395e80a1c None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:28.820143 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 520/1029] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:28.821395 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4790567-6de1-4194-917b-ea3f8bca1bca None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:28.840132 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412ad97-cd92-4e96-8e8d-0cc65e04afe8 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:28.840424 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412ad97-cd92-4e96-8e8d-0cc65e04afe8 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:28.840704 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412ad97-cd92-4e96-8e8d-0cc65e04afe8 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:28.842244 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 521/1030] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:05:28.848129 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc2bc8-9caa-42b7-8664-b8f97aed8914 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:28.848638 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc2bc8-9caa-42b7-8664-b8f97aed8914 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:28.848750 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc2bc8-9caa-42b7-8664-b8f97aed8914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:28.866526 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-aefc2bc8-9caa-42b7-8664-b8f97aed8914 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:28.867429 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-aefc2bc8-9caa-42b7-8664-b8f97aed8914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:28.922318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:28.935364 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4790567-6de1-4194-917b-ea3f8bca1bca None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:28.939393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 522/1031] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:05:28.963294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc2bc8-9caa-42b7-8664-b8f97aed8914 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:28.975193 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c52455-0e1f-435d-94b0-6baeafe1e4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:28.975978 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c52455-0e1f-435d-94b0-6baeafe1e4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:28.976260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c52455-0e1f-435d-94b0-6baeafe1e4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:28.976537 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c52455-0e1f-435d-94b0-6baeafe1e4f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:28.977330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c52455-0e1f-435d-94b0-6baeafe1e4f4 None admin] RBAC: Adding query filter params (interface=public, service_id=3f33543a27334d42a03a51798015775b, region_id=RegionOne) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:28.977642 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c52455-0e1f-435d-94b0-6baeafe1e4f4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:28.979261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c52455-0e1f-435d-94b0-6baeafe1e4f4 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:28.989443 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 510/1032] 10.222.0.17 () {56 vars in 1251 bytes} [Tue Jul 12 13:05:28 2022] GET /identity/v3/endpoints?service_id=3f33543a27334d42a03a51798015775b&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:28.991344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c52455-0e1f-435d-94b0-6baeafe1e4f4 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:29.002583 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:29.077464 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc2bc8-9caa-42b7-8664-b8f97aed8914 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:29.096224 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c52455-0e1f-435d-94b0-6baeafe1e4f4 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:29.117418 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25801b44-2164-4a2d-8d0f-ec8208982ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:29.118289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25801b44-2164-4a2d-8d0f-ec8208982ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:29.118574 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25801b44-2164-4a2d-8d0f-ec8208982ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:29.118959 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25801b44-2164-4a2d-8d0f-ec8208982ae6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:29.129369 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25801b44-2164-4a2d-8d0f-ec8208982ae6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:05:29.133390 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f93357-a06f-4208-814f-5f8e68e45f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:29.134297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f93357-a06f-4208-814f-5f8e68e45f0c None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:29.134784 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f93357-a06f-4208-814f-5f8e68e45f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:29.135237 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f93357-a06f-4208-814f-5f8e68e45f0c None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:29.136348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f93357-a06f-4208-814f-5f8e68e45f0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:29.137844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-25801b44-2164-4a2d-8d0f-ec8208982ae6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 13:05:29.137844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:29.137844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:29.137844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:29.137844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:29.137844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:29.137844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:29.137844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:29.137844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:29.137844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:29.137844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:29.137844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:29.137844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:05:29.137844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:05:29.137844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:05:29.137844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:05:29.138804 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:05:29.138804 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:05:29.138804 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:05:29.138804 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:05:29.138804 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:29.138804 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:29.138804 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:29.138804 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:29.138804 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:29.138804 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:29.138804 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:29.138804 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:29.138804 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:29.138804 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:29.138804 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:29.138804 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:29.139671 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:29.139671 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:29.139671 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:29.139671 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:29.139671 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:05:29.139671 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:05:29.139671 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:05:29.139671 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:05:29.139671 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:05:29.139671 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:05:29.139671 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 13:05:29.139671 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:29.139671 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 523/1033] 10.222.0.17 () {56 vars in 1120 bytes} [Tue Jul 12 13:05:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:05:29.140574 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f93357-a06f-4208-814f-5f8e68e45f0c None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:29.144829 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25801b44-2164-4a2d-8d0f-ec8208982ae6 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:29.149076 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 511/1034] 10.222.0.17 () {56 vars in 1087 bytes} [Tue Jul 12 13:05:28 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:05:29.261619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:29.270234 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25801b44-2164-4a2d-8d0f-ec8208982ae6 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:29.308621 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4861101-d95f-4c60-afde-c6d2b5bab949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:29.309311 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4861101-d95f-4c60-afde-c6d2b5bab949 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:29.309599 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4861101-d95f-4c60-afde-c6d2b5bab949 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:29.309876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4861101-d95f-4c60-afde-c6d2b5bab949 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:29.310653 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4861101-d95f-4c60-afde-c6d2b5bab949 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:29.310967 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4861101-d95f-4c60-afde-c6d2b5bab949 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:29.312454 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4861101-d95f-4c60-afde-c6d2b5bab949 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:29.321386 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 524/1035] 10.222.0.17 () {56 vars in 1115 bytes} [Tue Jul 12 13:05:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:29.327336 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f93357-a06f-4208-814f-5f8e68e45f0c None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:29.351603 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:29.436392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f93357-a06f-4208-814f-5f8e68e45f0c None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:29.469716 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172057ab-a342-4be0-99c4-1fb486f70df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:29.470537 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172057ab-a342-4be0-99c4-1fb486f70df3 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:29.470823 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172057ab-a342-4be0-99c4-1fb486f70df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:29.471100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172057ab-a342-4be0-99c4-1fb486f70df3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:29.482037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172057ab-a342-4be0-99c4-1fb486f70df3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:29.483504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172057ab-a342-4be0-99c4-1fb486f70df3 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:29.501814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-172057ab-a342-4be0-99c4-1fb486f70df3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:29.501814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:29.501814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:29.501814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:29.501814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:29.501814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:29.501814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:29.501814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:29.501814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:29.501814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:29.501814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:29.501814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:29.501814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:05:29.501814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:05:29.501814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:05:29.503133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:05:29.503133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:29.503133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:29.503133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:29.503133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:29.503133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:29.503133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:29.503133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:29.503133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:29.503133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:29.503133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:29.503133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:29.503133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:29.503133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:29.503133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:29.503133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:29.503133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:29.509676 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:05:29.509676 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:05:29.509676 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:29.509676 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:29.509676 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 512/1036] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:05:29.511861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4861101-d95f-4c60-afde-c6d2b5bab949 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:29.615862 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4861101-d95f-4c60-afde-c6d2b5bab949 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:29.649926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf25356-3482-46d2-a3a0-32d391e2be40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:29.650626 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf25356-3482-46d2-a3a0-32d391e2be40 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:29.650911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf25356-3482-46d2-a3a0-32d391e2be40 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:29.651191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf25356-3482-46d2-a3a0-32d391e2be40 None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:29.651914 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf25356-3482-46d2-a3a0-32d391e2be40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:29.652223 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf25356-3482-46d2-a3a0-32d391e2be40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:29.653585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf25356-3482-46d2-a3a0-32d391e2be40 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:29.666742 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 525/1037] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:29.672079 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172057ab-a342-4be0-99c4-1fb486f70df3 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:29.751090 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:29.784737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172057ab-a342-4be0-99c4-1fb486f70df3 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:29.820076 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a809e-50a2-4068-a707-d8c2f29d756e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:29.820887 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a809e-50a2-4068-a707-d8c2f29d756e None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:29.821161 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a809e-50a2-4068-a707-d8c2f29d756e None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:29.821435 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a809e-50a2-4068-a707-d8c2f29d756e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:29.828724 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a809e-50a2-4068-a707-d8c2f29d756e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:29.830171 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a809e-50a2-4068-a707-d8c2f29d756e None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:29.846858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-ee3a809e-50a2-4068-a707-d8c2f29d756e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:05:29.846858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:29.846858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:29.846858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:29.846858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:29.846858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:29.846858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:29.846858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:29.846858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:29.846858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:29.846858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:29.846858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:29.846858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:05:29.846858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:05:29.846858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:05:29.846858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:05:29.848032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:29.848032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:29.848032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:05:29.848032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:05:29.848032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:05:29.848032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:05:29.848032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:29.848032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:29.848032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:29.848032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:29.848032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:29.848032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:29.848032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:29.848032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:29.848032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:29.848032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:29.848032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:29.848032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:29.850480 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:29.850480 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:29.850480 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:05:29.850480 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:05:29.850480 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:05:29.850480 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:05:29.850480 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:05:29.850480 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:05:29.850480 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:05:29.850480 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:29.854357 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf25356-3482-46d2-a3a0-32d391e2be40 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:29.854809 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 513/1038] 10.222.0.17 () {56 vars in 1093 bytes} [Tue Jul 12 13:05:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:29.874106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:29.964634 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf25356-3482-46d2-a3a0-32d391e2be40 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:30.003270 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0150d-a9d2-48d8-854d-2f651670392c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:30.003951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0150d-a9d2-48d8-854d-2f651670392c None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:30.004235 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0150d-a9d2-48d8-854d-2f651670392c None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:30.004514 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0150d-a9d2-48d8-854d-2f651670392c None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:30.005350 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0150d-a9d2-48d8-854d-2f651670392c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:30.005661 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0150d-a9d2-48d8-854d-2f651670392c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:30.007133 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0150d-a9d2-48d8-854d-2f651670392c None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:30.031458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 526/1039] 10.222.0.17 () {56 vars in 1133 bytes} [Tue Jul 12 13:05:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:30.033086 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a809e-50a2-4068-a707-d8c2f29d756e None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:30.106435 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b916932-bb97-41f3-aa6c-911a0e9a9c35 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:30.106794 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b916932-bb97-41f3-aa6c-911a0e9a9c35 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:30.107014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b916932-bb97-41f3-aa6c-911a0e9a9c35 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:30.108650 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 527/1040] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:30.113539 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772c80b-c5a0-40c7-bf4a-9aedf236a2c3 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:30.113835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772c80b-c5a0-40c7-bf4a-9aedf236a2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:30.114140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772c80b-c5a0-40c7-bf4a-9aedf236a2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:30.131519 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-d772c80b-c5a0-40c7-bf4a-9aedf236a2c3 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:30.132649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-d772c80b-c5a0-40c7-bf4a-9aedf236a2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:30.143257 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a809e-50a2-4068-a707-d8c2f29d756e None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:30.174234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:30.181819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6735b-853e-47db-9a43-6653ccc52dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:30.182510 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6735b-853e-47db-9a43-6653ccc52dec None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:30.182821 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6735b-853e-47db-9a43-6653ccc52dec None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:30.183103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6735b-853e-47db-9a43-6653ccc52dec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:30.218282 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 528/1041] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:05:30.230380 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772c80b-c5a0-40c7-bf4a-9aedf236a2c3 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:30.234948 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:30.254298 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6735b-853e-47db-9a43-6653ccc52dec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:30.256377 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6735b-853e-47db-9a43-6653ccc52dec None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:30.349071 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772c80b-c5a0-40c7-bf4a-9aedf236a2c3 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:30.365208 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 514/1042] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:05:30 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:05:30.371504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6735b-853e-47db-9a43-6653ccc52dec None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:30.389782 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde8b62-0103-499f-9148-fe689d247f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:30.390875 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde8b62-0103-499f-9148-fe689d247f51 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:30.391163 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde8b62-0103-499f-9148-fe689d247f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:30.391439 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde8b62-0103-499f-9148-fe689d247f51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:30.401479 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:30.406242 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde8b62-0103-499f-9148-fe689d247f51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:05:30.416315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-efde8b62-0103-499f-9148-fe689d247f51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:05:30.416315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:30.416315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:30.416315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:30.416315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:30.416315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:30.416315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:30.416315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:30.416315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:30.416315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:30.416315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:30.416315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:30.416315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:05:30.416315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:05:30.416315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:05:30.416315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:05:30.417333 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:05:30.417333 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:05:30.417333 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:05:30.417333 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:05:30.417333 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:30.417333 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:30.417333 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:30.417333 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:30.417333 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:30.417333 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:30.417333 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:30.417333 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:30.417333 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:30.417333 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:30.417333 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:30.417333 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:30.418985 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:30.418985 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:30.418985 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:30.418985 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:30.418985 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:05:30.418985 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:05:30.418985 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:05:30.418985 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:05:30.418985 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:05:30.418985 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:05:30.418985 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:05:30.418985 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:30.418985 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 529/1043] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:05:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:30.423481 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde8b62-0103-499f-9148-fe689d247f51 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:30.487805 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6735b-853e-47db-9a43-6653ccc52dec None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:30.492653 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:30.534662 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ca364-9e87-49b2-8a85-9088e41c3a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:30.535714 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ca364-9e87-49b2-8a85-9088e41c3a14 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:30.536206 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ca364-9e87-49b2-8a85-9088e41c3a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:30.536501 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ca364-9e87-49b2-8a85-9088e41c3a14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:30.540297 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde8b62-0103-499f-9148-fe689d247f51 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:30.548361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ca364-9e87-49b2-8a85-9088e41c3a14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:30.549808 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ca364-9e87-49b2-8a85-9088e41c3a14 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:30.574248 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-9b8ca364-9e87-49b2-8a85-9088e41c3a14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:30.574248 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:30.574248 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:30.574248 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:30.574248 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:30.574248 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:30.574248 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:30.574248 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:30.574248 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:30.574248 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:30.574248 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:30.574248 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:30.574248 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:05:30.574248 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:05:30.574248 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:05:30.575373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:05:30.575373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:30.575373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:30.575373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:30.575373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:30.575373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:30.575373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:30.575373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:30.575373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:30.575373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:30.575373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:30.575373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:30.575373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:30.575373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:30.575373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:30.575373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:30.575373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:30.576618 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:05:30.576618 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:05:30.576618 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:30.576618 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:30.576618 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 515/1044] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:05:30.581306 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ca364-9e87-49b2-8a85-9088e41c3a14 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:30.583776 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f7399-e747-45b8-b040-82a235f7d651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:30.584954 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f7399-e747-45b8-b040-82a235f7d651 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:30.585242 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f7399-e747-45b8-b040-82a235f7d651 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:30.585527 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f7399-e747-45b8-b040-82a235f7d651 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:30.586305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f7399-e747-45b8-b040-82a235f7d651 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:30.586620 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f7399-e747-45b8-b040-82a235f7d651 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:30.587997 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f7399-e747-45b8-b040-82a235f7d651 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:30.603104 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 530/1045] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:05:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:30.605006 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f7399-e747-45b8-b040-82a235f7d651 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:30.689380 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:30.710706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ca364-9e87-49b2-8a85-9088e41c3a14 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:30.728637 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f7399-e747-45b8-b040-82a235f7d651 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:30.753535 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb4d0b-d012-46da-9a25-0185bfbbda0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:30.754299 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb4d0b-d012-46da-9a25-0185bfbbda0f None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:30.754591 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb4d0b-d012-46da-9a25-0185bfbbda0f None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:30.755261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb4d0b-d012-46da-9a25-0185bfbbda0f None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:30.755730 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb4d0b-d012-46da-9a25-0185bfbbda0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:30.756486 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb4d0b-d012-46da-9a25-0185bfbbda0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:30.757809 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb4d0b-d012-46da-9a25-0185bfbbda0f None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:30.758388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:30.772110 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 516/1046] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:30.777319 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb4d0b-d012-46da-9a25-0185bfbbda0f None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:30.778946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05960a7-e275-4dad-bbc4-e50124a2abf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:30.780206 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05960a7-e275-4dad-bbc4-e50124a2abf1 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:30.780496 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05960a7-e275-4dad-bbc4-e50124a2abf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:30.780780 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05960a7-e275-4dad-bbc4-e50124a2abf1 None admin] PATH_INFO: `/v3/users/80b1370f1e9548df8ef6d1797e87b537` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:30.797716 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05960a7-e275-4dad-bbc4-e50124a2abf1 None admin] RBAC: Authorizing `identity:get_user(user_id=80b1370f1e9548df8ef6d1797e87b537)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:30.800337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05960a7-e275-4dad-bbc4-e50124a2abf1 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:30.803857 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 531/1047] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:05:30 2022] GET /identity/v3/users/80b1370f1e9548df8ef6d1797e87b537 => generated 285 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:30.809477 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05960a7-e275-4dad-bbc4-e50124a2abf1 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:30.893238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb4d0b-d012-46da-9a25-0185bfbbda0f None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:30.917300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05960a7-e275-4dad-bbc4-e50124a2abf1 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:30.930068 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba23fa-81c1-4936-99e0-0a9fff28d12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:30.930836 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba23fa-81c1-4936-99e0-0a9fff28d12f None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:30.931124 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba23fa-81c1-4936-99e0-0a9fff28d12f None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:30.931404 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba23fa-81c1-4936-99e0-0a9fff28d12f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:30.938684 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba23fa-81c1-4936-99e0-0a9fff28d12f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:30.940251 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba23fa-81c1-4936-99e0-0a9fff28d12f None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:30.953533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22ae95-717b-4b9a-a618-fdca794c61aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:30.954221 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22ae95-717b-4b9a-a618-fdca794c61aa None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:30.954512 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22ae95-717b-4b9a-a618-fdca794c61aa None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:30.954789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22ae95-717b-4b9a-a618-fdca794c61aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:30.955739 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-b9ba23fa-81c1-4936-99e0-0a9fff28d12f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:05:30.955739 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:30.955739 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:30.955739 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:30.955739 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:30.955739 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:30.955739 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:30.955739 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:30.955739 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:30.955739 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:30.955739 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:30.955739 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:30.955739 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:05:30.955739 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:05:30.955739 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:05:30.956592 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:05:30.956592 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:30.956592 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:30.956592 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:30.956592 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:30.956592 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:30.956592 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:30.956592 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:30.956592 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:30.956592 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:30.956592 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:30.956592 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:30.956592 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:30.956592 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:30.956592 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:30.956592 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:30.956592 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:30.962623 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:05:30.962623 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:05:30.962623 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:05:30.962623 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:05:30.962623 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:05:30.962623 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:05:30.962623 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:05:30.962623 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:30.962623 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 517/1048] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:05:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:05:30.962623 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba23fa-81c1-4936-99e0-0a9fff28d12f None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:30.965507 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:31.015659 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:31.033612 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22ae95-717b-4b9a-a618-fdca794c61aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:31.035230 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22ae95-717b-4b9a-a618-fdca794c61aa None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:31.068418 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba23fa-81c1-4936-99e0-0a9fff28d12f None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:31.107750 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f475f-cd5a-468a-9863-2e897cafd7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:31.108422 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f475f-cd5a-468a-9863-2e897cafd7ed None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:31.109417 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f475f-cd5a-468a-9863-2e897cafd7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:31.109417 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f475f-cd5a-468a-9863-2e897cafd7ed None admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:31.109765 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f475f-cd5a-468a-9863-2e897cafd7ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:31.110081 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f475f-cd5a-468a-9863-2e897cafd7ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:31.111540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f475f-cd5a-468a-9863-2e897cafd7ed None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:31.124128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 518/1049] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:05:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:31.130075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f475f-cd5a-468a-9863-2e897cafd7ed None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:31.149518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 532/1050] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:05:30 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 13:05:31.150607 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22ae95-717b-4b9a-a618-fdca794c61aa None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:31.196952 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:31.237184 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:31.238936 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f475f-cd5a-468a-9863-2e897cafd7ed None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:31.253582 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22ae95-717b-4b9a-a618-fdca794c61aa None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:31.271126 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5bbc1e-9e6d-49b0-83e9-7c1113badaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:31.272289 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bbc1e-9e6d-49b0-83e9-7c1113badaee None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:31.272568 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bbc1e-9e6d-49b0-83e9-7c1113badaee None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:31.272841 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bbc1e-9e6d-49b0-83e9-7c1113badaee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:31.273658 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5bbc1e-9e6d-49b0-83e9-7c1113badaee None admin] RBAC: Adding query filter params (role.id=ce2d01c208f54cb38480ddb8127babc8, scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2, user.id=e52dfce1b06346bfbde6ee33e7f6f249) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:31.273969 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5bbc1e-9e6d-49b0-83e9-7c1113badaee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:31.275422 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5bbc1e-9e6d-49b0-83e9-7c1113badaee None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:31.280706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 519/1051] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:05:31 2022] GET /identity/v3/role_assignments?user.id=e52dfce1b06346bfbde6ee33e7f6f249&scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2&role.id=ce2d01c208f54cb38480ddb8127babc8 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:31.281954 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e0ab3-ae5d-4286-ad9e-36361280397b None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:31.282271 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e0ab3-ae5d-4286-ad9e-36361280397b None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:31.282550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e0ab3-ae5d-4286-ad9e-36361280397b None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:31.283781 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 520/1052] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:31.290000 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af10ec9-69de-444e-b583-bb615943ba6f None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:31.290308 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af10ec9-69de-444e-b583-bb615943ba6f None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:31.290590 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af10ec9-69de-444e-b583-bb615943ba6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:31.297438 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ce282-a2d6-4b65-880e-7d1ad7128376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:31.298696 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ce282-a2d6-4b65-880e-7d1ad7128376 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:31.299180 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ce282-a2d6-4b65-880e-7d1ad7128376 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:31.299641 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ce282-a2d6-4b65-880e-7d1ad7128376 None admin] PATH_INFO: `/v3/projects/703747b712be4ca9bb5da88738f7945b` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:31.301174 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ce282-a2d6-4b65-880e-7d1ad7128376 None admin] RBAC: Authorizing `identity:get_project(project_id=703747b712be4ca9bb5da88738f7945b)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:31.302915 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ce282-a2d6-4b65-880e-7d1ad7128376 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:31.305179 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 533/1053] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:05:31 2022] GET /identity/v3/projects/703747b712be4ca9bb5da88738f7945b => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:31.308762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-8af10ec9-69de-444e-b583-bb615943ba6f None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:31.310318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-8af10ec9-69de-444e-b583-bb615943ba6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:31.311003 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ce282-a2d6-4b65-880e-7d1ad7128376 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:31.385362 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 521/1054] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:05:31.409095 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af10ec9-69de-444e-b583-bb615943ba6f None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:31.427244 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ce282-a2d6-4b65-880e-7d1ad7128376 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:31.464298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a568d-2d0b-4a6c-a923-3f2ef83669e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:31.464881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a568d-2d0b-4a6c-a923-3f2ef83669e6 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:31.465171 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a568d-2d0b-4a6c-a923-3f2ef83669e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:31.465455 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a568d-2d0b-4a6c-a923-3f2ef83669e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:31.466338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a568d-2d0b-4a6c-a923-3f2ef83669e6 None admin] RBAC: Adding query filter params (role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0, scope.project.id=703747b712be4ca9bb5da88738f7945b, user.id=80b1370f1e9548df8ef6d1797e87b537) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:31.466656 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a568d-2d0b-4a6c-a923-3f2ef83669e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:31.468137 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a568d-2d0b-4a6c-a923-3f2ef83669e6 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:31.470667 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:31.478158 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 534/1055] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:05:31 2022] GET /identity/v3/role_assignments?user.id=80b1370f1e9548df8ef6d1797e87b537&scope.project.id=703747b712be4ca9bb5da88738f7945b&role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:31.525655 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af10ec9-69de-444e-b583-bb615943ba6f None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:31.564351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e5f9c-0441-450e-8498-e421df1358c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:31.565175 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e5f9c-0441-450e-8498-e421df1358c4 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:31.565464 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e5f9c-0441-450e-8498-e421df1358c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:31.565746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e5f9c-0441-450e-8498-e421df1358c4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:31.566442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e5f9c-0441-450e-8498-e421df1358c4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:31.567870 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e5f9c-0441-450e-8498-e421df1358c4 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:31.580511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-ed5e5f9c-0441-450e-8498-e421df1358c4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 13:05:31.580511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:31.580511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:05:31.580511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:05:31.580511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:05:31.580511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:05:31.580511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:05:31.580511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:31.580511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 13:05:31.580511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:31.580511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:05:31.580511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:31.580511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:31.580511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:31.580511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:31.580511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:31.580511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:31.581601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:31.581601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:31.581601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:31.581601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:31.581601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:31.581601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:31.581601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:05:31.581601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:05:31.581601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:05:31.581601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:05:31.581601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:31.581601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:31.581601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:31.581601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:31.581601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:31.581601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:31.582940 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:31.582940 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:31.582940 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:31.582940 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:31.582940 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:31.582940 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:31.582940 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:31.582940 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:31.582940 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:31.582940 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:31.582940 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:05:31.582940 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:05:31.582940 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 13:05:31.582940 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:31.582940 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 522/1056] 10.222.0.17 () {56 vars in 1105 bytes} [Tue Jul 12 13:05:31 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:05:31.591298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a568d-2d0b-4a6c-a923-3f2ef83669e6 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:31.611480 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:31.705814 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a568d-2d0b-4a6c-a923-3f2ef83669e6 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:31.740949 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fdd83-8f7a-48cc-9c7f-cf2b5e943bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:31.742461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fdd83-8f7a-48cc-9c7f-cf2b5e943bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:31.742950 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fdd83-8f7a-48cc-9c7f-cf2b5e943bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:31.743436 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fdd83-8f7a-48cc-9c7f-cf2b5e943bd5 None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:31.744330 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fdd83-8f7a-48cc-9c7f-cf2b5e943bd5 None admin] RBAC: Adding query filter params (name=image) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:31.744836 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fdd83-8f7a-48cc-9c7f-cf2b5e943bd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:31.746456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fdd83-8f7a-48cc-9c7f-cf2b5e943bd5 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:31.751589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 535/1057] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:31.757732 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e5f9c-0441-450e-8498-e421df1358c4 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:31.857647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e5f9c-0441-450e-8498-e421df1358c4 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:31.876917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:31.892860 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfb797-3757-451f-90aa-0055fa9a21ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:31.893535 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfb797-3757-451f-90aa-0055fa9a21ff None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:31.893843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfb797-3757-451f-90aa-0055fa9a21ff None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:31.894148 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfb797-3757-451f-90aa-0055fa9a21ff None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:31.894862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfb797-3757-451f-90aa-0055fa9a21ff None admin] RBAC: Adding query filter params (type=image) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:31.895174 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfb797-3757-451f-90aa-0055fa9a21ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:31.897083 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfb797-3757-451f-90aa-0055fa9a21ff None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:31.902331 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 523/1058] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:31.907917 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fdd83-8f7a-48cc-9c7f-cf2b5e943bd5 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:31.998336 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:32.020521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fdd83-8f7a-48cc-9c7f-cf2b5e943bd5 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:32.054663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d4a61-06d7-460c-82dd-1081fb8692e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:32.055333 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d4a61-06d7-460c-82dd-1081fb8692e9 None admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:32.055620 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d4a61-06d7-460c-82dd-1081fb8692e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:32.055896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d4a61-06d7-460c-82dd-1081fb8692e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:32.056644 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d4a61-06d7-460c-82dd-1081fb8692e9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:32.058086 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d4a61-06d7-460c-82dd-1081fb8692e9 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:32.082154 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 536/1059] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Jul 12 13:05:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:05:33.286645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b45a98-0fbb-4207-984b-1bdb1eb2b598 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:33.287679 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b45a98-0fbb-4207-984b-1bdb1eb2b598 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:33.287792 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b45a98-0fbb-4207-984b-1bdb1eb2b598 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:33.289269 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 524/1060] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:33.294182 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3989d-5422-4356-b7a5-437674744c2d None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:33.294573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3989d-5422-4356-b7a5-437674744c2d None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:33.294743 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3989d-5422-4356-b7a5-437674744c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:33.312004 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-8ca3989d-5422-4356-b7a5-437674744c2d None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:33.313181 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-8ca3989d-5422-4356-b7a5-437674744c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:33.386253 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 537/1061] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:33.408110 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b45a98-0fbb-4207-984b-1bdb1eb2b598 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:33.512977 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b45a98-0fbb-4207-984b-1bdb1eb2b598 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:33.545871 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b161e-c5db-4795-ac73-476e53f4dfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:33.546634 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b161e-c5db-4795-ac73-476e53f4dfac None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:33.546921 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b161e-c5db-4795-ac73-476e53f4dfac None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:33.547199 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b161e-c5db-4795-ac73-476e53f4dfac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:33.548193 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb52acb-6ef7-42f2-bc1e-6852534c72ec None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:33.548497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb52acb-6ef7-42f2-bc1e-6852534c72ec None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:33.548787 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb52acb-6ef7-42f2-bc1e-6852534c72ec None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:33.550188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 538/1062] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:05:33.555587 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f1441-5ed1-4b8d-9f74-263307dbe1ab None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:33.555884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f1441-5ed1-4b8d-9f74-263307dbe1ab None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:33.556171 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f1441-5ed1-4b8d-9f74-263307dbe1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:33.558937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b161e-c5db-4795-ac73-476e53f4dfac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:05:33.567414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-d64b161e-c5db-4795-ac73-476e53f4dfac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 13:05:33.567414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:33.567414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:33.567414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:33.567414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:33.567414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:33.567414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:33.567414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:33.567414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:33.567414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:33.567414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:33.567414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:33.567414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:05:33.567414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:05:33.567414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:05:33.567414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:05:33.568937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:05:33.568937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:05:33.568937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:05:33.568937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:05:33.568937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:33.568937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:33.568937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:33.568937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:33.568937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:33.568937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:33.568937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:33.568937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:33.568937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:33.568937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:33.568937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:33.568937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:33.569789 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:33.569789 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:33.569789 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:33.569789 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:33.569789 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:05:33.569789 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:05:33.569789 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:05:33.569789 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:05:33.569789 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:05:33.569789 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:05:33.569789 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 13:05:33.569789 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:33.571938 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 525/1063] 10.222.0.17 () {56 vars in 1120 bytes} [Tue Jul 12 13:05:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:33.576871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-ef0f1441-5ed1-4b8d-9f74-263307dbe1ab None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:33.576871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-ef0f1441-5ed1-4b8d-9f74-263307dbe1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:33.577923 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b161e-c5db-4795-ac73-476e53f4dfac None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:33.626132 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:33.633569 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:33.645585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 539/1064] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:05:33.667752 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f1441-5ed1-4b8d-9f74-263307dbe1ab None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:33.692102 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b161e-c5db-4795-ac73-476e53f4dfac None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:33.728126 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb9e6d-557a-4c52-8e3b-ea5696ee6177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:33.728669 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb9e6d-557a-4c52-8e3b-ea5696ee6177 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:33.728961 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb9e6d-557a-4c52-8e3b-ea5696ee6177 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:33.729256 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb9e6d-557a-4c52-8e3b-ea5696ee6177 None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:33.729994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb9e6d-557a-4c52-8e3b-ea5696ee6177 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:33.730353 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb9e6d-557a-4c52-8e3b-ea5696ee6177 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:33.731740 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb9e6d-557a-4c52-8e3b-ea5696ee6177 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:33.741887 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 526/1065] 10.222.0.17 () {56 vars in 1115 bytes} [Tue Jul 12 13:05:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:33.747379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb9e6d-557a-4c52-8e3b-ea5696ee6177 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:33.790338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f1441-5ed1-4b8d-9f74-263307dbe1ab None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:33.825940 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545c0e1-fe97-4449-bf60-89c81c0f5c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:33.826696 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545c0e1-fe97-4449-bf60-89c81c0f5c43 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:33.826982 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545c0e1-fe97-4449-bf60-89c81c0f5c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:33.827262 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545c0e1-fe97-4449-bf60-89c81c0f5c43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:33.839251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545c0e1-fe97-4449-bf60-89c81c0f5c43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:05:33.847054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-4545c0e1-fe97-4449-bf60-89c81c0f5c43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:05:33.847054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:33.847054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:33.847054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:33.847054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:33.847054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:33.847054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:33.847054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:33.847054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:33.847054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:33.847054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:33.847054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:33.847054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:05:33.847054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:05:33.847054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:05:33.847054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:05:33.848055 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:05:33.848055 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:05:33.848055 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:05:33.848055 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:05:33.848055 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:33.848055 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:33.848055 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:33.848055 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:33.848055 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:33.848055 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:33.848055 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:33.848055 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:33.848055 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:33.848055 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:33.848055 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:33.848055 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:33.848909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:33.848909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:33.848909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:33.848909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:33.848909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:05:33.848909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:05:33.848909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:05:33.848909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:05:33.848909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:05:33.848909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:05:33.848909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:05:33.848909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:33.848909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 540/1066] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:05:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:05:33.854860 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545c0e1-fe97-4449-bf60-89c81c0f5c43 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:33.860141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb9e6d-557a-4c52-8e3b-ea5696ee6177 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:33.869802 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:33.902131 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3e903-489f-4f1f-888b-c0230b2b5491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:33.902957 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3e903-489f-4f1f-888b-c0230b2b5491 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:33.903253 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3e903-489f-4f1f-888b-c0230b2b5491 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:33.903536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3e903-489f-4f1f-888b-c0230b2b5491 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:33.914880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3e903-489f-4f1f-888b-c0230b2b5491 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:33.915933 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:33.916349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3e903-489f-4f1f-888b-c0230b2b5491 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:33.936379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-2cb3e903-489f-4f1f-888b-c0230b2b5491 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:33.936379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:33.936379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:33.936379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:33.936379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:33.936379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:33.936379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:33.936379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:33.936379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:33.936379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:33.936379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:33.936379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:33.936379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:05:33.936379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:05:33.936379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:05:33.937372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:05:33.937372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:33.937372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:33.937372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:33.937372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:33.937372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:33.937372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:33.937372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:33.937372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:33.937372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:33.937372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:33.937372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:33.937372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:33.937372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:33.937372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:33.937372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:33.937372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:33.938331 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:05:33.938331 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:05:33.938331 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:33.938331 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:33.942278 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 527/1067] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:05:33.944037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3e903-489f-4f1f-888b-c0230b2b5491 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:33.973129 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545c0e1-fe97-4449-bf60-89c81c0f5c43 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:34.012760 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5cdb7-798e-484f-b345-422d50baf786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:34.013452 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5cdb7-798e-484f-b345-422d50baf786 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:34.013748 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5cdb7-798e-484f-b345-422d50baf786 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:34.014030 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5cdb7-798e-484f-b345-422d50baf786 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:34.014844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5cdb7-798e-484f-b345-422d50baf786 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:34.015163 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5cdb7-798e-484f-b345-422d50baf786 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:34.016552 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5cdb7-798e-484f-b345-422d50baf786 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:34.026658 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 541/1068] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:05:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:34.032309 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5cdb7-798e-484f-b345-422d50baf786 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:34.073768 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3e903-489f-4f1f-888b-c0230b2b5491 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:34.112141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f8aee-85bf-4de8-92d6-13092594fa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:34.112736 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f8aee-85bf-4de8-92d6-13092594fa4e None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:34.113020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f8aee-85bf-4de8-92d6-13092594fa4e None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:34.113304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f8aee-85bf-4de8-92d6-13092594fa4e None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:34.114037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f8aee-85bf-4de8-92d6-13092594fa4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:34.114381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f8aee-85bf-4de8-92d6-13092594fa4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:34.116510 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f8aee-85bf-4de8-92d6-13092594fa4e None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:34.129193 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 528/1069] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:34.134822 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f8aee-85bf-4de8-92d6-13092594fa4e None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:34.141123 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5cdb7-798e-484f-b345-422d50baf786 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:34.153887 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:34.156022 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:34.177003 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4036d9-95ab-474c-9b7a-1745c9c2c932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:34.178477 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4036d9-95ab-474c-9b7a-1745c9c2c932 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:34.178765 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4036d9-95ab-474c-9b7a-1745c9c2c932 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:34.179048 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4036d9-95ab-474c-9b7a-1745c9c2c932 None admin] PATH_INFO: `/v3/users/80b1370f1e9548df8ef6d1797e87b537` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:34.180261 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4036d9-95ab-474c-9b7a-1745c9c2c932 None admin] RBAC: Authorizing `identity:get_user(user_id=80b1370f1e9548df8ef6d1797e87b537)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:34.181703 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4036d9-95ab-474c-9b7a-1745c9c2c932 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:34.183384 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 542/1070] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:05:34 2022] GET /identity/v3/users/80b1370f1e9548df8ef6d1797e87b537 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:34.184562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ceca77-bd97-4eed-84e7-9696cd3b1b66 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:34.184896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ceca77-bd97-4eed-84e7-9696cd3b1b66 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:34.185186 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ceca77-bd97-4eed-84e7-9696cd3b1b66 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:34.186439 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 543/1071] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:34.191006 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ceca77-bd97-4eed-84e7-9696cd3b1b66 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:34.236150 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f8aee-85bf-4de8-92d6-13092594fa4e None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:34.269103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae539cf-6a9d-450a-a574-10525767ac64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:34.269899 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae539cf-6a9d-450a-a574-10525767ac64 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:34.270215 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae539cf-6a9d-450a-a574-10525767ac64 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:34.270501 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae539cf-6a9d-450a-a574-10525767ac64 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:34.278360 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae539cf-6a9d-450a-a574-10525767ac64 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:34.279791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae539cf-6a9d-450a-a574-10525767ac64 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:34.292153 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ceca77-bd97-4eed-84e7-9696cd3b1b66 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:34.294097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-aae539cf-6a9d-450a-a574-10525767ac64 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:05:34.294097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:34.294097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:34.294097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:34.294097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:34.294097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:34.294097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:34.294097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:34.294097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:34.294097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:34.294097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:34.294097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:34.294097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:05:34.294097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:05:34.294097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:05:34.294097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:05:34.295504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:34.295504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:34.295504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:05:34.295504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:05:34.295504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:05:34.295504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:05:34.295504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:34.295504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:34.295504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:34.295504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:34.295504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:34.295504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:34.295504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:34.295504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:34.295504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:34.295504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:34.295504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:34.295504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:34.296445 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:34.296445 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:34.296445 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:05:34.296445 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:05:34.296445 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:05:34.296445 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:05:34.296445 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:05:34.296445 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:05:34.296445 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:05:34.296445 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:34.300154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 529/1072] 10.222.0.17 () {56 vars in 1093 bytes} [Tue Jul 12 13:05:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:05:34.301324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258ec18-499c-461f-a33f-8e6125214b4d None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:34.301631 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258ec18-499c-461f-a33f-8e6125214b4d None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:34.301914 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258ec18-499c-461f-a33f-8e6125214b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:34.317754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-4258ec18-499c-461f-a33f-8e6125214b4d None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:34.318988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-4258ec18-499c-461f-a33f-8e6125214b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:34.325641 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81d932-71f7-4768-95ef-70cb374800d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:34.326594 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81d932-71f7-4768-95ef-70cb374800d9 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:34.326840 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81d932-71f7-4768-95ef-70cb374800d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:34.327139 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81d932-71f7-4768-95ef-70cb374800d9 None admin] PATH_INFO: `/v3/projects/703747b712be4ca9bb5da88738f7945b` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:34.328297 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81d932-71f7-4768-95ef-70cb374800d9 None admin] RBAC: Authorizing `identity:get_project(project_id=703747b712be4ca9bb5da88738f7945b)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:34.329730 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81d932-71f7-4768-95ef-70cb374800d9 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:34.331460 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 544/1073] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:05:34 2022] GET /identity/v3/projects/703747b712be4ca9bb5da88738f7945b => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:34.332215 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81d932-71f7-4768-95ef-70cb374800d9 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:34.383562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:34.388092 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 530/1074] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:34.389116 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258ec18-499c-461f-a33f-8e6125214b4d None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:34.401157 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:34.436743 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81d932-71f7-4768-95ef-70cb374800d9 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:34.471473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027af79-9c30-4c57-9850-38fa251d0c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:34.472151 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027af79-9c30-4c57-9850-38fa251d0c4b None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:34.472446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027af79-9c30-4c57-9850-38fa251d0c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:34.472724 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027af79-9c30-4c57-9850-38fa251d0c4b None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:34.473585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027af79-9c30-4c57-9850-38fa251d0c4b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:34.473906 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027af79-9c30-4c57-9850-38fa251d0c4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:34.475924 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027af79-9c30-4c57-9850-38fa251d0c4b None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:34.497604 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 545/1075] 10.222.0.17 () {56 vars in 1133 bytes} [Tue Jul 12 13:05:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:34.497604 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027af79-9c30-4c57-9850-38fa251d0c4b None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:34.501585 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258ec18-499c-461f-a33f-8e6125214b4d None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:34.535852 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9a202-b6af-4b9d-a8e3-05ba9f5597a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:34.536747 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9a202-b6af-4b9d-a8e3-05ba9f5597a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:34.537683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9a202-b6af-4b9d-a8e3-05ba9f5597a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:34.537964 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9a202-b6af-4b9d-a8e3-05ba9f5597a2 None admin] PATH_INFO: `/v3/projects/703747b712be4ca9bb5da88738f7945b/users/80b1370f1e9548df8ef6d1797e87b537/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:34.539974 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9a202-b6af-4b9d-a8e3-05ba9f5597a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=703747b712be4ca9bb5da88738f7945b, user_id=80b1370f1e9548df8ef6d1797e87b537, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:34.541397 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9a202-b6af-4b9d-a8e3-05ba9f5597a2 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:34.554187 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 531/1076] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Jul 12 13:05:34 2022] PUT /identity/v3/projects/703747b712be4ca9bb5da88738f7945b/users/80b1370f1e9548df8ef6d1797e87b537/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:05:34.554973 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9a202-b6af-4b9d-a8e3-05ba9f5597a2 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:34.600311 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027af79-9c30-4c57-9850-38fa251d0c4b None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:34.611668 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:34.641862 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efb110-ca48-4442-af07-ccf0d7b82a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:34.642500 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efb110-ca48-4442-af07-ccf0d7b82a82 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:34.642782 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efb110-ca48-4442-af07-ccf0d7b82a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:34.643082 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efb110-ca48-4442-af07-ccf0d7b82a82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:34.656604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:34.703782 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9a202-b6af-4b9d-a8e3-05ba9f5597a2 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:34.728130 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efb110-ca48-4442-af07-ccf0d7b82a82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:34.729618 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efb110-ca48-4442-af07-ccf0d7b82a82 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:34.750063 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e1a56-7c54-422e-904d-d58ab926b557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:34.750953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e1a56-7c54-422e-904d-d58ab926b557 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:34.751242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e1a56-7c54-422e-904d-d58ab926b557 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:34.751523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e1a56-7c54-422e-904d-d58ab926b557 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:34.763814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e1a56-7c54-422e-904d-d58ab926b557 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:34.765422 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e1a56-7c54-422e-904d-d58ab926b557 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:34.782686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-740e1a56-7c54-422e-904d-d58ab926b557 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:34.782686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:34.782686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:34.782686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:34.782686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:34.782686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:34.782686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:34.782686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:34.782686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:34.782686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:34.782686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:34.782686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:34.782686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:05:34.782686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:05:34.782686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:05:34.783628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:05:34.783628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:34.783628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:34.783628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:34.783628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:34.783628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:34.783628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:34.783628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:34.783628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:34.783628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:34.783628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:34.783628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:34.783628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:34.783628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:34.783628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:34.783628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:34.783628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:34.784523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:05:34.784523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:05:34.784523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:34.784523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:34.784523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 532/1077] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:34.790366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e1a56-7c54-422e-904d-d58ab926b557 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:34.843784 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 546/1078] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:05:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:05:34.850558 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efb110-ca48-4442-af07-ccf0d7b82a82 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:34.861840 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:34.919264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e1a56-7c54-422e-904d-d58ab926b557 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:34.943757 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:34.955445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efb110-ca48-4442-af07-ccf0d7b82a82 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:34.961875 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5ba40-79df-4e88-a9dd-b713b5c5d76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:34.962578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5ba40-79df-4e88-a9dd-b713b5c5d76b None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:34.962861 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5ba40-79df-4e88-a9dd-b713b5c5d76b None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:34.963138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5ba40-79df-4e88-a9dd-b713b5c5d76b None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:34.963857 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5ba40-79df-4e88-a9dd-b713b5c5d76b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:34.964160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5ba40-79df-4e88-a9dd-b713b5c5d76b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:34.965523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5ba40-79df-4e88-a9dd-b713b5c5d76b None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:34.978534 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 533/1079] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:34.983801 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5ba40-79df-4e88-a9dd-b713b5c5d76b None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:34.997052 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e660d2-7fc0-4ca2-b8ea-37eb34a7cd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:35.003786 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e660d2-7fc0-4ca2-b8ea-37eb34a7cd2b None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:35.003786 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e660d2-7fc0-4ca2-b8ea-37eb34a7cd2b None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:35.003786 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e660d2-7fc0-4ca2-b8ea-37eb34a7cd2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:35.020260 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e660d2-7fc0-4ca2-b8ea-37eb34a7cd2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:35.022850 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e660d2-7fc0-4ca2-b8ea-37eb34a7cd2b None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:35.043094 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-e5e660d2-7fc0-4ca2-b8ea-37eb34a7cd2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:35.043094 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:35.043094 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:35.043094 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:35.043094 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:35.043094 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:35.043094 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:35.043094 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:35.043094 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:35.043094 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:35.043094 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:35.043094 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:35.043094 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:05:35.043094 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:05:35.043094 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:05:35.044231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:05:35.044231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:35.044231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:35.044231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:35.044231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:35.044231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:35.044231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:35.044231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:35.044231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:35.044231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:35.044231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:35.044231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:35.044231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:35.044231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:35.044231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:35.044231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:35.044231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:35.045349 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:05:35.045349 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:05:35.045349 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:35.045349 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:35.049085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 547/1080] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:35.049926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e660d2-7fc0-4ca2-b8ea-37eb34a7cd2b None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:35.111414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5ba40-79df-4e88-a9dd-b713b5c5d76b None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:35.119912 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:35.145707 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b9b1e-3a3d-450f-a5dc-0fcd941210c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:35.147025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b9b1e-3a3d-450f-a5dc-0fcd941210c2 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:35.147301 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b9b1e-3a3d-450f-a5dc-0fcd941210c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:35.147622 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b9b1e-3a3d-450f-a5dc-0fcd941210c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:35.154378 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b9b1e-3a3d-450f-a5dc-0fcd941210c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:35.155814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b9b1e-3a3d-450f-a5dc-0fcd941210c2 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:35.165640 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e660d2-7fc0-4ca2-b8ea-37eb34a7cd2b None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:35.170619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-001b9b1e-3a3d-450f-a5dc-0fcd941210c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:05:35.170619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:35.170619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:35.170619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:35.170619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:35.170619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:35.170619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:35.170619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:35.170619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:35.170619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:35.170619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:35.170619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:35.170619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:05:35.170619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:05:35.170619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:05:35.171683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:05:35.171683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:35.171683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:35.171683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:35.171683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:35.171683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:35.171683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:35.171683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:35.171683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:35.171683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:35.171683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:35.171683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:35.171683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:35.171683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:35.171683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:35.171683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:35.171683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:35.172820 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:05:35.172820 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:05:35.172820 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:05:35.172820 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:05:35.172820 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:05:35.172820 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:05:35.172820 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:05:35.172820 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:35.176474 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 534/1081] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:05:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:35.177332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b9b1e-3a3d-450f-a5dc-0fcd941210c2 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:35.211486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27130e0a-74a1-4df4-9215-2cb2e2b84a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:35.212213 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27130e0a-74a1-4df4-9215-2cb2e2b84a12 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:35.212538 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27130e0a-74a1-4df4-9215-2cb2e2b84a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:35.212827 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27130e0a-74a1-4df4-9215-2cb2e2b84a12 None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:35.213598 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27130e0a-74a1-4df4-9215-2cb2e2b84a12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:35.213935 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27130e0a-74a1-4df4-9215-2cb2e2b84a12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:35.215596 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27130e0a-74a1-4df4-9215-2cb2e2b84a12 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:35.226345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:35.242152 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 548/1082] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:35.297757 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b9b1e-3a3d-450f-a5dc-0fcd941210c2 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:35.337673 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb7514-e517-4a8f-8309-029cbf15bb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:35.338441 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb7514-e517-4a8f-8309-029cbf15bb6a None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:35.338757 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb7514-e517-4a8f-8309-029cbf15bb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:35.339051 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb7514-e517-4a8f-8309-029cbf15bb6a None admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:35.339899 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb7514-e517-4a8f-8309-029cbf15bb6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:35.340236 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb7514-e517-4a8f-8309-029cbf15bb6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:35.341796 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb7514-e517-4a8f-8309-029cbf15bb6a None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:35.363872 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 535/1083] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:05:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:35.366200 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27130e0a-74a1-4df4-9215-2cb2e2b84a12 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:35.490668 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27130e0a-74a1-4df4-9215-2cb2e2b84a12 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:35.512192 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:35.528456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2713bc-a666-4460-b262-977808234a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:35.529369 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2713bc-a666-4460-b262-977808234a90 None admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:35.529660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2713bc-a666-4460-b262-977808234a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:35.529949 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2713bc-a666-4460-b262-977808234a90 None admin] PATH_INFO: `/v3/projects/cd70432d4e5a4e25a4a6def32ffc6ee2/users/e52dfce1b06346bfbde6ee33e7f6f249/roles/ce2d01c208f54cb38480ddb8127babc8` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:35.532226 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2713bc-a666-4460-b262-977808234a90 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd70432d4e5a4e25a4a6def32ffc6ee2, user_id=e52dfce1b06346bfbde6ee33e7f6f249, role_id=ce2d01c208f54cb38480ddb8127babc8)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:35.533669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2713bc-a666-4460-b262-977808234a90 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:35.547425 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 549/1084] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Jul 12 13:05:35 2022] PUT /identity/v3/projects/cd70432d4e5a4e25a4a6def32ffc6ee2/users/e52dfce1b06346bfbde6ee33e7f6f249/roles/ce2d01c208f54cb38480ddb8127babc8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:05:36.587251 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea7b01-d9f8-45f5-9d7c-d31eea684d99 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:36.587786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea7b01-d9f8-45f5-9d7c-d31eea684d99 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:36.587877 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea7b01-d9f8-45f5-9d7c-d31eea684d99 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:36.589253 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 536/1085] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:36.594553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec1cea-24b7-43c2-bdba-63a8b45b177d None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:36.594965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec1cea-24b7-43c2-bdba-63a8b45b177d None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:36.595240 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec1cea-24b7-43c2-bdba-63a8b45b177d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:36.612233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-4eec1cea-24b7-43c2-bdba-63a8b45b177d None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:36.613405 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-4eec1cea-24b7-43c2-bdba-63a8b45b177d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:36.685487 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 550/1086] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:36.708178 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea7b01-d9f8-45f5-9d7c-d31eea684d99 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:36.805744 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:36.810032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea7b01-d9f8-45f5-9d7c-d31eea684d99 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:36.843745 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdd11a-bf6e-4994-9998-96cd63869f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:36.844467 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdd11a-bf6e-4994-9998-96cd63869f3b None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:36.844753 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdd11a-bf6e-4994-9998-96cd63869f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:36.845031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdd11a-bf6e-4994-9998-96cd63869f3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:36.855565 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdd11a-bf6e-4994-9998-96cd63869f3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:05:36.863211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-b2bdd11a-bf6e-4994-9998-96cd63869f3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:05:36.863211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:36.863211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:36.863211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:36.863211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:36.863211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:36.863211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:36.863211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:36.863211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:36.863211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:36.863211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:36.863211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:36.863211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:05:36.863211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:05:36.863211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:05:36.863211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:05:36.864285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:05:36.864285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:05:36.864285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:05:36.864285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:05:36.864285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:36.864285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:36.864285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:36.864285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:36.864285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:36.864285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:36.864285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:36.864285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:36.864285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:36.864285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:36.864285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:36.864285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:36.865214 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:36.865214 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:36.865214 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:36.865214 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:36.865214 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:05:36.865214 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:05:36.865214 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:05:36.865214 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:05:36.865214 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:05:36.865214 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:05:36.865214 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:05:36.865214 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:36.865214 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 537/1087] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:05:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:36.870330 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec1cea-24b7-43c2-bdba-63a8b45b177d None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:36.965768 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec1cea-24b7-43c2-bdba-63a8b45b177d None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:36.976002 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:37.000023 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af7ca1-231f-4610-84a1-1eb8e8844436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:37.000699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af7ca1-231f-4610-84a1-1eb8e8844436 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:37.000986 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af7ca1-231f-4610-84a1-1eb8e8844436 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:37.001265 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af7ca1-231f-4610-84a1-1eb8e8844436 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:37.002012 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af7ca1-231f-4610-84a1-1eb8e8844436 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:37.002353 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af7ca1-231f-4610-84a1-1eb8e8844436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:37.003719 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af7ca1-231f-4610-84a1-1eb8e8844436 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:37.012542 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 551/1088] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:05:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:37.018128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdd11a-bf6e-4994-9998-96cd63869f3b None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:37.116927 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdd11a-bf6e-4994-9998-96cd63869f3b None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:37.151255 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37249bcb-8f99-4768-a7aa-58fb0a4f5d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:37.152158 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37249bcb-8f99-4768-a7aa-58fb0a4f5d59 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:37.152488 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37249bcb-8f99-4768-a7aa-58fb0a4f5d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:37.152689 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37249bcb-8f99-4768-a7aa-58fb0a4f5d59 None admin] PATH_INFO: `/v3/users/80b1370f1e9548df8ef6d1797e87b537` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:37.153874 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37249bcb-8f99-4768-a7aa-58fb0a4f5d59 None admin] RBAC: Authorizing `identity:get_user(user_id=80b1370f1e9548df8ef6d1797e87b537)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:37.155413 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37249bcb-8f99-4768-a7aa-58fb0a4f5d59 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:37.157057 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 538/1089] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:05:37 2022] GET /identity/v3/users/80b1370f1e9548df8ef6d1797e87b537 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:37.163242 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af7ca1-231f-4610-84a1-1eb8e8844436 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:37.260104 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af7ca1-231f-4610-84a1-1eb8e8844436 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:37.292310 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbd3b4-c738-4653-a76b-6fdffb6a6a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:37.292965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbd3b4-c738-4653-a76b-6fdffb6a6a4a None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:37.293250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbd3b4-c738-4653-a76b-6fdffb6a6a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:37.293529 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbd3b4-c738-4653-a76b-6fdffb6a6a4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:37.333432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:37.359512 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbd3b4-c738-4653-a76b-6fdffb6a6a4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:37.360974 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbd3b4-c738-4653-a76b-6fdffb6a6a4a None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:37.458941 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 552/1090] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:05:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:05:37.464719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37249bcb-8f99-4768-a7aa-58fb0a4f5d59 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:37.492757 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:37.566431 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37249bcb-8f99-4768-a7aa-58fb0a4f5d59 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:37.594373 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fa143-f983-43f3-8683-9844a8efd24c None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:37.594764 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fa143-f983-43f3-8683-9844a8efd24c None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:37.595320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fa143-f983-43f3-8683-9844a8efd24c None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:37.596528 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 553/1091] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:37.600906 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc2c5f-da6a-4b39-b346-e75cea348f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:37.601769 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc2c5f-da6a-4b39-b346-e75cea348f33 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:37.602424 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc2c5f-da6a-4b39-b346-e75cea348f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:37.602561 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342ee99-4ce5-46ca-a43c-a96d028d8c74 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:37.602658 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc2c5f-da6a-4b39-b346-e75cea348f33 None admin] PATH_INFO: `/v3/projects/703747b712be4ca9bb5da88738f7945b` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:37.602746 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342ee99-4ce5-46ca-a43c-a96d028d8c74 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:37.602908 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342ee99-4ce5-46ca-a43c-a96d028d8c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:37.603521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc2c5f-da6a-4b39-b346-e75cea348f33 None admin] RBAC: Authorizing `identity:get_project(project_id=703747b712be4ca9bb5da88738f7945b)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:37.604950 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc2c5f-da6a-4b39-b346-e75cea348f33 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:37.606664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 539/1092] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:05:37 2022] GET /identity/v3/projects/703747b712be4ca9bb5da88738f7945b => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:37.612617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc2c5f-da6a-4b39-b346-e75cea348f33 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:37.621499 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-8342ee99-4ce5-46ca-a43c-a96d028d8c74 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:37.622818 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-8342ee99-4ce5-46ca-a43c-a96d028d8c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:37.694861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 554/1093] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:05:37.711852 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:37.718013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc2c5f-da6a-4b39-b346-e75cea348f33 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:37.718213 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342ee99-4ce5-46ca-a43c-a96d028d8c74 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:37.720335 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:37.754544 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a3388-7a62-421b-8678-5485af15b106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:37.755216 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a3388-7a62-421b-8678-5485af15b106 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:37.755514 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a3388-7a62-421b-8678-5485af15b106 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:37.755803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a3388-7a62-421b-8678-5485af15b106 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:37.756635 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a3388-7a62-421b-8678-5485af15b106 None admin] RBAC: Adding query filter params (role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0, scope.project.id=703747b712be4ca9bb5da88738f7945b, user.id=80b1370f1e9548df8ef6d1797e87b537) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:37.756951 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a3388-7a62-421b-8678-5485af15b106 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:37.758590 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a3388-7a62-421b-8678-5485af15b106 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:37.765105 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 540/1094] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:05:37 2022] GET /identity/v3/role_assignments?user.id=80b1370f1e9548df8ef6d1797e87b537&scope.project.id=703747b712be4ca9bb5da88738f7945b&role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:37.829471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342ee99-4ce5-46ca-a43c-a96d028d8c74 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:37.867702 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb65d7-3c9b-40bf-9bf0-2d6495984d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:37.868549 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb65d7-3c9b-40bf-9bf0-2d6495984d0f None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:37.868834 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb65d7-3c9b-40bf-9bf0-2d6495984d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:37.869111 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb65d7-3c9b-40bf-9bf0-2d6495984d0f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:37.880484 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb65d7-3c9b-40bf-9bf0-2d6495984d0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:05:37.889431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-8efb65d7-3c9b-40bf-9bf0-2d6495984d0f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 13:05:37.889431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:37.889431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:37.889431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:37.889431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:37.889431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:37.889431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:37.889431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:37.889431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:37.889431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:37.889431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:37.889431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:37.889431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:05:37.889431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:05:37.889431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:05:37.889431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:05:37.890589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:05:37.890589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:05:37.890589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:05:37.890589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:05:37.890589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:37.890589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:37.890589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:37.890589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:37.890589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:37.890589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:37.890589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:37.890589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:37.890589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:37.890589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:37.890589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:37.890589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:37.891443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:37.891443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:37.891443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:37.891443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:37.891443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:05:37.891443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:05:37.891443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:05:37.891443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:05:37.891443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:05:37.891443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:05:37.891443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 13:05:37.891443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:37.891443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 555/1095] 10.222.0.17 () {56 vars in 1120 bytes} [Tue Jul 12 13:05:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:05:37.896967 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a3388-7a62-421b-8678-5485af15b106 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:38.004959 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a3388-7a62-421b-8678-5485af15b106 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:38.039729 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf5b8d-e592-4e7d-8907-4b73a1082ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:38.040459 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf5b8d-e592-4e7d-8907-4b73a1082ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:38.040801 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf5b8d-e592-4e7d-8907-4b73a1082ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:38.041132 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf5b8d-e592-4e7d-8907-4b73a1082ba7 None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:38.041918 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf5b8d-e592-4e7d-8907-4b73a1082ba7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:38.042270 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf5b8d-e592-4e7d-8907-4b73a1082ba7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:38.043649 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf5b8d-e592-4e7d-8907-4b73a1082ba7 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:38.052170 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 541/1096] 10.222.0.17 () {56 vars in 1115 bytes} [Tue Jul 12 13:05:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:38.057911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb65d7-3c9b-40bf-9bf0-2d6495984d0f None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:38.122717 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:38.164988 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb65d7-3c9b-40bf-9bf0-2d6495984d0f None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:38.199573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c2039-ed8b-4986-a7ed-9bc83153653c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:38.200413 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c2039-ed8b-4986-a7ed-9bc83153653c None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:38.200706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c2039-ed8b-4986-a7ed-9bc83153653c None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:38.200990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c2039-ed8b-4986-a7ed-9bc83153653c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:38.212438 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c2039-ed8b-4986-a7ed-9bc83153653c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:38.213990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c2039-ed8b-4986-a7ed-9bc83153653c None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:38.232894 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-f92c2039-ed8b-4986-a7ed-9bc83153653c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:38.232894 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:38.232894 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:38.232894 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:38.232894 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:38.232894 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:38.232894 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:38.232894 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:38.232894 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:38.232894 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:38.232894 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:38.232894 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:38.232894 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:05:38.232894 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:05:38.232894 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:05:38.233824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:05:38.233824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:38.233824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:38.233824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:38.233824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:38.233824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:38.233824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:38.233824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:38.233824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:38.233824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:38.233824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:38.233824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:38.233824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:38.233824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:38.233824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:38.233824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:38.233824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:38.234853 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:05:38.234853 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:05:38.234853 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:38.234853 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:38.234853 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 556/1097] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:38.240413 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf5b8d-e592-4e7d-8907-4b73a1082ba7 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:38.265920 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:38.342829 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf5b8d-e592-4e7d-8907-4b73a1082ba7 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:38.376505 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b02fd-f9dd-4cfa-bba1-ef635ada19c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:38.377166 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b02fd-f9dd-4cfa-bba1-ef635ada19c3 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:38.377450 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b02fd-f9dd-4cfa-bba1-ef635ada19c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:38.377727 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b02fd-f9dd-4cfa-bba1-ef635ada19c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:38.378461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b02fd-f9dd-4cfa-bba1-ef635ada19c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:38.378770 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b02fd-f9dd-4cfa-bba1-ef635ada19c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:38.380126 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b02fd-f9dd-4cfa-bba1-ef635ada19c3 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:38.392331 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 542/1098] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:38.397650 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c2039-ed8b-4986-a7ed-9bc83153653c None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:38.503885 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c2039-ed8b-4986-a7ed-9bc83153653c None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:38.518259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:38.539650 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0942f65-0b80-4f60-a26d-7b0f9f38a10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:38.540449 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0942f65-0b80-4f60-a26d-7b0f9f38a10c None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:38.540732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0942f65-0b80-4f60-a26d-7b0f9f38a10c None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:38.541007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0942f65-0b80-4f60-a26d-7b0f9f38a10c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:38.548824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0942f65-0b80-4f60-a26d-7b0f9f38a10c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:38.550298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0942f65-0b80-4f60-a26d-7b0f9f38a10c None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:38.564841 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-b0942f65-0b80-4f60-a26d-7b0f9f38a10c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:05:38.564841 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:38.564841 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:38.564841 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:38.564841 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:38.564841 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:38.564841 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:38.564841 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:38.564841 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:38.564841 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:38.564841 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:38.564841 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:38.564841 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:05:38.564841 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:05:38.564841 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:05:38.564841 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:05:38.566647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:38.566647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:38.566647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:05:38.566647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:05:38.566647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:05:38.566647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:05:38.566647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:38.566647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:38.566647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:38.566647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:38.566647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:38.566647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:38.566647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:38.566647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:38.566647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:38.566647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:38.566647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:38.566647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:38.568635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:38.568635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:38.568635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:05:38.568635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:05:38.568635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:05:38.568635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:05:38.568635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:05:38.568635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:05:38.568635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:05:38.568635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:05:38.568635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 557/1099] 10.222.0.17 () {56 vars in 1093 bytes} [Tue Jul 12 13:05:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:38.573490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b02fd-f9dd-4cfa-bba1-ef635ada19c3 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:38.655516 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:38.676169 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b02fd-f9dd-4cfa-bba1-ef635ada19c3 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:38.712617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4054f53-6e91-4ff2-b3f9-ce256d307742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:38.713287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4054f53-6e91-4ff2-b3f9-ce256d307742 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:38.713573 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4054f53-6e91-4ff2-b3f9-ce256d307742 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:38.713850 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4054f53-6e91-4ff2-b3f9-ce256d307742 None admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:38.714709 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4054f53-6e91-4ff2-b3f9-ce256d307742 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:38.715016 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4054f53-6e91-4ff2-b3f9-ce256d307742 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:38.716436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4054f53-6e91-4ff2-b3f9-ce256d307742 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:38.733288 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 543/1100] 10.222.0.17 () {56 vars in 1133 bytes} [Tue Jul 12 13:05:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:38.739065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0942f65-0b80-4f60-a26d-7b0f9f38a10c None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:38.839370 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0942f65-0b80-4f60-a26d-7b0f9f38a10c None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:38.874927 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd2426-2c95-420e-94df-ca0c8a6f9eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:38.875578 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd2426-2c95-420e-94df-ca0c8a6f9eab None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:38.875860 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd2426-2c95-420e-94df-ca0c8a6f9eab None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:38.876138 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd2426-2c95-420e-94df-ca0c8a6f9eab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:38.919838 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:38.945940 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd2426-2c95-420e-94df-ca0c8a6f9eab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:38.947433 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd2426-2c95-420e-94df-ca0c8a6f9eab None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:39.043098 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 558/1101] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:05:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 13:05:39.048790 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4054f53-6e91-4ff2-b3f9-ce256d307742 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:39.145772 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4054f53-6e91-4ff2-b3f9-ce256d307742 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:39.179436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b2e47-525b-46ea-9c3f-0e420850da77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:39.180224 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b2e47-525b-46ea-9c3f-0e420850da77 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:39.180507 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b2e47-525b-46ea-9c3f-0e420850da77 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:39.180782 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b2e47-525b-46ea-9c3f-0e420850da77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:39.188991 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:39.191369 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b2e47-525b-46ea-9c3f-0e420850da77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:39.192907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b2e47-525b-46ea-9c3f-0e420850da77 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:39.212031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-985b2e47-525b-46ea-9c3f-0e420850da77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:39.212031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:39.212031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:39.212031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:39.212031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:39.212031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:39.212031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:39.212031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:39.212031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:39.212031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:39.212031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:39.212031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:39.212031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:05:39.212031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:05:39.212031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:05:39.213783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:05:39.213783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:39.213783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:39.213783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:39.213783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:39.213783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:39.213783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:39.213783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:39.213783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:39.213783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:39.213783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:39.213783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:39.213783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:39.213783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:39.213783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:39.213783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:39.213783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:39.215785 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:05:39.215785 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:05:39.215785 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:05:39.215785 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:39.215785 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 544/1102] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:39.218904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd2426-2c95-420e-94df-ca0c8a6f9eab None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:39.291921 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:39.317708 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd2426-2c95-420e-94df-ca0c8a6f9eab None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:39.351706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05ab26-f3ed-47a9-8594-11098a2744bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:39.352364 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05ab26-f3ed-47a9-8594-11098a2744bf None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:39.352649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05ab26-f3ed-47a9-8594-11098a2744bf None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:39.352924 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05ab26-f3ed-47a9-8594-11098a2744bf None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:39.353632 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05ab26-f3ed-47a9-8594-11098a2744bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:39.353938 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05ab26-f3ed-47a9-8594-11098a2744bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:39.355332 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05ab26-f3ed-47a9-8594-11098a2744bf None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:39.367354 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 559/1103] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:39.372854 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b2e47-525b-46ea-9c3f-0e420850da77 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:39.475001 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b2e47-525b-46ea-9c3f-0e420850da77 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:39.508141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea063a-7390-4dc8-90f6-a1e882f2edbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:39.508963 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea063a-7390-4dc8-90f6-a1e882f2edbd None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:39.509244 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea063a-7390-4dc8-90f6-a1e882f2edbd None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:39.509545 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea063a-7390-4dc8-90f6-a1e882f2edbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:39.516846 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea063a-7390-4dc8-90f6-a1e882f2edbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:39.518327 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea063a-7390-4dc8-90f6-a1e882f2edbd None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:39.532461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-b1ea063a-7390-4dc8-90f6-a1e882f2edbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:05:39.532461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:39.532461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:39.532461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:39.532461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:39.532461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:39.532461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:39.532461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:39.532461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:39.532461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:39.532461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:39.532461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:39.532461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:05:39.532461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:05:39.532461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:05:39.533512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:05:39.533512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:39.533512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:39.533512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:39.533512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:39.533512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:39.533512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:39.533512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:39.533512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:39.533512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:39.533512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:39.533512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:39.533512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:39.533512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:39.533512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:39.533512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:39.533512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:39.539726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:05:39.539726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:05:39.539726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:05:39.539726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:05:39.539726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:05:39.539726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:05:39.539726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:05:39.539726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:39.539726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 545/1104] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:05:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:39.540219 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05ab26-f3ed-47a9-8594-11098a2744bf None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:39.640910 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05ab26-f3ed-47a9-8594-11098a2744bf None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:39.674470 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9644d0-5518-4ba1-bc34-5818ad08caab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:39.675133 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9644d0-5518-4ba1-bc34-5818ad08caab None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:39.675418 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9644d0-5518-4ba1-bc34-5818ad08caab None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:39.675695 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9644d0-5518-4ba1-bc34-5818ad08caab None admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:39.676468 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9644d0-5518-4ba1-bc34-5818ad08caab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:39.676777 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9644d0-5518-4ba1-bc34-5818ad08caab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:39.678242 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9644d0-5518-4ba1-bc34-5818ad08caab None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:39.679887 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:39.691547 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 560/1105] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:05:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:39.697402 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea063a-7390-4dc8-90f6-a1e882f2edbd None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:39.748908 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:39.795109 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea063a-7390-4dc8-90f6-a1e882f2edbd None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:39.827881 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a5d68-a453-44ad-9736-54872a7e745e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:39.828537 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a5d68-a453-44ad-9736-54872a7e745e None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:39.828819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a5d68-a453-44ad-9736-54872a7e745e None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:39.829095 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a5d68-a453-44ad-9736-54872a7e745e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:39.829923 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a5d68-a453-44ad-9736-54872a7e745e None admin] RBAC: Adding query filter params (role.id=ce2d01c208f54cb38480ddb8127babc8, scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2, user.id=e52dfce1b06346bfbde6ee33e7f6f249) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:39.830275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a5d68-a453-44ad-9736-54872a7e745e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:39.831773 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a5d68-a453-44ad-9736-54872a7e745e None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:39.833473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556a115-0d34-49d9-b063-b2b9cdf0f3cb None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:39.833964 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556a115-0d34-49d9-b063-b2b9cdf0f3cb None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:39.834049 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556a115-0d34-49d9-b063-b2b9cdf0f3cb None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:39.835458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 561/1106] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:39.837840 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 546/1107] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:05:39 2022] GET /identity/v3/role_assignments?user.id=e52dfce1b06346bfbde6ee33e7f6f249&scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2&role.id=ce2d01c208f54cb38480ddb8127babc8 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:39.840380 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304f3f8-d421-4409-ac3c-d9a7edfa80bd None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:39.840676 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304f3f8-d421-4409-ac3c-d9a7edfa80bd None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:39.840966 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304f3f8-d421-4409-ac3c-d9a7edfa80bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:39.859108 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-5304f3f8-d421-4409-ac3c-d9a7edfa80bd None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:39.860343 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-5304f3f8-d421-4409-ac3c-d9a7edfa80bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:39.935080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 562/1108] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:39.966537 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a5d68-a453-44ad-9736-54872a7e745e None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:40.071639 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a5d68-a453-44ad-9736-54872a7e745e None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:40.087399 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:40.106419 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdf4d4-0410-40b6-8089-31e61997b36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:40.107213 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdf4d4-0410-40b6-8089-31e61997b36c None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:40.107493 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdf4d4-0410-40b6-8089-31e61997b36c None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:40.107765 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdf4d4-0410-40b6-8089-31e61997b36c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:40.108913 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdf4d4-0410-40b6-8089-31e61997b36c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:40.110360 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdf4d4-0410-40b6-8089-31e61997b36c None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:40.111998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 547/1109] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:40.118383 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304f3f8-d421-4409-ac3c-d9a7edfa80bd None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:40.217024 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304f3f8-d421-4409-ac3c-d9a7edfa80bd None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:40.241398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:40.252432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5d417-59b2-4b27-b9a7-c6d0123f388d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:40.253113 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5d417-59b2-4b27-b9a7-c6d0123f388d None admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:40.253401 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5d417-59b2-4b27-b9a7-c6d0123f388d None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:40.253681 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5d417-59b2-4b27-b9a7-c6d0123f388d None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:40.254445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5d417-59b2-4b27-b9a7-c6d0123f388d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:40.255870 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5d417-59b2-4b27-b9a7-c6d0123f388d None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:40.276746 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 563/1110] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Jul 12 13:05:40 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:05:42.332731 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7347d13-7312-4b5f-b7e3-b85d382f4d5b None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:42.333319 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7347d13-7312-4b5f-b7e3-b85d382f4d5b None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:42.333319 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7347d13-7312-4b5f-b7e3-b85d382f4d5b None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:42.334715 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 548/1111] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:42.340208 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8ca53-e85c-4e9e-9d3f-bb4d80c527c5 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:42.340645 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8ca53-e85c-4e9e-9d3f-bb4d80c527c5 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:42.340751 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8ca53-e85c-4e9e-9d3f-bb4d80c527c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:42.357159 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-27f8ca53-e85c-4e9e-9d3f-bb4d80c527c5 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:42.358376 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-27f8ca53-e85c-4e9e-9d3f-bb4d80c527c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:42.426417 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 564/1112] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:42.450069 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7347d13-7312-4b5f-b7e3-b85d382f4d5b None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:42.548828 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7347d13-7312-4b5f-b7e3-b85d382f4d5b None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:42.582283 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdea7b-b6fe-42a1-ab59-66431c6f5332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:42.583186 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdea7b-b6fe-42a1-ab59-66431c6f5332 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:42.583431 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdea7b-b6fe-42a1-ab59-66431c6f5332 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:42.584221 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdea7b-b6fe-42a1-ab59-66431c6f5332 None admin] PATH_INFO: `/v3/roles/4d86c48385634483af68ab63e48f9787` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:42.585686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdea7b-b6fe-42a1-ab59-66431c6f5332 None admin] RBAC: Authorizing `identity:get_role(role_id=4d86c48385634483af68ab63e48f9787)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:42.587072 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdea7b-b6fe-42a1-ab59-66431c6f5332 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:42.588416 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 549/1113] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:05:42 2022] GET /identity/v3/roles/4d86c48385634483af68ab63e48f9787 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:42.594091 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8ca53-e85c-4e9e-9d3f-bb4d80c527c5 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:42.694097 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8ca53-e85c-4e9e-9d3f-bb4d80c527c5 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:42.704884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:42.731694 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9d01a-ad2e-4fcf-b22f-0711087ca2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:42.732586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9d01a-ad2e-4fcf-b22f-0711087ca2ab None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:42.732879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9d01a-ad2e-4fcf-b22f-0711087ca2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:42.733158 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9d01a-ad2e-4fcf-b22f-0711087ca2ab None admin] PATH_INFO: `/v3/users/d5ce5816498d434591d7d65ea65c2307` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:42.746455 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9d01a-ad2e-4fcf-b22f-0711087ca2ab None admin] RBAC: Authorizing `identity:get_user(user_id=d5ce5816498d434591d7d65ea65c2307)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:42.747918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9d01a-ad2e-4fcf-b22f-0711087ca2ab None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:42.749591 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 565/1114] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:05:42 2022] GET /identity/v3/users/d5ce5816498d434591d7d65ea65c2307 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:42.755512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdea7b-b6fe-42a1-ab59-66431c6f5332 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:42.808273 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:42.854810 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdea7b-b6fe-42a1-ab59-66431c6f5332 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:42.888859 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f824d-ba10-49dc-9276-fc1c4ea6d721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:42.889526 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f824d-ba10-49dc-9276-fc1c4ea6d721 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:42.889815 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f824d-ba10-49dc-9276-fc1c4ea6d721 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:42.890096 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f824d-ba10-49dc-9276-fc1c4ea6d721 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:42.957212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f824d-ba10-49dc-9276-fc1c4ea6d721 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:42.959244 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f824d-ba10-49dc-9276-fc1c4ea6d721 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:43.008708 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:43.057620 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 550/1115] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:05:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:05:43.063525 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9d01a-ad2e-4fcf-b22f-0711087ca2ab None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:43.158817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9d01a-ad2e-4fcf-b22f-0711087ca2ab None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:43.191829 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82806e-3afe-406e-95b5-e859a58d9a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:43.192696 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82806e-3afe-406e-95b5-e859a58d9a8e None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:43.193006 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82806e-3afe-406e-95b5-e859a58d9a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:43.193282 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82806e-3afe-406e-95b5-e859a58d9a8e None admin] PATH_INFO: `/v3/projects/703747b712be4ca9bb5da88738f7945b` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:43.194466 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c82806e-3afe-406e-95b5-e859a58d9a8e None admin] RBAC: Authorizing `identity:get_project(project_id=703747b712be4ca9bb5da88738f7945b)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:43.195891 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c82806e-3afe-406e-95b5-e859a58d9a8e None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:43.197601 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 566/1116] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:05:43 2022] GET /identity/v3/projects/703747b712be4ca9bb5da88738f7945b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:43.203729 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f824d-ba10-49dc-9276-fc1c4ea6d721 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:43.304619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f824d-ba10-49dc-9276-fc1c4ea6d721 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:43.340510 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717753eb-2568-4b72-84b0-c140e8c43cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:43.341201 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717753eb-2568-4b72-84b0-c140e8c43cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:43.341458 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717753eb-2568-4b72-84b0-c140e8c43cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:43.341735 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717753eb-2568-4b72-84b0-c140e8c43cd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:43.342604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717753eb-2568-4b72-84b0-c140e8c43cd9 None admin] RBAC: Adding query filter params (role.id=4d86c48385634483af68ab63e48f9787, scope.project.id=703747b712be4ca9bb5da88738f7945b, user.id=d5ce5816498d434591d7d65ea65c2307) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:43.342921 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717753eb-2568-4b72-84b0-c140e8c43cd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:43.344342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717753eb-2568-4b72-84b0-c140e8c43cd9 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:43.349905 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 551/1117] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:05:43 2022] GET /identity/v3/role_assignments?user.id=d5ce5816498d434591d7d65ea65c2307&scope.project.id=703747b712be4ca9bb5da88738f7945b&role.id=4d86c48385634483af68ab63e48f9787 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:45.322707 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c0a35-d857-4fa5-9451-7e9bef3b4879 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:45.323299 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c0a35-d857-4fa5-9451-7e9bef3b4879 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:45.323299 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c0a35-d857-4fa5-9451-7e9bef3b4879 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:45.324614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 567/1118] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:45.329828 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cccca8-4f26-4ff8-8249-469422dfbbe9 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:45.330255 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cccca8-4f26-4ff8-8249-469422dfbbe9 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:45.330430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cccca8-4f26-4ff8-8249-469422dfbbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:45.347318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-f6cccca8-4f26-4ff8-8249-469422dfbbe9 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:45.348493 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-f6cccca8-4f26-4ff8-8249-469422dfbbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:45.359365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:45.414194 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 552/1119] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:45.436486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c0a35-d857-4fa5-9451-7e9bef3b4879 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:45.472420 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:45.538473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c0a35-d857-4fa5-9451-7e9bef3b4879 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:45.573377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082a985-e37f-4ca3-b650-c4093e142c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:45.574203 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082a985-e37f-4ca3-b650-c4093e142c53 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:45.574496 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082a985-e37f-4ca3-b650-c4093e142c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:45.574771 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082a985-e37f-4ca3-b650-c4093e142c53 None admin] PATH_INFO: `/v3/roles/4d86c48385634483af68ab63e48f9787` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:45.576241 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082a985-e37f-4ca3-b650-c4093e142c53 None admin] RBAC: Authorizing `identity:get_role(role_id=4d86c48385634483af68ab63e48f9787)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:45.577609 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082a985-e37f-4ca3-b650-c4093e142c53 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:45.579440 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 568/1120] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:05:45 2022] GET /identity/v3/roles/4d86c48385634483af68ab63e48f9787 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:45.584916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cccca8-4f26-4ff8-8249-469422dfbbe9 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:45.688971 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cccca8-4f26-4ff8-8249-469422dfbbe9 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:45.722720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c420e-301b-4637-95e0-8982a3838f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:45.723588 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c420e-301b-4637-95e0-8982a3838f3f None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:45.723876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c420e-301b-4637-95e0-8982a3838f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:45.724730 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c420e-301b-4637-95e0-8982a3838f3f None admin] PATH_INFO: `/v3/users/d5ce5816498d434591d7d65ea65c2307` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:45.725911 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c420e-301b-4637-95e0-8982a3838f3f None admin] RBAC: Authorizing `identity:get_user(user_id=d5ce5816498d434591d7d65ea65c2307)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:45.727378 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c420e-301b-4637-95e0-8982a3838f3f None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:45.729006 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 553/1121] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:05:45 2022] GET /identity/v3/users/d5ce5816498d434591d7d65ea65c2307 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:45.735016 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082a985-e37f-4ca3-b650-c4093e142c53 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:45.830609 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082a985-e37f-4ca3-b650-c4093e142c53 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:45.832789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:45.864144 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cdf90-1b8a-4334-9aaf-ca004d268297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:45.865012 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cdf90-1b8a-4334-9aaf-ca004d268297 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:45.865294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cdf90-1b8a-4334-9aaf-ca004d268297 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:45.865568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cdf90-1b8a-4334-9aaf-ca004d268297 None admin] PATH_INFO: `/v3/projects/703747b712be4ca9bb5da88738f7945b` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:45.866751 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cdf90-1b8a-4334-9aaf-ca004d268297 None admin] RBAC: Authorizing `identity:get_project(project_id=703747b712be4ca9bb5da88738f7945b)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:45.868191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cdf90-1b8a-4334-9aaf-ca004d268297 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:45.869875 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 569/1122] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:05:45 2022] GET /identity/v3/projects/703747b712be4ca9bb5da88738f7945b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:05:45.876038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c420e-301b-4637-95e0-8982a3838f3f None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:45.892570 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:45.975673 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c420e-301b-4637-95e0-8982a3838f3f None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:46.009203 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1e40f-f988-4694-ac5c-fc4188a9e8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:46.010092 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1e40f-f988-4694-ac5c-fc4188a9e8e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:46.010410 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1e40f-f988-4694-ac5c-fc4188a9e8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:46.010948 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1e40f-f988-4694-ac5c-fc4188a9e8e8 None admin] PATH_INFO: `/v3/projects/703747b712be4ca9bb5da88738f7945b/users/d5ce5816498d434591d7d65ea65c2307/roles/4d86c48385634483af68ab63e48f9787` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:46.013251 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1e40f-f988-4694-ac5c-fc4188a9e8e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=703747b712be4ca9bb5da88738f7945b, user_id=d5ce5816498d434591d7d65ea65c2307, role_id=4d86c48385634483af68ab63e48f9787)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:46.014714 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1e40f-f988-4694-ac5c-fc4188a9e8e8 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:46.027768 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 554/1123] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Jul 12 13:05:45 2022] PUT /identity/v3/projects/703747b712be4ca9bb5da88738f7945b/users/d5ce5816498d434591d7d65ea65c2307/roles/4d86c48385634483af68ab63e48f9787 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:05:47.995796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58771af3-547b-4df0-b3bd-2e901dc14799 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:47.996350 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58771af3-547b-4df0-b3bd-2e901dc14799 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:47.996350 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58771af3-547b-4df0-b3bd-2e901dc14799 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:47.997725 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 570/1124] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:48.002896 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703669f-ff83-4981-876c-0d5ce674a1ec None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:48.003291 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703669f-ff83-4981-876c-0d5ce674a1ec None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:48.003456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703669f-ff83-4981-876c-0d5ce674a1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:48.026058 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-a703669f-ff83-4981-876c-0d5ce674a1ec None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:48.027579 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-a703669f-ff83-4981-876c-0d5ce674a1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:48.097502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 555/1125] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:48.121188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58771af3-547b-4df0-b3bd-2e901dc14799 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:48.218725 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58771af3-547b-4df0-b3bd-2e901dc14799 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:48.252375 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af8ccb-3334-4ea5-ae26-d6250cb8d10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:48.253181 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af8ccb-3334-4ea5-ae26-d6250cb8d10f None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:48.253465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af8ccb-3334-4ea5-ae26-d6250cb8d10f None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:48.253744 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af8ccb-3334-4ea5-ae26-d6250cb8d10f None admin] PATH_INFO: `/v3/roles/4d86c48385634483af68ab63e48f9787` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:48.255235 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af8ccb-3334-4ea5-ae26-d6250cb8d10f None admin] RBAC: Authorizing `identity:get_role(role_id=4d86c48385634483af68ab63e48f9787)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:48.256603 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af8ccb-3334-4ea5-ae26-d6250cb8d10f None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:48.257955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 571/1126] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:05:48 2022] GET /identity/v3/roles/4d86c48385634483af68ab63e48f9787 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:48.264123 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703669f-ff83-4981-876c-0d5ce674a1ec None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:48.267183 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:48.360439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703669f-ff83-4981-876c-0d5ce674a1ec None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:48.393637 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0da7e-0564-44c5-941f-e556ce451479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:48.394559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0da7e-0564-44c5-941f-e556ce451479 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:48.394850 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0da7e-0564-44c5-941f-e556ce451479 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:48.395130 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0da7e-0564-44c5-941f-e556ce451479 None admin] PATH_INFO: `/v3/users/d5ce5816498d434591d7d65ea65c2307` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:48.396920 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0da7e-0564-44c5-941f-e556ce451479 None admin] RBAC: Authorizing `identity:get_user(user_id=d5ce5816498d434591d7d65ea65c2307)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:48.398367 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0da7e-0564-44c5-941f-e556ce451479 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:48.399974 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 556/1127] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:05:48 2022] GET /identity/v3/users/d5ce5816498d434591d7d65ea65c2307 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:48.405532 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af8ccb-3334-4ea5-ae26-d6250cb8d10f None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:48.446366 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:48.503751 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af8ccb-3334-4ea5-ae26-d6250cb8d10f None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:48.536176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a7f39-1e20-4b21-98d7-83f3f118e93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:48.536843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a7f39-1e20-4b21-98d7-83f3f118e93c None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:48.537131 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a7f39-1e20-4b21-98d7-83f3f118e93c None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:48.537412 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a7f39-1e20-4b21-98d7-83f3f118e93c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:48.601148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a7f39-1e20-4b21-98d7-83f3f118e93c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:48.602635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a7f39-1e20-4b21-98d7-83f3f118e93c None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:48.641691 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:48.701049 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 572/1128] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:05:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:05:48.706816 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0da7e-0564-44c5-941f-e556ce451479 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:48.774193 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:48.802910 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0da7e-0564-44c5-941f-e556ce451479 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:48.835553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1510f-10a1-485a-ba8f-c6db2082c8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:48.836395 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1510f-10a1-485a-ba8f-c6db2082c8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:48.836681 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1510f-10a1-485a-ba8f-c6db2082c8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:48.836958 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1510f-10a1-485a-ba8f-c6db2082c8f0 None admin] PATH_INFO: `/v3/projects/703747b712be4ca9bb5da88738f7945b` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:48.838131 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1510f-10a1-485a-ba8f-c6db2082c8f0 None admin] RBAC: Authorizing `identity:get_project(project_id=703747b712be4ca9bb5da88738f7945b)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:48.839547 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1510f-10a1-485a-ba8f-c6db2082c8f0 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:48.841212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 557/1129] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:05:48 2022] GET /identity/v3/projects/703747b712be4ca9bb5da88738f7945b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:48.847289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a7f39-1e20-4b21-98d7-83f3f118e93c None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:48.943182 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a7f39-1e20-4b21-98d7-83f3f118e93c None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:48.975726 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1f844-65e5-4eb4-948d-6bef8702633c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:48.976370 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1f844-65e5-4eb4-948d-6bef8702633c None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:48.976656 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1f844-65e5-4eb4-948d-6bef8702633c None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:48.976933 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1f844-65e5-4eb4-948d-6bef8702633c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:48.977760 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1f844-65e5-4eb4-948d-6bef8702633c None admin] RBAC: Adding query filter params (role.id=4d86c48385634483af68ab63e48f9787, scope.project.id=703747b712be4ca9bb5da88738f7945b, user.id=d5ce5816498d434591d7d65ea65c2307) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:48.978077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1f844-65e5-4eb4-948d-6bef8702633c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:48.979529 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1f844-65e5-4eb4-948d-6bef8702633c None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:48.985167 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 573/1130] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:05:48 2022] GET /identity/v3/role_assignments?user.id=d5ce5816498d434591d7d65ea65c2307&scope.project.id=703747b712be4ca9bb5da88738f7945b&role.id=4d86c48385634483af68ab63e48f9787 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:50.998430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7203ce7-f92e-4eed-988b-fce975c4e9ca None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:50.999002 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7203ce7-f92e-4eed-988b-fce975c4e9ca None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:50.999002 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7203ce7-f92e-4eed-988b-fce975c4e9ca None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:51.000342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 558/1131] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:51.005493 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59b2a8-aa7d-4463-9d49-5e5061293bd4 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:51.005896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59b2a8-aa7d-4463-9d49-5e5061293bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:51.006064 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59b2a8-aa7d-4463-9d49-5e5061293bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:51.012216 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:51.023880 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-dd59b2a8-aa7d-4463-9d49-5e5061293bd4 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:51.025072 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-dd59b2a8-aa7d-4463-9d49-5e5061293bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:51.089042 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 574/1132] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:51.112001 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7203ce7-f92e-4eed-988b-fce975c4e9ca None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:51.210762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7203ce7-f92e-4eed-988b-fce975c4e9ca None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:51.242574 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad5412-bd1e-4a5c-bc82-454b17c7e8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:51.243358 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad5412-bd1e-4a5c-bc82-454b17c7e8bd None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:51.243640 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad5412-bd1e-4a5c-bc82-454b17c7e8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:51.243914 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad5412-bd1e-4a5c-bc82-454b17c7e8bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:51.245067 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad5412-bd1e-4a5c-bc82-454b17c7e8bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:51.246516 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad5412-bd1e-4a5c-bc82-454b17c7e8bd None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:51.248107 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 559/1133] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:51.254269 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59b2a8-aa7d-4463-9d49-5e5061293bd4 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:51.351232 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59b2a8-aa7d-4463-9d49-5e5061293bd4 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:51.383658 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a92e85-7f09-4ab3-9d96-42cd5a5182ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:51.384308 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a92e85-7f09-4ab3-9d96-42cd5a5182ac None admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:51.384600 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a92e85-7f09-4ab3-9d96-42cd5a5182ac None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:51.384882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a92e85-7f09-4ab3-9d96-42cd5a5182ac None admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:51.385579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a92e85-7f09-4ab3-9d96-42cd5a5182ac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:51.387344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a92e85-7f09-4ab3-9d96-42cd5a5182ac None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:51.390541 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:51.414646 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 575/1134] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Jul 12 13:05:51 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:05:53.440246 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6578774-7a90-4c3c-886e-0cb80534dec2 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:53.440786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6578774-7a90-4c3c-886e-0cb80534dec2 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:53.440786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6578774-7a90-4c3c-886e-0cb80534dec2 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:53.442182 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 560/1135] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:53.447833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b27d8-3865-46d4-bf4b-e76501aaa80c None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:53.448294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b27d8-3865-46d4-bf4b-e76501aaa80c None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:53.448391 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b27d8-3865-46d4-bf4b-e76501aaa80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:53.465288 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-241b27d8-3865-46d4-bf4b-e76501aaa80c None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:53.466495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-241b27d8-3865-46d4-bf4b-e76501aaa80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:53.530232 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 576/1136] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:53.553995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6578774-7a90-4c3c-886e-0cb80534dec2 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:53.564723 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:53.653415 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6578774-7a90-4c3c-886e-0cb80534dec2 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:53.685850 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29315b3-5e4f-43b2-9eca-168a300fdb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:53.686680 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29315b3-5e4f-43b2-9eca-168a300fdb76 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:53.686970 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29315b3-5e4f-43b2-9eca-168a300fdb76 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:53.687250 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29315b3-5e4f-43b2-9eca-168a300fdb76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:53.688416 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29315b3-5e4f-43b2-9eca-168a300fdb76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:53.689856 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29315b3-5e4f-43b2-9eca-168a300fdb76 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:53.691524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 561/1137] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:05:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:53.697696 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b27d8-3865-46d4-bf4b-e76501aaa80c None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:53.793763 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b27d8-3865-46d4-bf4b-e76501aaa80c None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:53.810289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:53.828796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e9482-e1c5-4f36-b25e-bd56fbd036b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:53.829462 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e9482-e1c5-4f36-b25e-bd56fbd036b3 None admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:53.829748 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e9482-e1c5-4f36-b25e-bd56fbd036b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:53.830027 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e9482-e1c5-4f36-b25e-bd56fbd036b3 None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:53.830771 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e9482-e1c5-4f36-b25e-bd56fbd036b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:53.832206 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e9482-e1c5-4f36-b25e-bd56fbd036b3 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:53.852637 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 577/1138] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Jul 12 13:05:53 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:05:55.911475 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75b4cb-0c79-4d1d-bc48-29b4f6d2e1e3 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:55.912000 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75b4cb-0c79-4d1d-bc48-29b4f6d2e1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:55.912113 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75b4cb-0c79-4d1d-bc48-29b4f6d2e1e3 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:55.913407 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 562/1139] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:55.918523 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f1f2b-c519-403a-8602-87b04816adb6 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:55.918910 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f1f2b-c519-403a-8602-87b04816adb6 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:55.919096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f1f2b-c519-403a-8602-87b04816adb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:55.935649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-627f1f2b-c519-403a-8602-87b04816adb6 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:55.936779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-627f1f2b-c519-403a-8602-87b04816adb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:56.001147 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 578/1140] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:56.024444 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75b4cb-0c79-4d1d-bc48-29b4f6d2e1e3 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:56.107006 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:56.136098 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75b4cb-0c79-4d1d-bc48-29b4f6d2e1e3 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:56.167841 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be71a3a-a9c5-48c3-b0f8-e698a01210b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:56.168625 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be71a3a-a9c5-48c3-b0f8-e698a01210b2 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:56.168908 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be71a3a-a9c5-48c3-b0f8-e698a01210b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:56.169187 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be71a3a-a9c5-48c3-b0f8-e698a01210b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:56.179362 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be71a3a-a9c5-48c3-b0f8-e698a01210b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:05:56.186885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-0be71a3a-a9c5-48c3-b0f8-e698a01210b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:05:56.186885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:56.186885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:56.186885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:56.186885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:56.186885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:56.186885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:56.186885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:56.186885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:56.186885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:56.186885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:56.186885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:56.186885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:05:56.186885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:05:56.186885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:05:56.186885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:05:56.188061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:05:56.188061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:05:56.188061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:05:56.188061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:05:56.188061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:56.188061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:56.188061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:56.188061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:56.188061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:56.188061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:56.188061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:56.188061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:56.188061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:56.188061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:56.188061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:56.188061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:56.189189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:56.189189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:56.189189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:56.189189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:56.189189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:05:56.189189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:05:56.189189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:05:56.189189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:05:56.189189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:05:56.189189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:05:56.189189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:05:56.189189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:56.189189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 563/1141] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:05:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:05:56.194706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f1f2b-c519-403a-8602-87b04816adb6 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:56.287965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f1f2b-c519-403a-8602-87b04816adb6 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:56.289479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:56.322789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8b0b8-bb37-4182-8756-418bde0fd412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:56.323449 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8b0b8-bb37-4182-8756-418bde0fd412 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:56.323733 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8b0b8-bb37-4182-8756-418bde0fd412 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:56.324010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8b0b8-bb37-4182-8756-418bde0fd412 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:56.324746 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8b0b8-bb37-4182-8756-418bde0fd412 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:56.325063 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8b0b8-bb37-4182-8756-418bde0fd412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:56.326450 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8b0b8-bb37-4182-8756-418bde0fd412 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:56.334178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 579/1142] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:05:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:56.339838 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be71a3a-a9c5-48c3-b0f8-e698a01210b2 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:56.436384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be71a3a-a9c5-48c3-b0f8-e698a01210b2 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:56.467532 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799bf73-0a93-4ae0-8bc8-8a6945474a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:56.468386 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799bf73-0a93-4ae0-8bc8-8a6945474a1f None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:56.468669 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799bf73-0a93-4ae0-8bc8-8a6945474a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:56.468941 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799bf73-0a93-4ae0-8bc8-8a6945474a1f None admin] PATH_INFO: `/v3/users/a88d3ed6d62e4b97b653c7f139cd708f` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:56.471548 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:56.482462 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799bf73-0a93-4ae0-8bc8-8a6945474a1f None admin] RBAC: Authorizing `identity:get_user(user_id=a88d3ed6d62e4b97b653c7f139cd708f)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:56.483888 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799bf73-0a93-4ae0-8bc8-8a6945474a1f None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:56.485500 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 564/1143] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:05:56 2022] GET /identity/v3/users/a88d3ed6d62e4b97b653c7f139cd708f => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:56.491881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8b0b8-bb37-4182-8756-418bde0fd412 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:56.590728 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8b0b8-bb37-4182-8756-418bde0fd412 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:56.624014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d63ee-4cfa-49ab-850d-b1ea00f691a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:56.624667 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d63ee-4cfa-49ab-850d-b1ea00f691a2 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:56.624956 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d63ee-4cfa-49ab-850d-b1ea00f691a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:56.625239 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d63ee-4cfa-49ab-850d-b1ea00f691a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:56.654353 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:56.691268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d63ee-4cfa-49ab-850d-b1ea00f691a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:56.692708 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d63ee-4cfa-49ab-850d-b1ea00f691a2 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:56.787526 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 580/1144] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:05:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:05:56.793368 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799bf73-0a93-4ae0-8bc8-8a6945474a1f None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:56.887600 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799bf73-0a93-4ae0-8bc8-8a6945474a1f None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:56.920290 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a1bb2-dad4-4907-a1d0-2079a9abf770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:56.921133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a1bb2-dad4-4907-a1d0-2079a9abf770 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:56.921422 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a1bb2-dad4-4907-a1d0-2079a9abf770 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:56.921699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a1bb2-dad4-4907-a1d0-2079a9abf770 None admin] PATH_INFO: `/v3/projects/547aefe3a69645099caa7bf9d9db4027` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:56.922874 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a1bb2-dad4-4907-a1d0-2079a9abf770 None admin] RBAC: Authorizing `identity:get_project(project_id=547aefe3a69645099caa7bf9d9db4027)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:56.924288 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a1bb2-dad4-4907-a1d0-2079a9abf770 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:56.925935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 565/1145] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:05:56 2022] GET /identity/v3/projects/547aefe3a69645099caa7bf9d9db4027 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:56.931889 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d63ee-4cfa-49ab-850d-b1ea00f691a2 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:56.990506 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:57.028231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d63ee-4cfa-49ab-850d-b1ea00f691a2 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:57.061873 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992335b-9864-4e9e-914e-9a34f70824f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:57.062490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992335b-9864-4e9e-914e-9a34f70824f7 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:57.062780 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992335b-9864-4e9e-914e-9a34f70824f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:57.063058 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992335b-9864-4e9e-914e-9a34f70824f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:57.063877 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992335b-9864-4e9e-914e-9a34f70824f7 None admin] RBAC: Adding query filter params (role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0, scope.project.id=547aefe3a69645099caa7bf9d9db4027, user.id=a88d3ed6d62e4b97b653c7f139cd708f) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:57.064191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992335b-9864-4e9e-914e-9a34f70824f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:57.065606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992335b-9864-4e9e-914e-9a34f70824f7 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:57.070877 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 581/1146] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:05:56 2022] GET /identity/v3/role_assignments?user.id=a88d3ed6d62e4b97b653c7f139cd708f&scope.project.id=547aefe3a69645099caa7bf9d9db4027&role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:59.038851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704c5ae-25a8-4427-ab07-2a4d963613aa None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:59.039407 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704c5ae-25a8-4427-ab07-2a4d963613aa None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:59.039407 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704c5ae-25a8-4427-ab07-2a4d963613aa None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:59.040782 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 566/1147] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:05:59.045862 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68331568-4ebf-4003-a100-92232c2a358e None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:59.046321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68331568-4ebf-4003-a100-92232c2a358e None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:59.046457 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68331568-4ebf-4003-a100-92232c2a358e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:59.063213 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-68331568-4ebf-4003-a100-92232c2a358e None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:05:59.064389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-68331568-4ebf-4003-a100-92232c2a358e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:05:59.127884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 582/1148] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:05:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:05:59.150930 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704c5ae-25a8-4427-ab07-2a4d963613aa None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:59.211373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:59.250022 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704c5ae-25a8-4427-ab07-2a4d963613aa None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:59.282939 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f913d4-f732-439e-8473-d1942c67e57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:59.283720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f913d4-f732-439e-8473-d1942c67e57f None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:59.284006 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f913d4-f732-439e-8473-d1942c67e57f None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:59.284284 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f913d4-f732-439e-8473-d1942c67e57f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:59.294497 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f913d4-f732-439e-8473-d1942c67e57f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:05:59.302632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-95f913d4-f732-439e-8473-d1942c67e57f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:05:59.302632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:05:59.302632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:05:59.302632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:05:59.302632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:05:59.302632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:05:59.302632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:05:59.302632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:05:59.302632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:05:59.302632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:05:59.302632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:05:59.302632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:05:59.302632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:05:59.302632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:05:59.302632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:05:59.302632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:05:59.303550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:05:59.303550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:05:59.303550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:05:59.303550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:05:59.303550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:05:59.303550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:05:59.303550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:05:59.303550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:05:59.303550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:05:59.303550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:05:59.303550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:05:59.303550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:05:59.303550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:05:59.303550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:05:59.303550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:05:59.303550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:05:59.304578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:05:59.304578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:05:59.304578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:05:59.304578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:05:59.304578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:05:59.304578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:05:59.304578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:05:59.304578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:05:59.304578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:05:59.304578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:05:59.304578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:05:59.304578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:05:59.304578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 567/1149] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:05:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:05:59.309773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68331568-4ebf-4003-a100-92232c2a358e None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:59.366273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:59.406074 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68331568-4ebf-4003-a100-92232c2a358e None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:59.439310 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e477e9-0000-4f56-a7c3-5f60d5629265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:59.439973 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e477e9-0000-4f56-a7c3-5f60d5629265 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:59.440288 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e477e9-0000-4f56-a7c3-5f60d5629265 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:59.440571 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e477e9-0000-4f56-a7c3-5f60d5629265 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:59.441308 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e477e9-0000-4f56-a7c3-5f60d5629265 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:05:59.441624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e477e9-0000-4f56-a7c3-5f60d5629265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:59.443160 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e477e9-0000-4f56-a7c3-5f60d5629265 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:59.450980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 583/1150] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:05:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:59.456534 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f913d4-f732-439e-8473-d1942c67e57f None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:59.553516 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f913d4-f732-439e-8473-d1942c67e57f None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:59.574634 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:59.586077 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924883b-04ba-43fd-beeb-a42febd52899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:59.586976 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924883b-04ba-43fd-beeb-a42febd52899 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:59.587263 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924883b-04ba-43fd-beeb-a42febd52899 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:59.587545 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924883b-04ba-43fd-beeb-a42febd52899 None admin] PATH_INFO: `/v3/users/a88d3ed6d62e4b97b653c7f139cd708f` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:59.588744 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924883b-04ba-43fd-beeb-a42febd52899 None admin] RBAC: Authorizing `identity:get_user(user_id=a88d3ed6d62e4b97b653c7f139cd708f)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:59.590224 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924883b-04ba-43fd-beeb-a42febd52899 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:59.591899 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 568/1151] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:05:59 2022] GET /identity/v3/users/a88d3ed6d62e4b97b653c7f139cd708f => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:59.597731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e477e9-0000-4f56-a7c3-5f60d5629265 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:59.693195 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e477e9-0000-4f56-a7c3-5f60d5629265 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:59.712341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:05:59.726584 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a711bd5-7097-40ea-95b4-88caa0e5474e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:59.727443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a711bd5-7097-40ea-95b4-88caa0e5474e None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:59.727745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a711bd5-7097-40ea-95b4-88caa0e5474e None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:59.728023 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a711bd5-7097-40ea-95b4-88caa0e5474e None admin] PATH_INFO: `/v3/projects/547aefe3a69645099caa7bf9d9db4027` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:59.729171 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a711bd5-7097-40ea-95b4-88caa0e5474e None admin] RBAC: Authorizing `identity:get_project(project_id=547aefe3a69645099caa7bf9d9db4027)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:59.730636 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a711bd5-7097-40ea-95b4-88caa0e5474e None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:59.732301 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 584/1152] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:05:59 2022] GET /identity/v3/projects/547aefe3a69645099caa7bf9d9db4027 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:05:59.738134 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924883b-04ba-43fd-beeb-a42febd52899 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:05:59.835269 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924883b-04ba-43fd-beeb-a42febd52899 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:05:59.867591 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153c3d8-5319-414e-bda9-2dd48345291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:05:59.868474 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153c3d8-5319-414e-bda9-2dd48345291e None admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:05:59.868761 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153c3d8-5319-414e-bda9-2dd48345291e None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:05:59.869041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153c3d8-5319-414e-bda9-2dd48345291e None admin] PATH_INFO: `/v3/projects/547aefe3a69645099caa7bf9d9db4027/users/a88d3ed6d62e4b97b653c7f139cd708f/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:05:59.871002 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153c3d8-5319-414e-bda9-2dd48345291e None admin] RBAC: Authorizing `identity:create_grant(project_id=547aefe3a69645099caa7bf9d9db4027, user_id=a88d3ed6d62e4b97b653c7f139cd708f, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:05:59.872432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153c3d8-5319-414e-bda9-2dd48345291e None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:05:59.885304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 569/1153] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Jul 12 13:05:59 2022] PUT /identity/v3/projects/547aefe3a69645099caa7bf9d9db4027/users/a88d3ed6d62e4b97b653c7f139cd708f/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:06:01.854448 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174d75d-4423-4254-80a6-6b4c8b272170 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:01.855005 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174d75d-4423-4254-80a6-6b4c8b272170 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:01.855005 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174d75d-4423-4254-80a6-6b4c8b272170 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:01.856391 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 585/1154] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:06:01.861479 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711a516-b299-4205-8cd3-79fdecd759d1 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:01.861901 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711a516-b299-4205-8cd3-79fdecd759d1 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:01.862043 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711a516-b299-4205-8cd3-79fdecd759d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:01.879038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-e711a516-b299-4205-8cd3-79fdecd759d1 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:06:01.880232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-e711a516-b299-4205-8cd3-79fdecd759d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:06:01.924791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:01.947056 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 570/1155] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:06:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:06:01.970782 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174d75d-4423-4254-80a6-6b4c8b272170 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:02.069505 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174d75d-4423-4254-80a6-6b4c8b272170 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:02.103743 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb8418-3a1e-4cc1-95b0-4f27edeaae49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:02.104526 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb8418-3a1e-4cc1-95b0-4f27edeaae49 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:02.104814 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb8418-3a1e-4cc1-95b0-4f27edeaae49 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:02.105091 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb8418-3a1e-4cc1-95b0-4f27edeaae49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:02.115241 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb8418-3a1e-4cc1-95b0-4f27edeaae49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:06:02.122946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-97fb8418-3a1e-4cc1-95b0-4f27edeaae49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:06:02.122946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:06:02.122946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:06:02.122946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:06:02.122946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:06:02.122946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:06:02.122946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:06:02.122946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:06:02.122946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:06:02.122946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:06:02.122946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:06:02.122946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:06:02.122946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:06:02.122946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:06:02.122946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:06:02.122946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:06:02.124035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:06:02.124035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:06:02.124035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:06:02.124035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:06:02.124035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:06:02.124035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:06:02.124035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:06:02.124035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:06:02.124035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:06:02.124035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:06:02.124035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:06:02.124035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:06:02.124035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:06:02.124035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:06:02.124035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:06:02.124035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:06:02.125070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:06:02.125070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:06:02.125070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:06:02.125070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:06:02.125070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:06:02.125070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:06:02.125070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:06:02.125070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:06:02.125070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:06:02.125070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:06:02.125070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:06:02.125070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:06:02.125070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 586/1156] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:06:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:06:02.130226 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711a516-b299-4205-8cd3-79fdecd759d1 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:02.228629 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711a516-b299-4205-8cd3-79fdecd759d1 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:02.260621 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736719b-f646-4924-9f69-ed39f579d4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:02.261573 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736719b-f646-4924-9f69-ed39f579d4dc None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:02.261861 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736719b-f646-4924-9f69-ed39f579d4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:02.262158 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736719b-f646-4924-9f69-ed39f579d4dc None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:02.262896 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736719b-f646-4924-9f69-ed39f579d4dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:06:02.263202 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736719b-f646-4924-9f69-ed39f579d4dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:06:02.264551 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736719b-f646-4924-9f69-ed39f579d4dc None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:06:02.272815 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 571/1157] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:06:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:06:02.278639 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb8418-3a1e-4cc1-95b0-4f27edeaae49 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:02.325996 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:02.375278 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb8418-3a1e-4cc1-95b0-4f27edeaae49 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:02.409622 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10479667-c829-40c4-8048-b9397d2affcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:02.410518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10479667-c829-40c4-8048-b9397d2affcb None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:02.410803 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10479667-c829-40c4-8048-b9397d2affcb None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:02.411114 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10479667-c829-40c4-8048-b9397d2affcb None admin] PATH_INFO: `/v3/users/a88d3ed6d62e4b97b653c7f139cd708f` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:02.412284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10479667-c829-40c4-8048-b9397d2affcb None admin] RBAC: Authorizing `identity:get_user(user_id=a88d3ed6d62e4b97b653c7f139cd708f)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:06:02.413711 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10479667-c829-40c4-8048-b9397d2affcb None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:06:02.415356 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 587/1158] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:06:02 2022] GET /identity/v3/users/a88d3ed6d62e4b97b653c7f139cd708f => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:06:02.421030 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736719b-f646-4924-9f69-ed39f579d4dc None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:02.463094 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:02.517762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736719b-f646-4924-9f69-ed39f579d4dc None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:02.549279 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f958c00-0c26-40b6-a316-a28f61ca4608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:02.549918 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f958c00-0c26-40b6-a316-a28f61ca4608 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:02.550228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f958c00-0c26-40b6-a316-a28f61ca4608 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:02.550503 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f958c00-0c26-40b6-a316-a28f61ca4608 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:02.614887 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f958c00-0c26-40b6-a316-a28f61ca4608 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:06:02.616315 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f958c00-0c26-40b6-a316-a28f61ca4608 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:06:02.656130 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:02.711329 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 572/1159] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:06:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:06:02.717085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10479667-c829-40c4-8048-b9397d2affcb None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:02.812987 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10479667-c829-40c4-8048-b9397d2affcb None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:02.828661 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:02.846171 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90d07e-c55a-4eb2-bc0a-d610a8fc1535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:02.847024 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90d07e-c55a-4eb2-bc0a-d610a8fc1535 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:02.847307 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90d07e-c55a-4eb2-bc0a-d610a8fc1535 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:02.847581 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90d07e-c55a-4eb2-bc0a-d610a8fc1535 None admin] PATH_INFO: `/v3/projects/547aefe3a69645099caa7bf9d9db4027` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:02.849270 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90d07e-c55a-4eb2-bc0a-d610a8fc1535 None admin] RBAC: Authorizing `identity:get_project(project_id=547aefe3a69645099caa7bf9d9db4027)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:06:02.850731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90d07e-c55a-4eb2-bc0a-d610a8fc1535 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:06:02.852392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 588/1160] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:06:02 2022] GET /identity/v3/projects/547aefe3a69645099caa7bf9d9db4027 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:06:02.858481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f958c00-0c26-40b6-a316-a28f61ca4608 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:02.954818 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f958c00-0c26-40b6-a316-a28f61ca4608 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:02.987267 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c022f33-cfcb-47f0-877a-807ff8ed6509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:02.987924 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c022f33-cfcb-47f0-877a-807ff8ed6509 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:02.988211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c022f33-cfcb-47f0-877a-807ff8ed6509 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:02.988491 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c022f33-cfcb-47f0-877a-807ff8ed6509 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:02.989806 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c022f33-cfcb-47f0-877a-807ff8ed6509 None admin] RBAC: Adding query filter params (role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0, scope.project.id=547aefe3a69645099caa7bf9d9db4027, user.id=a88d3ed6d62e4b97b653c7f139cd708f) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:06:02.990149 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c022f33-cfcb-47f0-877a-807ff8ed6509 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:06:02.991578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c022f33-cfcb-47f0-877a-807ff8ed6509 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:06:02.997322 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 573/1161] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:06:02 2022] GET /identity/v3/role_assignments?user.id=a88d3ed6d62e4b97b653c7f139cd708f&scope.project.id=547aefe3a69645099caa7bf9d9db4027&role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:06:05.029485 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5714c-d647-4819-80ed-54a10d19ec14 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:05.030032 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5714c-d647-4819-80ed-54a10d19ec14 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:05.030032 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5714c-d647-4819-80ed-54a10d19ec14 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:05.031436 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 589/1162] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:06:05.037076 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76940a-f288-4f41-bdd5-a7a032c4f8cc None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:05.037446 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76940a-f288-4f41-bdd5-a7a032c4f8cc None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:05.037646 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76940a-f288-4f41-bdd5-a7a032c4f8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:05.049829 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:05.055552 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-eb76940a-f288-4f41-bdd5-a7a032c4f8cc None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:06:05.056742 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-eb76940a-f288-4f41-bdd5-a7a032c4f8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:06:05.121070 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 574/1163] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:06:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:06:05.143439 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5714c-d647-4819-80ed-54a10d19ec14 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:05.241400 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5714c-d647-4819-80ed-54a10d19ec14 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:05.275811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683e746-daf9-4e23-8299-e035b12f6a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:05.276456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683e746-daf9-4e23-8299-e035b12f6a30 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:05.276741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683e746-daf9-4e23-8299-e035b12f6a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:05.277018 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683e746-daf9-4e23-8299-e035b12f6a30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:05.326585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:05.342286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683e746-daf9-4e23-8299-e035b12f6a30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:06:05.343736 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683e746-daf9-4e23-8299-e035b12f6a30 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:06:05.438181 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 590/1164] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:06:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:06:05.444762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76940a-f288-4f41-bdd5-a7a032c4f8cc None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:05.538848 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76940a-f288-4f41-bdd5-a7a032c4f8cc None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:05.570915 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ee38f-dbbc-483f-89b2-da0f74b3a874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:05.571704 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ee38f-dbbc-483f-89b2-da0f74b3a874 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:05.571987 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ee38f-dbbc-483f-89b2-da0f74b3a874 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:05.572258 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ee38f-dbbc-483f-89b2-da0f74b3a874 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:05.574850 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:05.580071 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ee38f-dbbc-483f-89b2-da0f74b3a874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:06:05.581682 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ee38f-dbbc-483f-89b2-da0f74b3a874 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:06:05.596228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-439ee38f-dbbc-483f-89b2-da0f74b3a874 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 12 13:06:05.596228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:06:05.596228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 12 13:06:05.596228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 12 13:06:05.596228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:06:05.596228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:06:05.596228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:06:05.596228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:06:05.596228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 12 13:06:05.596228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:06:05.596228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:06:05.596228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:06:05.596228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:06:05.596228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:06:05.596228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:06:05.596228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:06:05.596228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:06:05.597489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:06:05.597489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:06:05.597489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:06:05.597489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:06:05.597489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:06:05.597489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:06:05.597489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:06:05.597489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:06:05.597489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:06:05.597489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:06:05.597489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:06:05.597489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:06:05.597489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:06:05.597489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:06:05.597489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:06:05.597489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:06:05.598687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:06:05.598687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:06:05.598687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:06:05.598687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:06:05.598687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:06:05.598687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:06:05.598687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:06:05.598687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:06:05.598687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:06:05.598687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:06:05.598687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 12 13:06:05.598687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:06:05.598687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 12 13:06:05.598687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:06:05.598687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 575/1165] 10.222.0.17 () {56 vars in 1117 bytes} [Tue Jul 12 13:06:05 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:06:05.603613 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683e746-daf9-4e23-8299-e035b12f6a30 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:05.684445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:05.700750 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683e746-daf9-4e23-8299-e035b12f6a30 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:05.733502 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c176e-89ff-4108-bfb2-ace02b8ac05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:05.734186 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c176e-89ff-4108-bfb2-ace02b8ac05b None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:05.734476 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c176e-89ff-4108-bfb2-ace02b8ac05b None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:05.734753 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c176e-89ff-4108-bfb2-ace02b8ac05b None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:05.735468 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c176e-89ff-4108-bfb2-ace02b8ac05b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:06:05.735775 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c176e-89ff-4108-bfb2-ace02b8ac05b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:06:05.737135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c176e-89ff-4108-bfb2-ace02b8ac05b None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:06:05.744602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 591/1166] 10.222.0.17 () {56 vars in 1115 bytes} [Tue Jul 12 13:06:05 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:06:07.730948 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23eb33-54cb-479b-89a6-48e403ce8e4d None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:07.731446 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23eb33-54cb-479b-89a6-48e403ce8e4d None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:07.731538 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23eb33-54cb-479b-89a6-48e403ce8e4d None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:07.732884 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 576/1167] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:06:07.738020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92eb0c5-9337-4c53-b045-54253d8a91eb None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:07.738567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92eb0c5-9337-4c53-b045-54253d8a91eb None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:07.738660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92eb0c5-9337-4c53-b045-54253d8a91eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:07.755458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-f92eb0c5-9337-4c53-b045-54253d8a91eb None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:06:07.756630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-f92eb0c5-9337-4c53-b045-54253d8a91eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:06:07.820015 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 592/1168] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:06:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:06:07.842083 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23eb33-54cb-479b-89a6-48e403ce8e4d None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:07.940764 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23eb33-54cb-479b-89a6-48e403ce8e4d None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:07.972843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e417d20-a33f-4d25-ac34-486fcbe453cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:07.974064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e417d20-a33f-4d25-ac34-486fcbe453cf None admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:07.974379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e417d20-a33f-4d25-ac34-486fcbe453cf None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:07.974657 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e417d20-a33f-4d25-ac34-486fcbe453cf None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:07.975397 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e417d20-a33f-4d25-ac34-486fcbe453cf None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:06:07.976746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e417d20-a33f-4d25-ac34-486fcbe453cf None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:06:07.990796 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 577/1169] 10.222.0.17 () {60 vars in 1138 bytes} [Tue Jul 12 13:06:07 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:06:09.999044 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8e72c-5b99-4337-8bf2-9afa06ebf948 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:09.999578 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8e72c-5b99-4337-8bf2-9afa06ebf948 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:09.999673 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8e72c-5b99-4337-8bf2-9afa06ebf948 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:10.000984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 593/1170] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:06:10.005966 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769e915-ce89-479a-9c05-08151f8d77fe None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:10.006375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769e915-ce89-479a-9c05-08151f8d77fe None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:10.006558 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769e915-ce89-479a-9c05-08151f8d77fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:10.023177 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-f769e915-ce89-479a-9c05-08151f8d77fe None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:06:10.024369 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-f769e915-ce89-479a-9c05-08151f8d77fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:06:10.073194 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:10.090523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 578/1171] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:06:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:06:10.118464 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8e72c-5b99-4337-8bf2-9afa06ebf948 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:10.197920 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:10.219904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8e72c-5b99-4337-8bf2-9afa06ebf948 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:10.252350 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95af31-202a-4656-8e67-305864b36d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:10.253143 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95af31-202a-4656-8e67-305864b36d0f None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:10.253430 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95af31-202a-4656-8e67-305864b36d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:10.253710 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95af31-202a-4656-8e67-305864b36d0f None admin] PATH_INFO: `/v3/domains/b83b532c03b245a2b69adc3dc1176150` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:10.264096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95af31-202a-4656-8e67-305864b36d0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=b83b532c03b245a2b69adc3dc1176150)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:06:10.265537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95af31-202a-4656-8e67-305864b36d0f None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:06:10.267186 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 594/1172] 10.222.0.17 () {56 vars in 1183 bytes} [Tue Jul 12 13:06:10 2022] GET /identity/v3/domains/b83b532c03b245a2b69adc3dc1176150 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:06:10.273504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769e915-ce89-479a-9c05-08151f8d77fe None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:10.367922 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769e915-ce89-479a-9c05-08151f8d77fe None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:10.401898 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93b5d6-651e-4012-8d5b-a671ba4a35dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:10.402598 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93b5d6-651e-4012-8d5b-a671ba4a35dd None admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:10.402888 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93b5d6-651e-4012-8d5b-a671ba4a35dd None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:10.403190 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93b5d6-651e-4012-8d5b-a671ba4a35dd None admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:10.403921 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd93b5d6-651e-4012-8d5b-a671ba4a35dd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:06:10.405372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd93b5d6-651e-4012-8d5b-a671ba4a35dd None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:06:10.429620 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 579/1173] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Jul 12 13:06:10 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:06:12.450511 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d963f66-07e8-4e6e-bf68-73b38f7acb8d None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:12.451114 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d963f66-07e8-4e6e-bf68-73b38f7acb8d None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:12.451114 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d963f66-07e8-4e6e-bf68-73b38f7acb8d None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:12.452442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 595/1174] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:06:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:06:12.457497 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c4992-08de-4af6-a47c-d0fa28673b7a None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:12.457912 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c4992-08de-4af6-a47c-d0fa28673b7a None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:12.458640 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c4992-08de-4af6-a47c-d0fa28673b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:12.474940 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-041c4992-08de-4af6-a47c-d0fa28673b7a None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:06:12.476118 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-041c4992-08de-4af6-a47c-d0fa28673b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:06:12.505604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:12.542812 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 580/1175] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:06:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:06:12.567586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d963f66-07e8-4e6e-bf68-73b38f7acb8d None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:12.665935 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d963f66-07e8-4e6e-bf68-73b38f7acb8d None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:12.699293 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78572417-5797-46cd-875d-742fc16c8549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:12.700156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78572417-5797-46cd-875d-742fc16c8549 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:12.700441 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78572417-5797-46cd-875d-742fc16c8549 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:12.700767 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78572417-5797-46cd-875d-742fc16c8549 None admin] PATH_INFO: `/v3/domains/b83b532c03b245a2b69adc3dc1176150` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:12.701870 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78572417-5797-46cd-875d-742fc16c8549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b83b532c03b245a2b69adc3dc1176150)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:06:12.703335 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78572417-5797-46cd-875d-742fc16c8549 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:06:12.704933 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 596/1176] 10.222.0.17 () {56 vars in 1183 bytes} [Tue Jul 12 13:06:12 2022] GET /identity/v3/domains/b83b532c03b245a2b69adc3dc1176150 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:06:12.710684 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c4992-08de-4af6-a47c-d0fa28673b7a None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:12.806256 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c4992-08de-4af6-a47c-d0fa28673b7a None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:12.838815 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6c9f3-d7ee-4e78-a5f9-1a88cacabf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:12.839483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6c9f3-d7ee-4e78-a5f9-1a88cacabf0a None admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:12.839771 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6c9f3-d7ee-4e78-a5f9-1a88cacabf0a None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:12.840054 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6c9f3-d7ee-4e78-a5f9-1a88cacabf0a None admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:12.840777 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6c9f3-d7ee-4e78-a5f9-1a88cacabf0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:06:12.842229 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6c9f3-d7ee-4e78-a5f9-1a88cacabf0a None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:06:12.862054 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 581/1177] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Jul 12 13:06:12 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:06:14.887810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4d8bd-c9eb-48cd-9647-6a9c02b5319f None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:14.887810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4d8bd-c9eb-48cd-9647-6a9c02b5319f None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:14.888455 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4d8bd-c9eb-48cd-9647-6a9c02b5319f None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:14.889330 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 597/1178] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:06:14.894394 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56e8e7-d1ea-49b3-86ac-0206b8140b7d None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:14.894814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56e8e7-d1ea-49b3-86ac-0206b8140b7d None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:14.894961 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56e8e7-d1ea-49b3-86ac-0206b8140b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:14.911491 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-db56e8e7-d1ea-49b3-86ac-0206b8140b7d None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:06:14.912670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-db56e8e7-d1ea-49b3-86ac-0206b8140b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:06:14.930021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:14.978726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 582/1179] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:06:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:06:15.002360 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4d8bd-c9eb-48cd-9647-6a9c02b5319f None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:15.012085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:15.101128 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4d8bd-c9eb-48cd-9647-6a9c02b5319f None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:15.133788 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3dbfc-a45c-4fa6-8b4d-e387fb41765d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:15.134596 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3dbfc-a45c-4fa6-8b4d-e387fb41765d None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:15.134881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3dbfc-a45c-4fa6-8b4d-e387fb41765d None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:15.135157 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3dbfc-a45c-4fa6-8b4d-e387fb41765d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:15.145234 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3dbfc-a45c-4fa6-8b4d-e387fb41765d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:06:15.153106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-43f3dbfc-a45c-4fa6-8b4d-e387fb41765d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:06:15.153106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:06:15.153106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:06:15.153106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:06:15.153106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:06:15.153106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:06:15.153106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:06:15.153106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:06:15.153106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:06:15.153106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:06:15.153106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:06:15.153106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:06:15.153106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:06:15.153106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:06:15.153106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:06:15.153106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:06:15.154325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:06:15.154325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:06:15.154325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:06:15.154325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:06:15.154325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:06:15.154325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:06:15.154325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:06:15.154325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:06:15.154325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:06:15.154325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:06:15.154325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:06:15.154325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:06:15.154325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:06:15.154325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:06:15.154325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:06:15.154325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:06:15.155608 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:06:15.155608 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:06:15.155608 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:06:15.155608 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:06:15.155608 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:06:15.155608 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:06:15.155608 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:06:15.155608 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:06:15.155608 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:06:15.155608 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:06:15.155608 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:06:15.155608 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:06:15.155608 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 598/1180] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:06:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:06:15.160206 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56e8e7-d1ea-49b3-86ac-0206b8140b7d None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:15.255579 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56e8e7-d1ea-49b3-86ac-0206b8140b7d None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:15.289527 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742e7cd-ddf3-47ca-aea4-dc8a03268d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:15.290230 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742e7cd-ddf3-47ca-aea4-dc8a03268d52 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:15.290519 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742e7cd-ddf3-47ca-aea4-dc8a03268d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:15.290797 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742e7cd-ddf3-47ca-aea4-dc8a03268d52 None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:15.291544 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742e7cd-ddf3-47ca-aea4-dc8a03268d52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:06:15.291859 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742e7cd-ddf3-47ca-aea4-dc8a03268d52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:06:15.293219 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742e7cd-ddf3-47ca-aea4-dc8a03268d52 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:06:15.301098 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 583/1181] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:06:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:06:15.307415 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3dbfc-a45c-4fa6-8b4d-e387fb41765d None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:15.370559 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:15.404448 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3dbfc-a45c-4fa6-8b4d-e387fb41765d None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:15.437176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853403f2-3dab-4d16-a308-e0c1a6bd5fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:15.438044 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853403f2-3dab-4d16-a308-e0c1a6bd5fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:15.438358 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853403f2-3dab-4d16-a308-e0c1a6bd5fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:15.438639 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853403f2-3dab-4d16-a308-e0c1a6bd5fc6 None admin] PATH_INFO: `/v3/users/44d1b2701ae54016a6534092ac2f8f66` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:15.451263 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853403f2-3dab-4d16-a308-e0c1a6bd5fc6 None admin] RBAC: Authorizing `identity:get_user(user_id=44d1b2701ae54016a6534092ac2f8f66)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:06:15.452710 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853403f2-3dab-4d16-a308-e0c1a6bd5fc6 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:06:15.454371 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 599/1182] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:06:15 2022] GET /identity/v3/users/44d1b2701ae54016a6534092ac2f8f66 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:06:15.460494 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742e7cd-ddf3-47ca-aea4-dc8a03268d52 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:15.479064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:15.557882 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742e7cd-ddf3-47ca-aea4-dc8a03268d52 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:15.589710 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbe1d3-25bc-4e51-a437-dd954d80ae7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:15.590378 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbe1d3-25bc-4e51-a437-dd954d80ae7a None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:15.590666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbe1d3-25bc-4e51-a437-dd954d80ae7a None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:15.590943 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbe1d3-25bc-4e51-a437-dd954d80ae7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:15.655195 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbbe1d3-25bc-4e51-a437-dd954d80ae7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:06:15.656623 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbbe1d3-25bc-4e51-a437-dd954d80ae7a None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:06:15.672984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:15.752724 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 584/1183] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:06:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:06:15.758788 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853403f2-3dab-4d16-a308-e0c1a6bd5fc6 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:15.856446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853403f2-3dab-4d16-a308-e0c1a6bd5fc6 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:15.879264 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:15.891431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40aebf-23c4-4448-a6ea-4db7a39713e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:15.892288 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40aebf-23c4-4448-a6ea-4db7a39713e6 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:15.892566 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40aebf-23c4-4448-a6ea-4db7a39713e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:15.892836 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40aebf-23c4-4448-a6ea-4db7a39713e6 None admin] PATH_INFO: `/v3/projects/e89b6cb084e14445bbfccf680d201b6c` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:15.893988 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40aebf-23c4-4448-a6ea-4db7a39713e6 None admin] RBAC: Authorizing `identity:get_project(project_id=e89b6cb084e14445bbfccf680d201b6c)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:06:15.896044 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40aebf-23c4-4448-a6ea-4db7a39713e6 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:06:15.897762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 600/1184] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:06:15 2022] GET /identity/v3/projects/e89b6cb084e14445bbfccf680d201b6c => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:06:15.903920 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbe1d3-25bc-4e51-a437-dd954d80ae7a None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:15.998196 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbe1d3-25bc-4e51-a437-dd954d80ae7a None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:16.014665 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:16.032711 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac29d9-77ea-4666-ab2d-2183b607ce53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:16.033353 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac29d9-77ea-4666-ab2d-2183b607ce53 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:16.033641 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac29d9-77ea-4666-ab2d-2183b607ce53 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:16.033919 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac29d9-77ea-4666-ab2d-2183b607ce53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:16.034771 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac29d9-77ea-4666-ab2d-2183b607ce53 None admin] RBAC: Adding query filter params (role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0, scope.project.id=e89b6cb084e14445bbfccf680d201b6c, user.id=44d1b2701ae54016a6534092ac2f8f66) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:06:16.035085 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac29d9-77ea-4666-ab2d-2183b607ce53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:06:16.036498 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac29d9-77ea-4666-ab2d-2183b607ce53 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:06:16.041765 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 585/1185] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:06:15 2022] GET /identity/v3/role_assignments?user.id=44d1b2701ae54016a6534092ac2f8f66&scope.project.id=e89b6cb084e14445bbfccf680d201b6c&role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:06:18.031441 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63e46f-1227-4b18-b8ac-94cac2ed1ea7 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:18.031992 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63e46f-1227-4b18-b8ac-94cac2ed1ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:18.031992 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63e46f-1227-4b18-b8ac-94cac2ed1ea7 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:18.033365 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 601/1186] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:06:18.038636 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69c08c-2348-4da0-ba35-b298ef2fa19e None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:18.039057 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69c08c-2348-4da0-ba35-b298ef2fa19e None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:18.039195 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69c08c-2348-4da0-ba35-b298ef2fa19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:18.055938 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-4f69c08c-2348-4da0-ba35-b298ef2fa19e None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:06:18.057102 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-4f69c08c-2348-4da0-ba35-b298ef2fa19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:06:18.121225 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 586/1187] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:06:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:06:18.143667 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63e46f-1227-4b18-b8ac-94cac2ed1ea7 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:18.242514 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63e46f-1227-4b18-b8ac-94cac2ed1ea7 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:18.275505 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10aba0-e623-4341-89ec-4defa52aa92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:18.276295 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10aba0-e623-4341-89ec-4defa52aa92e None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:18.276580 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10aba0-e623-4341-89ec-4defa52aa92e None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:18.276855 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10aba0-e623-4341-89ec-4defa52aa92e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:18.287622 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10aba0-e623-4341-89ec-4defa52aa92e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:06:18.295187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-0b10aba0-e623-4341-89ec-4defa52aa92e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:06:18.295187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:06:18.295187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:06:18.295187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:06:18.295187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:06:18.295187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:06:18.295187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:06:18.295187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:06:18.295187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:06:18.295187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:06:18.295187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:06:18.295187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:06:18.295187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:06:18.295187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:06:18.295187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:06:18.295187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:06:18.296276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:06:18.296276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:06:18.296276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:06:18.296276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:06:18.296276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:06:18.296276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:06:18.296276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:06:18.296276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:06:18.296276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:06:18.296276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:06:18.296276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:06:18.296276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:06:18.296276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:06:18.296276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:06:18.296276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:06:18.296276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:06:18.297424 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:06:18.297424 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:06:18.297424 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:06:18.297424 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:06:18.297424 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:06:18.297424 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:06:18.297424 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:06:18.297424 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:06:18.297424 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:06:18.297424 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:06:18.297424 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:06:18.297424 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:06:18.297424 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 602/1188] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:06:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:06:18.303046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69c08c-2348-4da0-ba35-b298ef2fa19e None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:18.418732 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69c08c-2348-4da0-ba35-b298ef2fa19e None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:18.429695 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:18.453169 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1853b-32c3-4327-b7eb-38b7ff4ca455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:18.453835 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1853b-32c3-4327-b7eb-38b7ff4ca455 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:18.454138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1853b-32c3-4327-b7eb-38b7ff4ca455 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:18.454440 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1853b-32c3-4327-b7eb-38b7ff4ca455 None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:18.455215 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1853b-32c3-4327-b7eb-38b7ff4ca455 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:06:18.455556 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1853b-32c3-4327-b7eb-38b7ff4ca455 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:06:18.457160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1853b-32c3-4327-b7eb-38b7ff4ca455 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:06:18.465705 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 587/1189] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:06:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:06:18.471425 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10aba0-e623-4341-89ec-4defa52aa92e None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:18.522906 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:18.568315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10aba0-e623-4341-89ec-4defa52aa92e None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:18.600631 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20868e9a-f89b-4482-9c0c-7aebe34bf5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:18.601488 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20868e9a-f89b-4482-9c0c-7aebe34bf5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:18.601766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20868e9a-f89b-4482-9c0c-7aebe34bf5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:18.602038 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20868e9a-f89b-4482-9c0c-7aebe34bf5e7 None admin] PATH_INFO: `/v3/users/44d1b2701ae54016a6534092ac2f8f66` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:18.603220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20868e9a-f89b-4482-9c0c-7aebe34bf5e7 None admin] RBAC: Authorizing `identity:get_user(user_id=44d1b2701ae54016a6534092ac2f8f66)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:06:18.604645 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20868e9a-f89b-4482-9c0c-7aebe34bf5e7 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:06:18.606277 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 603/1190] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:06:18 2022] GET /identity/v3/users/44d1b2701ae54016a6534092ac2f8f66 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:06:18.612245 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1853b-32c3-4327-b7eb-38b7ff4ca455 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:18.711148 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1853b-32c3-4327-b7eb-38b7ff4ca455 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:18.743567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500479e6-8c6b-42d7-8e29-b02f7877abe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:18.744424 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500479e6-8c6b-42d7-8e29-b02f7877abe3 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:18.744709 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500479e6-8c6b-42d7-8e29-b02f7877abe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:18.744986 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500479e6-8c6b-42d7-8e29-b02f7877abe3 None admin] PATH_INFO: `/v3/projects/e89b6cb084e14445bbfccf680d201b6c` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:18.746163 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500479e6-8c6b-42d7-8e29-b02f7877abe3 None admin] RBAC: Authorizing `identity:get_project(project_id=e89b6cb084e14445bbfccf680d201b6c)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:06:18.747590 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500479e6-8c6b-42d7-8e29-b02f7877abe3 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:06:18.749271 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 588/1191] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:06:18 2022] GET /identity/v3/projects/e89b6cb084e14445bbfccf680d201b6c => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:06:18.755776 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20868e9a-f89b-4482-9c0c-7aebe34bf5e7 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:18.851562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20868e9a-f89b-4482-9c0c-7aebe34bf5e7 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:18.870481 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:18.884180 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c477e-14fd-47fa-a99d-7dd83bc1a429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:18.885059 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c477e-14fd-47fa-a99d-7dd83bc1a429 None admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:18.885339 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c477e-14fd-47fa-a99d-7dd83bc1a429 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:18.885613 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c477e-14fd-47fa-a99d-7dd83bc1a429 None admin] PATH_INFO: `/v3/projects/e89b6cb084e14445bbfccf680d201b6c/users/44d1b2701ae54016a6534092ac2f8f66/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:18.887816 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c477e-14fd-47fa-a99d-7dd83bc1a429 None admin] RBAC: Authorizing `identity:create_grant(project_id=e89b6cb084e14445bbfccf680d201b6c, user_id=44d1b2701ae54016a6534092ac2f8f66, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:06:18.889233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c477e-14fd-47fa-a99d-7dd83bc1a429 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:06:18.901438 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 604/1192] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Jul 12 13:06:18 2022] PUT /identity/v3/projects/e89b6cb084e14445bbfccf680d201b6c/users/44d1b2701ae54016a6534092ac2f8f66/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:06:20.866707 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413979f-0580-4069-ac31-285b55315e97 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:20.867230 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413979f-0580-4069-ac31-285b55315e97 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:20.867334 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413979f-0580-4069-ac31-285b55315e97 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:20.868656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 589/1193] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:06:20.873856 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6684d8-d81e-472c-9a60-d008ca5e1439 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:20.874277 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6684d8-d81e-472c-9a60-d008ca5e1439 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:20.874438 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6684d8-d81e-472c-9a60-d008ca5e1439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:20.891474 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-fe6684d8-d81e-472c-9a60-d008ca5e1439 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:06:20.892648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-fe6684d8-d81e-472c-9a60-d008ca5e1439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:06:20.957006 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 605/1194] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:06:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:06:20.979784 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413979f-0580-4069-ac31-285b55315e97 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:21.023738 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:21.079866 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413979f-0580-4069-ac31-285b55315e97 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:21.111777 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e000b1a-1054-4c51-91a5-898a7354e613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:21.112603 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e000b1a-1054-4c51-91a5-898a7354e613 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:21.112888 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e000b1a-1054-4c51-91a5-898a7354e613 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:21.113163 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e000b1a-1054-4c51-91a5-898a7354e613 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:21.123439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e000b1a-1054-4c51-91a5-898a7354e613 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:06:21.130988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-5e000b1a-1054-4c51-91a5-898a7354e613 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:06:21.130988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:06:21.130988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:06:21.130988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:06:21.130988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:06:21.130988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:06:21.130988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:06:21.130988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:06:21.130988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:06:21.130988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:06:21.130988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:06:21.130988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:06:21.130988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:06:21.130988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:06:21.130988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:06:21.130988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:06:21.132064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:06:21.132064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:06:21.132064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:06:21.132064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:06:21.132064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:06:21.132064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:06:21.132064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:06:21.132064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:06:21.132064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:06:21.132064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:06:21.132064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:06:21.132064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:06:21.132064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:06:21.132064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:06:21.132064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:06:21.132064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:06:21.133282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:06:21.133282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:06:21.133282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:06:21.133282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:06:21.133282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:06:21.133282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:06:21.133282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:06:21.133282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:06:21.133282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:06:21.133282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:06:21.133282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:06:21.133282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:06:21.133282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 590/1195] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:06:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:06:21.138462 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6684d8-d81e-472c-9a60-d008ca5e1439 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:21.234140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6684d8-d81e-472c-9a60-d008ca5e1439 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:21.244865 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:21.268162 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965354c-cf6c-4627-9444-2a9327053f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:21.268825 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965354c-cf6c-4627-9444-2a9327053f4f None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:21.269111 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965354c-cf6c-4627-9444-2a9327053f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:21.269388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965354c-cf6c-4627-9444-2a9327053f4f None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:21.270189 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965354c-cf6c-4627-9444-2a9327053f4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:06:21.270505 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965354c-cf6c-4627-9444-2a9327053f4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:06:21.271863 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965354c-cf6c-4627-9444-2a9327053f4f None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:06:21.279637 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 606/1196] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:06:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:06:21.285258 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e000b1a-1054-4c51-91a5-898a7354e613 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:21.380720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:21.383594 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e000b1a-1054-4c51-91a5-898a7354e613 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:21.418419 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a111dda-15d5-430c-9222-5f98ed084c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:21.419289 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a111dda-15d5-430c-9222-5f98ed084c3c None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:21.419574 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a111dda-15d5-430c-9222-5f98ed084c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:21.419852 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a111dda-15d5-430c-9222-5f98ed084c3c None admin] PATH_INFO: `/v3/users/44d1b2701ae54016a6534092ac2f8f66` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:21.421029 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a111dda-15d5-430c-9222-5f98ed084c3c None admin] RBAC: Authorizing `identity:get_user(user_id=44d1b2701ae54016a6534092ac2f8f66)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:06:21.422483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a111dda-15d5-430c-9222-5f98ed084c3c None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:06:21.424106 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 591/1197] 10.222.0.17 () {56 vars in 1177 bytes} [Tue Jul 12 13:06:21 2022] GET /identity/v3/users/44d1b2701ae54016a6534092ac2f8f66 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:06:21.430500 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965354c-cf6c-4627-9444-2a9327053f4f None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:21.528562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965354c-cf6c-4627-9444-2a9327053f4f None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:21.561551 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb8055-9b42-49ff-bcd0-140ffa577730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:21.562222 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb8055-9b42-49ff-bcd0-140ffa577730 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:21.562507 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb8055-9b42-49ff-bcd0-140ffa577730 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:21.562782 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb8055-9b42-49ff-bcd0-140ffa577730 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:21.607628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:21.633857 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb8055-9b42-49ff-bcd0-140ffa577730 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:06:21.635358 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb8055-9b42-49ff-bcd0-140ffa577730 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:06:21.734071 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 607/1198] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:06:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:06:21.739886 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a111dda-15d5-430c-9222-5f98ed084c3c None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:21.835702 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a111dda-15d5-430c-9222-5f98ed084c3c None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:21.868147 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700ae6b-9018-4215-afa4-5090b22461f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:21.868999 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700ae6b-9018-4215-afa4-5090b22461f7 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:21.869284 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700ae6b-9018-4215-afa4-5090b22461f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:21.869559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700ae6b-9018-4215-afa4-5090b22461f7 None admin] PATH_INFO: `/v3/projects/e89b6cb084e14445bbfccf680d201b6c` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:21.870741 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700ae6b-9018-4215-afa4-5090b22461f7 None admin] RBAC: Authorizing `identity:get_project(project_id=e89b6cb084e14445bbfccf680d201b6c)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:06:21.872153 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700ae6b-9018-4215-afa4-5090b22461f7 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:06:21.873815 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 592/1199] 10.222.0.17 () {56 vars in 1186 bytes} [Tue Jul 12 13:06:21 2022] GET /identity/v3/projects/e89b6cb084e14445bbfccf680d201b6c => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:06:21.880266 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb8055-9b42-49ff-bcd0-140ffa577730 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:06:21.946802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:21.975843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb8055-9b42-49ff-bcd0-140ffa577730 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:06:22.010100 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d605417-6feb-466b-8ce9-8583239ab617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:06:22.011043 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d605417-6feb-466b-8ce9-8583239ab617 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:06:22.011328 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d605417-6feb-466b-8ce9-8583239ab617 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:06:22.011602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d605417-6feb-466b-8ce9-8583239ab617 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:06:22.012465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d605417-6feb-466b-8ce9-8583239ab617 None admin] RBAC: Adding query filter params (role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0, scope.project.id=e89b6cb084e14445bbfccf680d201b6c, user.id=44d1b2701ae54016a6534092ac2f8f66) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:06:22.012861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d605417-6feb-466b-8ce9-8583239ab617 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:06:22.014321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d605417-6feb-466b-8ce9-8583239ab617 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:06:22.021563 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 608/1200] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:06:21 2022] GET /identity/v3/role_assignments?user.id=44d1b2701ae54016a6534092ac2f8f66&scope.project.id=e89b6cb084e14445bbfccf680d201b6c&role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:06:31.864174 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=82 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:06:32.017877 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=32 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:17.265688 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1998282-ec79-492d-a098-738ca2abf193 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:17.266865 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1998282-ec79-492d-a098-738ca2abf193 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:17.266865 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1998282-ec79-492d-a098-738ca2abf193 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:17.268046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 593/1201] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:07:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:07:17.273591 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74313f-aa78-4507-abe1-5bc1418094aa None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:17.274070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74313f-aa78-4507-abe1-5bc1418094aa None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:17.274198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74313f-aa78-4507-abe1-5bc1418094aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:17.292729 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-1e74313f-aa78-4507-abe1-5bc1418094aa None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:07:17.294020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-1e74313f-aa78-4507-abe1-5bc1418094aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:07:17.387304 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 609/1202] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:07:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:07:17.416955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1998282-ec79-492d-a098-738ca2abf193 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:17.548013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1998282-ec79-492d-a098-738ca2abf193 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:17.586376 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794b7ea-ff38-4303-95fb-4a2f7bb789bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:17.587253 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794b7ea-ff38-4303-95fb-4a2f7bb789bd None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:17.587562 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794b7ea-ff38-4303-95fb-4a2f7bb789bd None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:17.587849 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794b7ea-ff38-4303-95fb-4a2f7bb789bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:17.601551 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794b7ea-ff38-4303-95fb-4a2f7bb789bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:17.603687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794b7ea-ff38-4303-95fb-4a2f7bb789bd None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:17.627313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-a794b7ea-ff38-4303-95fb-4a2f7bb789bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:07:17.627313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:17.627313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:17.627313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:17.627313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:17.627313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:17.627313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:17.627313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:17.627313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:17.627313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:17.627313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:17.627313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:17.627313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:07:17.627313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:07:17.627313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:07:17.628381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:07:17.628381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:17.628381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:17.628381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:17.628381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:17.628381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:17.628381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:17.628381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:17.628381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:17.628381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:17.628381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:17.628381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:17.628381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:17.628381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:17.628381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:17.628381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:17.628381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:17.629376 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:07:17.629376 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:07:17.629376 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:07:17.629376 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:07:17.629376 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 594/1203] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:07:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:17.635172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74313f-aa78-4507-abe1-5bc1418094aa None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:17.788810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74313f-aa78-4507-abe1-5bc1418094aa None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:17.830432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:17.837982 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144582e-6cbe-4ae7-8f83-b71e02e3fcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:17.838762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144582e-6cbe-4ae7-8f83-b71e02e3fcb7 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:17.839054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144582e-6cbe-4ae7-8f83-b71e02e3fcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:17.839403 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144582e-6cbe-4ae7-8f83-b71e02e3fcb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:17.840736 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144582e-6cbe-4ae7-8f83-b71e02e3fcb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:17.841527 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144582e-6cbe-4ae7-8f83-b71e02e3fcb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:17.843402 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144582e-6cbe-4ae7-8f83-b71e02e3fcb7 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:17.862995 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 610/1204] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:07:17.869271 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794b7ea-ff38-4303-95fb-4a2f7bb789bd None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:17.943227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:17.999231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794b7ea-ff38-4303-95fb-4a2f7bb789bd None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:18.046822 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47eee91-9461-4962-bec0-b9175ccaf237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:18.047580 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47eee91-9461-4962-bec0-b9175ccaf237 None admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:18.047887 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47eee91-9461-4962-bec0-b9175ccaf237 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:18.048222 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47eee91-9461-4962-bec0-b9175ccaf237 None admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:18.048987 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47eee91-9461-4962-bec0-b9175ccaf237 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:18.050539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47eee91-9461-4962-bec0-b9175ccaf237 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:18.074947 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 595/1205] 10.222.0.17 () {60 vars in 1132 bytes} [Tue Jul 12 13:07:17 2022] POST /identity/v3/users => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:07:20.371967 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab457a-0c7d-468d-acc6-27bf057894c6 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:20.372523 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab457a-0c7d-468d-acc6-27bf057894c6 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:20.372523 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab457a-0c7d-468d-acc6-27bf057894c6 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:20.373921 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 611/1206] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:07:20.382379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46313d-5959-4606-a624-43b82c1170cc None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:20.382835 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46313d-5959-4606-a624-43b82c1170cc None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:20.382993 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46313d-5959-4606-a624-43b82c1170cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:20.404754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-7f46313d-5959-4606-a624-43b82c1170cc None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:07:20.406022 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-7f46313d-5959-4606-a624-43b82c1170cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:07:20.492240 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 596/1207] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:07:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:07:20.519274 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab457a-0c7d-468d-acc6-27bf057894c6 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:20.654574 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab457a-0c7d-468d-acc6-27bf057894c6 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:20.699686 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e536300-7cef-48a7-9b25-3c9b1954dbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:20.700637 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e536300-7cef-48a7-9b25-3c9b1954dbe8 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:20.700941 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e536300-7cef-48a7-9b25-3c9b1954dbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:20.701355 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e536300-7cef-48a7-9b25-3c9b1954dbe8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:20.712443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e536300-7cef-48a7-9b25-3c9b1954dbe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:07:20.721648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-4e536300-7cef-48a7-9b25-3c9b1954dbe8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:07:20.721648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:20.721648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:20.721648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:20.721648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:20.721648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:20.721648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:20.721648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:20.721648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:20.721648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:20.721648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:20.721648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:20.721648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:07:20.721648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:07:20.721648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:07:20.721648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:07:20.722878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:07:20.722878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:07:20.722878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:07:20.722878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:07:20.722878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:20.722878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:20.722878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:20.722878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:20.722878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:20.722878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:20.722878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:20.722878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:20.722878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:20.722878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:20.722878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:20.722878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:20.723905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:20.723905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:20.723905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:20.723905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:20.723905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:07:20.723905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:07:20.723905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:07:20.723905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:07:20.723905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:07:20.723905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:07:20.723905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:07:20.723905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:07:20.723905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 612/1208] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Jul 12 13:07:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:20.728930 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46313d-5959-4606-a624-43b82c1170cc None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:20.777740 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:20.861176 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46313d-5959-4606-a624-43b82c1170cc None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:20.905213 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d75f4b-b84b-4fd2-bc97-f0143046ec4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:20.905855 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d75f4b-b84b-4fd2-bc97-f0143046ec4a None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:20.906156 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d75f4b-b84b-4fd2-bc97-f0143046ec4a None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:20.906469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d75f4b-b84b-4fd2-bc97-f0143046ec4a None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:20.907255 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d75f4b-b84b-4fd2-bc97-f0143046ec4a None admin] RBAC: Adding query filter params (name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:20.907560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d75f4b-b84b-4fd2-bc97-f0143046ec4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:20.909037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d75f4b-b84b-4fd2-bc97-f0143046ec4a None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:20.918017 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 597/1209] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Jul 12 13:07:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:20.924468 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e536300-7cef-48a7-9b25-3c9b1954dbe8 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:20.986870 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:21.047918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e536300-7cef-48a7-9b25-3c9b1954dbe8 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:21.091792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c37fd-1a10-4e5e-b60d-47949ec45743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:21.092655 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c37fd-1a10-4e5e-b60d-47949ec45743 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:21.092924 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c37fd-1a10-4e5e-b60d-47949ec45743 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:21.093290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c37fd-1a10-4e5e-b60d-47949ec45743 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:21.106191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c37fd-1a10-4e5e-b60d-47949ec45743 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:21.107887 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c37fd-1a10-4e5e-b60d-47949ec45743 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:21.128934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-877c37fd-1a10-4e5e-b60d-47949ec45743 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:07:21.128934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:21.128934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:21.128934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:21.128934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:21.128934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:21.128934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:21.128934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:21.128934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:21.128934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:21.128934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:21.128934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:21.128934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:07:21.128934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:07:21.128934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:07:21.130483 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:07:21.130483 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:21.130483 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:21.130483 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:21.130483 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:21.130483 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:21.130483 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:21.130483 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:21.130483 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:21.130483 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:21.130483 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:21.130483 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:21.130483 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:21.130483 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:21.130483 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:21.130483 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:21.130483 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:21.131974 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:07:21.131974 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:07:21.131974 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:07:21.131974 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:07:21.131974 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 613/1210] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:07:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:07:21.136632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d75f4b-b84b-4fd2-bc97-f0143046ec4a None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:21.244917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:21.248379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d75f4b-b84b-4fd2-bc97-f0143046ec4a None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:21.298371 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4170c-c29a-4c78-bdef-c3817f67a459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:21.299167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4170c-c29a-4c78-bdef-c3817f67a459 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:21.299437 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4170c-c29a-4c78-bdef-c3817f67a459 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:21.299717 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4170c-c29a-4c78-bdef-c3817f67a459 None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:21.300533 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4170c-c29a-4c78-bdef-c3817f67a459 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:21.300841 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4170c-c29a-4c78-bdef-c3817f67a459 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:21.302473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4170c-c29a-4c78-bdef-c3817f67a459 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:21.316676 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 598/1211] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:07:21.323433 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c37fd-1a10-4e5e-b60d-47949ec45743 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:21.452050 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c37fd-1a10-4e5e-b60d-47949ec45743 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:21.453886 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:21.491773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657ea79-79b9-41fa-acd2-b439181892f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:21.492586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657ea79-79b9-41fa-acd2-b439181892f9 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:21.492896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657ea79-79b9-41fa-acd2-b439181892f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:21.493164 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657ea79-79b9-41fa-acd2-b439181892f9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:21.502182 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657ea79-79b9-41fa-acd2-b439181892f9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:21.503653 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657ea79-79b9-41fa-acd2-b439181892f9 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:21.521479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-e657ea79-79b9-41fa-acd2-b439181892f9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 13:07:21.521479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:21.521479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:21.521479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:21.521479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:21.521479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:21.521479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:21.521479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:21.521479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:21.521479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:21.521479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:21.521479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:21.521479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:07:21.521479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:07:21.521479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:07:21.521479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:07:21.522810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:21.522810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:21.522810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:07:21.522810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:07:21.522810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:07:21.522810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:07:21.522810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:21.522810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:21.522810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:21.522810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:21.522810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:21.522810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:21.522810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:21.522810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:21.522810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:21.522810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:21.522810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:21.522810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:21.523864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:21.523864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:21.523864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:07:21.523864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:07:21.523864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:07:21.523864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:07:21.523864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:07:21.523864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:07:21.523864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 13:07:21.523864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:07:21.523864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 614/1212] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:07:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:21.528710 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4170c-c29a-4c78-bdef-c3817f67a459 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:21.659115 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4170c-c29a-4c78-bdef-c3817f67a459 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:21.699810 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfe9e2-3eeb-45e5-a84c-8a7ecbbe6f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:21.700516 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfe9e2-3eeb-45e5-a84c-8a7ecbbe6f57 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:21.700782 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfe9e2-3eeb-45e5-a84c-8a7ecbbe6f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:21.701063 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfe9e2-3eeb-45e5-a84c-8a7ecbbe6f57 None admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:21.701923 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfe9e2-3eeb-45e5-a84c-8a7ecbbe6f57 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:21.702301 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfe9e2-3eeb-45e5-a84c-8a7ecbbe6f57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:21.703673 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfe9e2-3eeb-45e5-a84c-8a7ecbbe6f57 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:21.726176 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 599/1213] 10.222.0.17 () {56 vars in 1143 bytes} [Tue Jul 12 13:07:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:07:21.727449 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657ea79-79b9-41fa-acd2-b439181892f9 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:21.852376 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657ea79-79b9-41fa-acd2-b439181892f9 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:21.890934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca6c73-3359-478f-9e76-2992a833a50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:21.893037 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca6c73-3359-478f-9e76-2992a833a50b None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:21.893037 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca6c73-3359-478f-9e76-2992a833a50b None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:21.893037 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca6c73-3359-478f-9e76-2992a833a50b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:21.926466 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:21.969512 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca6c73-3359-478f-9e76-2992a833a50b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:21.971120 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca6c73-3359-478f-9e76-2992a833a50b None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:22.076536 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 615/1214] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:07:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 13:07:22.082372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfe9e2-3eeb-45e5-a84c-8a7ecbbe6f57 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:22.103432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:22.188386 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfe9e2-3eeb-45e5-a84c-8a7ecbbe6f57 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:22.224863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e8ebb-cc59-40e9-b76e-0565e442593f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:22.225669 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e8ebb-cc59-40e9-b76e-0565e442593f None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:22.225954 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e8ebb-cc59-40e9-b76e-0565e442593f None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:22.226262 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e8ebb-cc59-40e9-b76e-0565e442593f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:22.236849 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e8ebb-cc59-40e9-b76e-0565e442593f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:22.238345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e8ebb-cc59-40e9-b76e-0565e442593f None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:22.262995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-156e8ebb-cc59-40e9-b76e-0565e442593f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:07:22.262995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:22.262995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:22.262995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:22.262995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:22.262995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:22.262995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:22.262995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:22.262995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:22.262995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:22.262995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:22.262995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:22.262995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:07:22.262995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:07:22.262995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:07:22.264205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:07:22.264205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:22.264205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:22.264205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:22.264205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:22.264205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:22.264205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:22.264205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:22.264205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:22.264205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:22.264205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:22.264205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:22.264205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:22.264205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:22.264205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:22.264205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:22.264205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:22.265363 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:07:22.265363 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:07:22.265363 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:07:22.265363 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:07:22.269409 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 600/1215] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:07:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:22.270435 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca6c73-3359-478f-9e76-2992a833a50b None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:22.340099 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:22.382654 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca6c73-3359-478f-9e76-2992a833a50b None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:22.423628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5e841-88a5-4130-8e0c-c11b89e6c2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:22.424521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5e841-88a5-4130-8e0c-c11b89e6c2b5 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:22.424921 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5e841-88a5-4130-8e0c-c11b89e6c2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:22.425297 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5e841-88a5-4130-8e0c-c11b89e6c2b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:22.426102 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5e841-88a5-4130-8e0c-c11b89e6c2b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:22.426627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5e841-88a5-4130-8e0c-c11b89e6c2b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:22.428116 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5e841-88a5-4130-8e0c-c11b89e6c2b5 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:22.443636 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 616/1216] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:22.449581 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e8ebb-cc59-40e9-b76e-0565e442593f None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:22.531870 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:22.568649 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e8ebb-cc59-40e9-b76e-0565e442593f None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:22.615886 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9839de-6f5f-43e2-ad8b-15f21d7eb54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:22.616878 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9839de-6f5f-43e2-ad8b-15f21d7eb54c None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:22.617254 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9839de-6f5f-43e2-ad8b-15f21d7eb54c None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:22.617634 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9839de-6f5f-43e2-ad8b-15f21d7eb54c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:22.625109 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9839de-6f5f-43e2-ad8b-15f21d7eb54c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:22.626776 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9839de-6f5f-43e2-ad8b-15f21d7eb54c None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:22.642863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-1f9839de-6f5f-43e2-ad8b-15f21d7eb54c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:07:22.642863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:22.642863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:22.642863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:22.642863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:22.642863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:22.642863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:22.642863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:22.642863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:22.642863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:22.642863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:22.642863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:22.642863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:07:22.642863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:07:22.642863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:07:22.644031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:07:22.644031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:22.644031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:22.644031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:22.644031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:22.644031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:22.644031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:22.644031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:22.644031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:22.644031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:22.644031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:22.644031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:22.644031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:22.644031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:22.644031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:22.644031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:22.644031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:22.645164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:07:22.645164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:07:22.645164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:07:22.645164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:07:22.645164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:07:22.645164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:07:22.645164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:07:22.645164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:07:22.647318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 601/1217] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:07:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:22.652901 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5e841-88a5-4130-8e0c-c11b89e6c2b5 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:22.759573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5e841-88a5-4130-8e0c-c11b89e6c2b5 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:22.787392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:22.802871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762b012-4d89-4348-952f-e68be26e05af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:22.803575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762b012-4d89-4348-952f-e68be26e05af None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:22.803865 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762b012-4d89-4348-952f-e68be26e05af None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:22.804155 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762b012-4d89-4348-952f-e68be26e05af None admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:22.804949 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762b012-4d89-4348-952f-e68be26e05af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:22.805266 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762b012-4d89-4348-952f-e68be26e05af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:22.806745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762b012-4d89-4348-952f-e68be26e05af None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:22.820839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 617/1218] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:07:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:22.826825 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9839de-6f5f-43e2-ad8b-15f21d7eb54c None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:22.949272 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9839de-6f5f-43e2-ad8b-15f21d7eb54c None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:22.980039 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:22.987976 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4014260-f2ab-4328-a7b4-cc80fd4f359c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:22.988973 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4014260-f2ab-4328-a7b4-cc80fd4f359c None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:22.990018 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4014260-f2ab-4328-a7b4-cc80fd4f359c None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:22.990495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4014260-f2ab-4328-a7b4-cc80fd4f359c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:22.991607 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4014260-f2ab-4328-a7b4-cc80fd4f359c None admin] RBAC: Adding query filter params (role.id=88426002bf1b40c0b59071eaaba38530, scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2, user.id=698828dd940f46e2b493ba55cd894eac) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:22.992231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4014260-f2ab-4328-a7b4-cc80fd4f359c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:22.993981 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4014260-f2ab-4328-a7b4-cc80fd4f359c None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:23.000838 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 602/1219] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:07:22 2022] GET /identity/v3/role_assignments?user.id=698828dd940f46e2b493ba55cd894eac&scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2&role.id=88426002bf1b40c0b59071eaaba38530 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:25.154928 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77649cac-0b93-4214-ba49-5f0c718a9bb7 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:25.155462 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77649cac-0b93-4214-ba49-5f0c718a9bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:25.155574 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77649cac-0b93-4214-ba49-5f0c718a9bb7 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:25.156850 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 618/1220] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:07:25.162773 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9307dd1-cff6-47f3-859c-8ff49304ac75 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:25.163200 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9307dd1-cff6-47f3-859c-8ff49304ac75 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:25.163348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9307dd1-cff6-47f3-859c-8ff49304ac75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:25.181731 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-a9307dd1-cff6-47f3-859c-8ff49304ac75 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:07:25.183068 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-a9307dd1-cff6-47f3-859c-8ff49304ac75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:07:25.256513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 603/1221] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:07:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:07:25.279506 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77649cac-0b93-4214-ba49-5f0c718a9bb7 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:25.384344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77649cac-0b93-4214-ba49-5f0c718a9bb7 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:25.425180 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea619b0-b47a-4ede-b752-04afe3b0588b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:25.426147 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea619b0-b47a-4ede-b752-04afe3b0588b None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:25.426445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea619b0-b47a-4ede-b752-04afe3b0588b None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:25.426765 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea619b0-b47a-4ede-b752-04afe3b0588b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:25.441416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea619b0-b47a-4ede-b752-04afe3b0588b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:07:25.452132 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-3ea619b0-b47a-4ede-b752-04afe3b0588b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:07:25.452132 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:25.452132 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:25.452132 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:25.452132 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:25.452132 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:25.452132 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:25.452132 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:25.452132 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:25.452132 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:25.452132 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:25.452132 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:25.452132 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:07:25.452132 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:07:25.452132 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:07:25.452132 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:07:25.453388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:07:25.453388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:07:25.453388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:07:25.453388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:07:25.453388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:25.453388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:25.453388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:25.453388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:25.453388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:25.453388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:25.453388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:25.453388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:25.453388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:25.453388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:25.453388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:25.453388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:25.454298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:25.454298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:25.454298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:25.454298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:25.454298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:07:25.454298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:07:25.454298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:07:25.454298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:07:25.454298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:07:25.454298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:07:25.454298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:07:25.454298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:07:25.454298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 619/1222] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Jul 12 13:07:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:25.460262 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9307dd1-cff6-47f3-859c-8ff49304ac75 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:25.568735 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9307dd1-cff6-47f3-859c-8ff49304ac75 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:25.594348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:25.605403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34245051-6cf3-4c34-b293-3883694f6f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:25.606178 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34245051-6cf3-4c34-b293-3883694f6f7f None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:25.606471 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34245051-6cf3-4c34-b293-3883694f6f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:25.606753 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34245051-6cf3-4c34-b293-3883694f6f7f None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:25.607497 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34245051-6cf3-4c34-b293-3883694f6f7f None admin] RBAC: Adding query filter params (name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:25.607808 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34245051-6cf3-4c34-b293-3883694f6f7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:25.609177 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34245051-6cf3-4c34-b293-3883694f6f7f None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:25.618738 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 604/1223] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Jul 12 13:07:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:07:25.624614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea619b0-b47a-4ede-b752-04afe3b0588b None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:25.680100 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:25.739684 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea619b0-b47a-4ede-b752-04afe3b0588b None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:25.779384 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc8401-b565-4926-84f6-e7c514565c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:25.780173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc8401-b565-4926-84f6-e7c514565c5b None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:25.780462 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc8401-b565-4926-84f6-e7c514565c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:25.780736 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc8401-b565-4926-84f6-e7c514565c5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:25.792350 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc8401-b565-4926-84f6-e7c514565c5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:25.794079 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc8401-b565-4926-84f6-e7c514565c5b None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:25.813259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-38cc8401-b565-4926-84f6-e7c514565c5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:07:25.813259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:25.813259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:25.813259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:25.813259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:25.813259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:25.813259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:25.813259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:25.813259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:25.813259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:25.813259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:25.813259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:25.813259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:07:25.813259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:07:25.813259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:07:25.814606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:07:25.814606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:25.814606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:25.814606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:25.814606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:25.814606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:25.814606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:25.814606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:25.814606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:25.814606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:25.814606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:25.814606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:25.814606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:25.814606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:25.814606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:25.814606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:25.814606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:25.815585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:07:25.815585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:07:25.815585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:07:25.815585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:07:25.815585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 620/1224] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:07:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:25.821587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34245051-6cf3-4c34-b293-3883694f6f7f None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:25.938893 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34245051-6cf3-4c34-b293-3883694f6f7f None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:25.975923 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebfb87-fe98-452d-a7b9-146adb992cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:25.976600 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebfb87-fe98-452d-a7b9-146adb992cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:25.976890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebfb87-fe98-452d-a7b9-146adb992cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:25.977174 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebfb87-fe98-452d-a7b9-146adb992cb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:25.977894 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebfb87-fe98-452d-a7b9-146adb992cb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:25.978236 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebfb87-fe98-452d-a7b9-146adb992cb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:25.979678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebfb87-fe98-452d-a7b9-146adb992cb3 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:25.992736 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 605/1225] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:25.998938 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc8401-b565-4926-84f6-e7c514565c5b None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:26.108857 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:26.116030 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc8401-b565-4926-84f6-e7c514565c5b None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:26.152950 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61e6c8-6954-4c6e-9faf-a37603be28c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:26.153841 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61e6c8-6954-4c6e-9faf-a37603be28c0 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:26.154214 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61e6c8-6954-4c6e-9faf-a37603be28c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:26.154551 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61e6c8-6954-4c6e-9faf-a37603be28c0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:26.162907 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61e6c8-6954-4c6e-9faf-a37603be28c0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:26.164348 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61e6c8-6954-4c6e-9faf-a37603be28c0 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:26.181422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-1d61e6c8-6954-4c6e-9faf-a37603be28c0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 13:07:26.181422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:26.181422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:26.181422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:26.181422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:26.181422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:26.181422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:26.181422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:26.181422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:26.181422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:26.181422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:26.181422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:26.181422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:07:26.181422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:07:26.181422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:07:26.181422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:07:26.182501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:26.182501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:26.182501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:07:26.182501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:07:26.182501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:07:26.182501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:07:26.182501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:26.182501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:26.182501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:26.182501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:26.182501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:26.182501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:26.182501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:26.182501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:26.182501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:26.182501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:26.182501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:26.182501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:26.183474 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:26.183474 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:26.183474 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:07:26.183474 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:07:26.183474 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:07:26.183474 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:07:26.183474 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:07:26.183474 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:07:26.183474 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 13:07:26.183474 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:07:26.183474 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 621/1226] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:07:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:07:26.189565 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebfb87-fe98-452d-a7b9-146adb992cb3 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:26.240431 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:26.296290 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebfb87-fe98-452d-a7b9-146adb992cb3 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:26.335746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362da7d-bb45-4e91-a3f6-49560c1caab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:26.336657 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362da7d-bb45-4e91-a3f6-49560c1caab5 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:26.336996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362da7d-bb45-4e91-a3f6-49560c1caab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:26.337381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362da7d-bb45-4e91-a3f6-49560c1caab5 None admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:26.338537 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362da7d-bb45-4e91-a3f6-49560c1caab5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:26.338853 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362da7d-bb45-4e91-a3f6-49560c1caab5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:26.340534 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362da7d-bb45-4e91-a3f6-49560c1caab5 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:26.360380 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 606/1227] 10.222.0.17 () {56 vars in 1143 bytes} [Tue Jul 12 13:07:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:26.367990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61e6c8-6954-4c6e-9faf-a37603be28c0 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:26.489855 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61e6c8-6954-4c6e-9faf-a37603be28c0 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:26.526233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f7ebf-83e5-4af0-9c0b-6048d946d279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:26.527060 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f7ebf-83e5-4af0-9c0b-6048d946d279 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:26.527361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f7ebf-83e5-4af0-9c0b-6048d946d279 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:26.527623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f7ebf-83e5-4af0-9c0b-6048d946d279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:26.539201 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f7ebf-83e5-4af0-9c0b-6048d946d279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:26.540655 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f7ebf-83e5-4af0-9c0b-6048d946d279 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:26.558789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-5e5f7ebf-83e5-4af0-9c0b-6048d946d279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:07:26.558789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:26.558789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:26.558789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:26.558789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:26.558789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:26.558789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:26.558789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:26.558789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:26.558789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:26.558789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:26.558789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:26.558789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:07:26.558789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:07:26.558789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:07:26.559879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:07:26.559879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:26.559879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:26.559879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:26.559879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:26.559879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:26.559879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:26.559879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:26.559879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:26.559879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:26.559879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:26.559879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:26.559879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:26.559879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:26.559879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:26.559879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:26.559879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:26.568090 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:07:26.568090 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:07:26.568090 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:07:26.568090 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:07:26.568090 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 622/1228] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:07:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:26.568636 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362da7d-bb45-4e91-a3f6-49560c1caab5 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:26.689918 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362da7d-bb45-4e91-a3f6-49560c1caab5 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:26.692776 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:26.731121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78b1cd-ed35-432d-a82c-5f9b495f5682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:26.731791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78b1cd-ed35-432d-a82c-5f9b495f5682 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:26.732080 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78b1cd-ed35-432d-a82c-5f9b495f5682 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:26.732357 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78b1cd-ed35-432d-a82c-5f9b495f5682 None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:26.733077 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78b1cd-ed35-432d-a82c-5f9b495f5682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:26.733385 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78b1cd-ed35-432d-a82c-5f9b495f5682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:26.734880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78b1cd-ed35-432d-a82c-5f9b495f5682 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:26.746551 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 607/1229] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:26.752614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f7ebf-83e5-4af0-9c0b-6048d946d279 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:26.762619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:26.865657 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f7ebf-83e5-4af0-9c0b-6048d946d279 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:26.900135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f2d8a-27ff-4a9b-9427-b6b4c1ea3edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:26.900942 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f2d8a-27ff-4a9b-9427-b6b4c1ea3edd None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:26.901250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f2d8a-27ff-4a9b-9427-b6b4c1ea3edd None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:26.901505 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f2d8a-27ff-4a9b-9427-b6b4c1ea3edd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:26.908199 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f2d8a-27ff-4a9b-9427-b6b4c1ea3edd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:26.909611 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f2d8a-27ff-4a9b-9427-b6b4c1ea3edd None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:26.924409 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-4b9f2d8a-27ff-4a9b-9427-b6b4c1ea3edd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:07:26.924409 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:26.924409 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:26.924409 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:26.924409 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:26.924409 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:26.924409 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:26.924409 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:26.924409 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:26.924409 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:26.924409 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:26.924409 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:26.924409 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:07:26.924409 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:07:26.924409 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:07:26.925600 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:07:26.925600 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:26.925600 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:26.925600 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:26.925600 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:26.925600 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:26.925600 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:26.925600 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:26.925600 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:26.925600 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:26.925600 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:26.925600 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:26.925600 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:26.925600 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:26.925600 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:26.925600 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:26.925600 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:26.926599 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:07:26.926599 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:07:26.926599 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:07:26.926599 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:07:26.926599 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:07:26.926599 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:07:26.926599 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:07:26.926599 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:07:26.926599 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 623/1230] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:07:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:26.931736 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78b1cd-ed35-432d-a82c-5f9b495f5682 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:27.046252 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78b1cd-ed35-432d-a82c-5f9b495f5682 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:27.081316 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0e1ee-5275-4156-a55b-96e0a7b0d053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:27.081993 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0e1ee-5275-4156-a55b-96e0a7b0d053 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:27.082312 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0e1ee-5275-4156-a55b-96e0a7b0d053 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:27.082595 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0e1ee-5275-4156-a55b-96e0a7b0d053 None admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:27.083970 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0e1ee-5275-4156-a55b-96e0a7b0d053 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:27.084272 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0e1ee-5275-4156-a55b-96e0a7b0d053 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:27.085703 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0e1ee-5275-4156-a55b-96e0a7b0d053 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:27.098650 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 608/1231] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:07:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:07:27.104909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f2d8a-27ff-4a9b-9427-b6b4c1ea3edd None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:27.177978 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:27.213177 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f2d8a-27ff-4a9b-9427-b6b4c1ea3edd None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:27.250808 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f2123-6e1f-4e5e-a986-29860dcbb56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:27.251849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f2123-6e1f-4e5e-a986-29860dcbb56e None admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:27.252139 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f2123-6e1f-4e5e-a986-29860dcbb56e None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:27.252418 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f2123-6e1f-4e5e-a986-29860dcbb56e None admin] PATH_INFO: `/v3/projects/cd70432d4e5a4e25a4a6def32ffc6ee2/users/698828dd940f46e2b493ba55cd894eac/roles/88426002bf1b40c0b59071eaaba38530` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:27.267702 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f2123-6e1f-4e5e-a986-29860dcbb56e None admin] RBAC: Authorizing `identity:create_grant(project_id=cd70432d4e5a4e25a4a6def32ffc6ee2, user_id=698828dd940f46e2b493ba55cd894eac, role_id=88426002bf1b40c0b59071eaaba38530)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:27.269153 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f2123-6e1f-4e5e-a986-29860dcbb56e None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:27.281832 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 624/1232] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Jul 12 13:07:27 2022] PUT /identity/v3/projects/cd70432d4e5a4e25a4a6def32ffc6ee2/users/698828dd940f46e2b493ba55cd894eac/roles/88426002bf1b40c0b59071eaaba38530 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:07:29.363254 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338872e-b735-4196-9b61-fa16804f6018 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:29.363850 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338872e-b735-4196-9b61-fa16804f6018 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:29.363973 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338872e-b735-4196-9b61-fa16804f6018 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:29.365553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 609/1233] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:07:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:07:29.371280 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e6d3b-b0c9-4145-812d-7f40a1919051 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:29.371723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e6d3b-b0c9-4145-812d-7f40a1919051 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:29.371827 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e6d3b-b0c9-4145-812d-7f40a1919051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:29.392764 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-0d1e6d3b-b0c9-4145-812d-7f40a1919051 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:07:29.393981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-0d1e6d3b-b0c9-4145-812d-7f40a1919051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:07:29.478401 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 625/1234] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:07:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:07:29.503690 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338872e-b735-4196-9b61-fa16804f6018 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:29.531684 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:29.612924 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338872e-b735-4196-9b61-fa16804f6018 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:29.649202 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f709c6-b4e5-4250-ace4-d9af391d9a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:29.649995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f709c6-b4e5-4250-ace4-d9af391d9a4d None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:29.650318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f709c6-b4e5-4250-ace4-d9af391d9a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:29.650601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f709c6-b4e5-4250-ace4-d9af391d9a4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:29.661162 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f709c6-b4e5-4250-ace4-d9af391d9a4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:07:29.668762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-44f709c6-b4e5-4250-ace4-d9af391d9a4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:07:29.668762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:29.668762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:29.668762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:29.668762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:29.668762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:29.668762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:29.668762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:29.668762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:29.668762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:29.668762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:29.668762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:29.668762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:07:29.668762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:07:29.668762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:07:29.668762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:07:29.670073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:07:29.670073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:07:29.670073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:07:29.670073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:07:29.670073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:29.670073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:29.670073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:29.670073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:29.670073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:29.670073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:29.670073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:29.670073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:29.670073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:29.670073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:29.670073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:29.670073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:29.670980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:29.670980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:29.670980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:29.670980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:29.670980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:07:29.670980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:07:29.670980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:07:29.670980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:07:29.670980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:07:29.670980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:07:29.670980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:07:29.670980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:07:29.670980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 610/1235] 10.222.0.17 () {56 vars in 1102 bytes} [Tue Jul 12 13:07:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:29.677700 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e6d3b-b0c9-4145-812d-7f40a1919051 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:29.731442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:29.790206 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e6d3b-b0c9-4145-812d-7f40a1919051 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:29.825789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129b26f-17f5-4002-8c34-ff8e650c8b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:29.826497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129b26f-17f5-4002-8c34-ff8e650c8b5a None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:29.826787 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129b26f-17f5-4002-8c34-ff8e650c8b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:29.827069 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129b26f-17f5-4002-8c34-ff8e650c8b5a None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:29.827811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129b26f-17f5-4002-8c34-ff8e650c8b5a None admin] RBAC: Adding query filter params (name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:29.828196 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129b26f-17f5-4002-8c34-ff8e650c8b5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:29.829713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129b26f-17f5-4002-8c34-ff8e650c8b5a None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:29.839417 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 626/1236] 10.222.0.17 () {56 vars in 1103 bytes} [Tue Jul 12 13:07:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:29.845210 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f709c6-b4e5-4250-ace4-d9af391d9a4d None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:29.942692 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:29.959559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f709c6-b4e5-4250-ace4-d9af391d9a4d None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:29.997404 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f9e0e-4694-4c50-9b2f-815793f60529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:29.998354 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f9e0e-4694-4c50-9b2f-815793f60529 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:29.998647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f9e0e-4694-4c50-9b2f-815793f60529 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:29.998930 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f9e0e-4694-4c50-9b2f-815793f60529 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:30.012501 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f9e0e-4694-4c50-9b2f-815793f60529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:30.013948 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f9e0e-4694-4c50-9b2f-815793f60529 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:30.034197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-3f2f9e0e-4694-4c50-9b2f-815793f60529 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:07:30.034197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:30.034197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:30.034197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:30.034197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:30.034197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:30.034197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:30.034197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:30.034197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:30.034197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:30.034197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:30.034197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:30.034197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:07:30.034197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:07:30.034197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:07:30.035238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:07:30.035238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:30.035238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:30.035238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:30.035238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:30.035238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:30.035238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:30.035238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:30.035238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:30.035238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:30.035238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:30.035238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:30.035238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:30.035238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:30.035238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:30.035238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:30.035238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:30.041691 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:07:30.041691 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:07:30.041691 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:07:30.041691 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:07:30.041691 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 611/1237] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:07:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:30.042045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129b26f-17f5-4002-8c34-ff8e650c8b5a None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:30.156057 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129b26f-17f5-4002-8c34-ff8e650c8b5a None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:30.168234 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:30.196817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02877dd5-0670-43bd-b1ea-054f88590e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:30.197432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02877dd5-0670-43bd-b1ea-054f88590e7d None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:30.197741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02877dd5-0670-43bd-b1ea-054f88590e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:30.198076 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02877dd5-0670-43bd-b1ea-054f88590e7d None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:30.199011 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02877dd5-0670-43bd-b1ea-054f88590e7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:30.199400 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02877dd5-0670-43bd-b1ea-054f88590e7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:30.200857 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02877dd5-0670-43bd-b1ea-054f88590e7d None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:30.214084 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 627/1238] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:30.219983 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f9e0e-4694-4c50-9b2f-815793f60529 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:30.335621 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f9e0e-4694-4c50-9b2f-815793f60529 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:30.371333 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75397131-d485-4b46-ba45-ce151494b152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:30.372148 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75397131-d485-4b46-ba45-ce151494b152 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:30.372434 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75397131-d485-4b46-ba45-ce151494b152 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:30.372717 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75397131-d485-4b46-ba45-ce151494b152 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:30.375561 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:30.381911 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75397131-d485-4b46-ba45-ce151494b152 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:30.384064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75397131-d485-4b46-ba45-ce151494b152 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:30.400243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-75397131-d485-4b46-ba45-ce151494b152 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 13:07:30.400243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:30.400243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:30.400243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:30.400243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:30.400243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:30.400243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:30.400243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:30.400243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:30.400243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:30.400243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:30.400243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:30.400243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:07:30.400243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:07:30.400243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:07:30.400243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:07:30.401470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:30.401470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:30.401470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:07:30.401470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:07:30.401470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:07:30.401470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:07:30.401470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:30.401470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:30.401470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:30.401470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:30.401470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:30.401470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:30.401470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:30.401470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:30.401470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:30.401470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:30.401470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:30.401470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:30.402549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:30.402549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:30.402549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:07:30.402549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:07:30.402549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:07:30.402549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:07:30.402549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:07:30.402549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:07:30.402549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 13:07:30.402549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:07:30.402549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 612/1239] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:07:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:07:30.407568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02877dd5-0670-43bd-b1ea-054f88590e7d None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:30.515807 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02877dd5-0670-43bd-b1ea-054f88590e7d None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:30.555753 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51320e8c-799e-4846-af2e-d0d6e3a931a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:30.556431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51320e8c-799e-4846-af2e-d0d6e3a931a8 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:30.556723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51320e8c-799e-4846-af2e-d0d6e3a931a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:30.557004 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51320e8c-799e-4846-af2e-d0d6e3a931a8 None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:30.557842 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51320e8c-799e-4846-af2e-d0d6e3a931a8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:30.558227 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51320e8c-799e-4846-af2e-d0d6e3a931a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:30.560068 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51320e8c-799e-4846-af2e-d0d6e3a931a8 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:30.579405 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 628/1240] 10.222.0.17 () {56 vars in 1143 bytes} [Tue Jul 12 13:07:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:07:30.586355 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75397131-d485-4b46-ba45-ce151494b152 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:30.707704 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75397131-d485-4b46-ba45-ce151494b152 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:30.747036 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b82302-ccdb-45e9-bd75-22b0312c7a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:30.747781 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b82302-ccdb-45e9-bd75-22b0312c7a8e None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:30.748200 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b82302-ccdb-45e9-bd75-22b0312c7a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:30.748523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b82302-ccdb-45e9-bd75-22b0312c7a8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:30.820191 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:30.830405 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b82302-ccdb-45e9-bd75-22b0312c7a8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:30.832415 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b82302-ccdb-45e9-bd75-22b0312c7a8e None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:30.962754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 613/1241] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:07:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:07:30.969220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51320e8c-799e-4846-af2e-d0d6e3a931a8 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:31.000113 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:31.077051 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51320e8c-799e-4846-af2e-d0d6e3a931a8 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:31.118136 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a2ae2-b3cb-42c0-93d3-6849e1b72c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:31.119065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a2ae2-b3cb-42c0-93d3-6849e1b72c63 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:31.119357 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a2ae2-b3cb-42c0-93d3-6849e1b72c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:31.119761 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a2ae2-b3cb-42c0-93d3-6849e1b72c63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:31.131726 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a2ae2-b3cb-42c0-93d3-6849e1b72c63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:31.133432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a2ae2-b3cb-42c0-93d3-6849e1b72c63 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:31.152614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-750a2ae2-b3cb-42c0-93d3-6849e1b72c63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:07:31.152614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:31.152614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:31.152614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:31.152614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:31.152614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:31.152614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:31.152614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:31.152614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:31.152614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:31.152614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:31.152614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:31.152614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:07:31.152614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:07:31.152614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:07:31.153731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:07:31.153731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:31.153731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:31.153731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:31.153731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:31.153731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:31.153731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:31.153731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:31.153731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:31.153731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:31.153731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:31.153731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:31.153731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:31.153731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:31.153731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:31.153731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:31.153731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:31.154800 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:07:31.154800 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:07:31.154800 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:07:31.154800 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:07:31.154800 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 629/1242] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:07:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:31.159437 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b82302-ccdb-45e9-bd75-22b0312c7a8e None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:31.257296 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:31.265390 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b82302-ccdb-45e9-bd75-22b0312c7a8e None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:31.305209 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d188adc-4ab0-413c-87ff-391cf1f81d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:31.305942 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d188adc-4ab0-413c-87ff-391cf1f81d11 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:31.306283 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d188adc-4ab0-413c-87ff-391cf1f81d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:31.306635 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d188adc-4ab0-413c-87ff-391cf1f81d11 None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:31.307413 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d188adc-4ab0-413c-87ff-391cf1f81d11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:31.307759 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d188adc-4ab0-413c-87ff-391cf1f81d11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:31.309447 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d188adc-4ab0-413c-87ff-391cf1f81d11 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:31.322749 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 614/1243] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:31.329048 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a2ae2-b3cb-42c0-93d3-6849e1b72c63 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:31.422075 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:31.449563 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a2ae2-b3cb-42c0-93d3-6849e1b72c63 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:31.491566 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36af623-5cd7-4a42-b30f-d9fe3feaa011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:31.492617 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36af623-5cd7-4a42-b30f-d9fe3feaa011 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:31.492910 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36af623-5cd7-4a42-b30f-d9fe3feaa011 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:31.493191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36af623-5cd7-4a42-b30f-d9fe3feaa011 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:31.500328 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36af623-5cd7-4a42-b30f-d9fe3feaa011 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:31.501771 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36af623-5cd7-4a42-b30f-d9fe3feaa011 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:31.516567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-b36af623-5cd7-4a42-b30f-d9fe3feaa011 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:07:31.516567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:31.516567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:31.516567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:31.516567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:31.516567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:31.516567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:31.516567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:31.516567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:31.516567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:31.516567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:31.516567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:31.516567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:07:31.516567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:07:31.516567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:07:31.517615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:07:31.517615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:31.517615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:31.517615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:31.517615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:31.517615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:31.517615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:31.517615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:31.517615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:31.517615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:31.517615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:31.517615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:31.517615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:31.517615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:31.517615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:31.517615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:31.517615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:31.518731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:07:31.518731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:07:31.518731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:07:31.518731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:07:31.518731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:07:31.518731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:07:31.518731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:07:31.518731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:07:31.518731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 630/1244] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:07:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:07:31.523851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d188adc-4ab0-413c-87ff-391cf1f81d11 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:31.634599 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d188adc-4ab0-413c-87ff-391cf1f81d11 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:31.671473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331c04d-2775-4d20-bb24-7f6fcf8e34ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:31.672221 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331c04d-2775-4d20-bb24-7f6fcf8e34ff None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:31.672553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331c04d-2775-4d20-bb24-7f6fcf8e34ff None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:31.672851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331c04d-2775-4d20-bb24-7f6fcf8e34ff None admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:31.673718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331c04d-2775-4d20-bb24-7f6fcf8e34ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:31.674107 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331c04d-2775-4d20-bb24-7f6fcf8e34ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:31.675644 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331c04d-2775-4d20-bb24-7f6fcf8e34ff None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:31.690748 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 615/1245] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:07:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:31.698225 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36af623-5cd7-4a42-b30f-d9fe3feaa011 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:31.809944 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36af623-5cd7-4a42-b30f-d9fe3feaa011 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:31.846886 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6871dd-8892-44b6-8a34-e3a0054082bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:31.847718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6871dd-8892-44b6-8a34-e3a0054082bc None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:31.848078 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6871dd-8892-44b6-8a34-e3a0054082bc None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:31.849003 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6871dd-8892-44b6-8a34-e3a0054082bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:31.849862 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6871dd-8892-44b6-8a34-e3a0054082bc None admin] RBAC: Adding query filter params (role.id=88426002bf1b40c0b59071eaaba38530, scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2, user.id=698828dd940f46e2b493ba55cd894eac) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:31.850197 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6871dd-8892-44b6-8a34-e3a0054082bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:31.851643 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6871dd-8892-44b6-8a34-e3a0054082bc None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:31.859242 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 631/1246] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:07:31 2022] GET /identity/v3/role_assignments?user.id=698828dd940f46e2b493ba55cd894eac&scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2&role.id=88426002bf1b40c0b59071eaaba38530 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:33.915028 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed6d70-d62a-496c-8473-5ac4af21dbe6 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:33.915602 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed6d70-d62a-496c-8473-5ac4af21dbe6 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:33.915696 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed6d70-d62a-496c-8473-5ac4af21dbe6 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:33.917483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 616/1247] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:07:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:07:33.922822 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32686fbf-cbc7-4247-b34f-635a2f134cf6 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:33.923275 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32686fbf-cbc7-4247-b34f-635a2f134cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:33.923381 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32686fbf-cbc7-4247-b34f-635a2f134cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:33.931682 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:33.945410 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-32686fbf-cbc7-4247-b34f-635a2f134cf6 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:07:33.946636 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-32686fbf-cbc7-4247-b34f-635a2f134cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:07:34.023963 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 632/1248] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:07:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:07:34.048447 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed6d70-d62a-496c-8473-5ac4af21dbe6 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:34.069433 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:34.165232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed6d70-d62a-496c-8473-5ac4af21dbe6 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:34.206951 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd4052-edd0-49eb-8ba0-9d10ab5d82b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:34.207798 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd4052-edd0-49eb-8ba0-9d10ab5d82b5 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:34.208084 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd4052-edd0-49eb-8ba0-9d10ab5d82b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:34.208367 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd4052-edd0-49eb-8ba0-9d10ab5d82b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:34.219338 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd4052-edd0-49eb-8ba0-9d10ab5d82b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:07:34.227324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-18cd4052-edd0-49eb-8ba0-9d10ab5d82b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:07:34.227324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:34.227324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:34.227324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:34.227324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:34.227324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:34.227324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:34.227324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:34.227324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:34.227324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:34.227324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:34.227324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:34.227324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:07:34.227324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:07:34.227324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:07:34.227324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:07:34.228567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:07:34.228567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:07:34.228567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:07:34.228567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:07:34.228567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:34.228567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:34.228567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:34.228567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:34.228567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:34.228567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:34.228567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:34.228567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:34.228567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:34.228567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:34.228567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:34.228567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:34.229632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:34.229632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:34.229632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:34.229632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:34.229632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:07:34.229632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:07:34.229632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:07:34.229632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:07:34.229632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:07:34.229632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:07:34.229632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:07:34.229632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:07:34.229632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 617/1249] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:07:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:07:34.234792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32686fbf-cbc7-4247-b34f-635a2f134cf6 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:34.347818 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32686fbf-cbc7-4247-b34f-635a2f134cf6 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:34.382204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:34.388020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2d4df-caa4-4560-b55d-7fcaa5f6a380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:34.388721 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2d4df-caa4-4560-b55d-7fcaa5f6a380 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:34.389058 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2d4df-caa4-4560-b55d-7fcaa5f6a380 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:34.389283 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2d4df-caa4-4560-b55d-7fcaa5f6a380 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:34.390033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2d4df-caa4-4560-b55d-7fcaa5f6a380 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:34.390369 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2d4df-caa4-4560-b55d-7fcaa5f6a380 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:34.391741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2d4df-caa4-4560-b55d-7fcaa5f6a380 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:34.400725 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 633/1250] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:07:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:34.406442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd4052-edd0-49eb-8ba0-9d10ab5d82b5 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:34.493085 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:34.519839 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd4052-edd0-49eb-8ba0-9d10ab5d82b5 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:34.556334 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711da1d9-0192-4ec5-8ace-6dfef23f1121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:34.557262 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711da1d9-0192-4ec5-8ace-6dfef23f1121 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:34.557581 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711da1d9-0192-4ec5-8ace-6dfef23f1121 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:34.557820 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711da1d9-0192-4ec5-8ace-6dfef23f1121 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:34.569026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711da1d9-0192-4ec5-8ace-6dfef23f1121 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:34.570516 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711da1d9-0192-4ec5-8ace-6dfef23f1121 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:34.588902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-711da1d9-0192-4ec5-8ace-6dfef23f1121 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:07:34.588902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:34.588902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:34.588902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:34.588902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:34.588902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:34.588902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:34.588902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:34.588902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:34.588902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:34.588902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:34.588902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:34.588902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:07:34.588902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:07:34.588902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:07:34.590141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:07:34.590141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:34.590141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:34.590141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:34.590141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:34.590141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:34.590141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:34.590141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:34.590141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:34.590141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:34.590141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:34.590141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:34.590141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:34.590141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:34.590141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:34.590141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:34.590141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:34.591152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:07:34.591152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:07:34.591152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:07:34.591152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:07:34.591152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 618/1251] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:07:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:34.596120 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2d4df-caa4-4560-b55d-7fcaa5f6a380 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:34.718391 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2d4df-caa4-4560-b55d-7fcaa5f6a380 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:34.752469 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300682b-97d9-4941-a96b-5f15ff7d2bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:34.753051 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300682b-97d9-4941-a96b-5f15ff7d2bdf None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:34.753334 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300682b-97d9-4941-a96b-5f15ff7d2bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:34.753607 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300682b-97d9-4941-a96b-5f15ff7d2bdf None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:34.754837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300682b-97d9-4941-a96b-5f15ff7d2bdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:34.755148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300682b-97d9-4941-a96b-5f15ff7d2bdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:34.756501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300682b-97d9-4941-a96b-5f15ff7d2bdf None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:34.771038 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 634/1252] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:34.777397 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711da1d9-0192-4ec5-8ace-6dfef23f1121 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:34.891914 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711da1d9-0192-4ec5-8ace-6dfef23f1121 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:34.924539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:34.935057 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2c56d-3a38-48af-9740-740576f4a308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:34.935921 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2c56d-3a38-48af-9740-740576f4a308 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:34.936320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2c56d-3a38-48af-9740-740576f4a308 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:34.936699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2c56d-3a38-48af-9740-740576f4a308 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:34.945414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec2c56d-3a38-48af-9740-740576f4a308 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:34.946890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec2c56d-3a38-48af-9740-740576f4a308 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:34.964935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-bec2c56d-3a38-48af-9740-740576f4a308 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 13:07:34.964935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:34.964935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:34.964935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:34.964935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:34.964935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:34.964935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:34.964935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:34.964935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:34.964935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:34.964935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:34.964935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:34.964935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:07:34.964935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:07:34.964935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:07:34.964935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:07:34.966089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:34.966089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:34.966089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:07:34.966089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:07:34.966089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:07:34.966089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:07:34.966089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:34.966089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:34.966089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:34.966089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:34.966089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:34.966089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:34.966089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:34.966089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:34.966089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:34.966089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:34.966089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:34.966089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:34.967297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:34.967297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:34.967297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:07:34.967297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:07:34.967297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:07:34.967297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:07:34.967297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:07:34.967297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:07:34.967297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 13:07:34.967297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:07:34.967297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 619/1253] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:07:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:34.972750 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300682b-97d9-4941-a96b-5f15ff7d2bdf None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:35.039129 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:35.092560 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300682b-97d9-4941-a96b-5f15ff7d2bdf None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:35.128622 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5d566-c671-4f09-a9c3-8d79fe1a79ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:35.129294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5d566-c671-4f09-a9c3-8d79fe1a79ff None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:35.130242 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5d566-c671-4f09-a9c3-8d79fe1a79ff None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:35.130521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5d566-c671-4f09-a9c3-8d79fe1a79ff None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:35.131359 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5d566-c671-4f09-a9c3-8d79fe1a79ff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:35.131674 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5d566-c671-4f09-a9c3-8d79fe1a79ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:35.133085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5d566-c671-4f09-a9c3-8d79fe1a79ff None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:35.151208 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 635/1254] 10.222.0.17 () {56 vars in 1143 bytes} [Tue Jul 12 13:07:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:35.157022 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2c56d-3a38-48af-9740-740576f4a308 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:35.257960 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2c56d-3a38-48af-9740-740576f4a308 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:35.292546 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de902bf-b0b4-4e8a-9370-fc0b5986b0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:35.293439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de902bf-b0b4-4e8a-9370-fc0b5986b0ed None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:35.293728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de902bf-b0b4-4e8a-9370-fc0b5986b0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:35.294016 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de902bf-b0b4-4e8a-9370-fc0b5986b0ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:35.356519 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:35.373529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de902bf-b0b4-4e8a-9370-fc0b5986b0ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:35.375024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de902bf-b0b4-4e8a-9370-fc0b5986b0ed None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:35.496624 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 620/1255] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:07:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:07:35.505191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5d566-c671-4f09-a9c3-8d79fe1a79ff None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:35.617691 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5d566-c671-4f09-a9c3-8d79fe1a79ff None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:35.634905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:35.660457 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c363b6-817d-4a21-8ec1-35f37b34a8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:35.661295 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c363b6-817d-4a21-8ec1-35f37b34a8ca None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:35.661584 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c363b6-817d-4a21-8ec1-35f37b34a8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:35.661863 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c363b6-817d-4a21-8ec1-35f37b34a8ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:35.673623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c363b6-817d-4a21-8ec1-35f37b34a8ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:35.675688 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c363b6-817d-4a21-8ec1-35f37b34a8ca None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:35.699713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-71c363b6-817d-4a21-8ec1-35f37b34a8ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:07:35.699713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:35.699713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:35.699713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:35.699713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:35.699713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:35.699713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:35.699713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:35.699713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:35.699713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:35.699713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:35.699713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:35.699713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:07:35.699713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:07:35.699713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:07:35.701014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:07:35.701014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:35.701014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:35.701014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:35.701014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:35.701014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:35.701014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:35.701014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:35.701014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:35.701014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:35.701014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:35.701014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:35.701014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:35.701014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:35.701014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:35.701014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:35.701014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:35.706726 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:07:35.706726 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:07:35.706726 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:07:35.706726 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:07:35.706726 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 636/1256] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:07:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:35.707104 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de902bf-b0b4-4e8a-9370-fc0b5986b0ed None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:35.810574 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:35.825358 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de902bf-b0b4-4e8a-9370-fc0b5986b0ed None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:35.865688 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2cba28-722b-4cbb-a471-e827611ed708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:35.866508 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cba28-722b-4cbb-a471-e827611ed708 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:35.866795 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cba28-722b-4cbb-a471-e827611ed708 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:35.867077 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cba28-722b-4cbb-a471-e827611ed708 None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:35.868064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2cba28-722b-4cbb-a471-e827611ed708 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:35.868371 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2cba28-722b-4cbb-a471-e827611ed708 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:35.870083 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2cba28-722b-4cbb-a471-e827611ed708 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:35.884159 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 621/1257] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:35.890805 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c363b6-817d-4a21-8ec1-35f37b34a8ca None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:36.007477 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c363b6-817d-4a21-8ec1-35f37b34a8ca None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:36.049195 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be1f54-b2f1-49aa-8246-ab9e4d4ebc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:36.050041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be1f54-b2f1-49aa-8246-ab9e4d4ebc98 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:36.050354 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be1f54-b2f1-49aa-8246-ab9e4d4ebc98 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:36.050632 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be1f54-b2f1-49aa-8246-ab9e4d4ebc98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:36.058276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be1f54-b2f1-49aa-8246-ab9e4d4ebc98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:36.059760 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be1f54-b2f1-49aa-8246-ab9e4d4ebc98 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:36.075187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-89be1f54-b2f1-49aa-8246-ab9e4d4ebc98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:07:36.075187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:36.075187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:36.075187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:36.075187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:36.075187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:36.075187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:36.075187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:36.075187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:36.075187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:36.075187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:36.075187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:36.075187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:07:36.075187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:07:36.075187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:07:36.076374 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:07:36.076374 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:36.076374 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:36.076374 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:36.076374 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:36.076374 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:36.076374 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:36.076374 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:36.076374 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:36.076374 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:36.076374 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:36.076374 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:36.076374 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:36.076374 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:36.076374 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:36.076374 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:36.076374 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:36.082204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:07:36.082204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:07:36.082204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:07:36.082204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:07:36.082204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:07:36.082204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:07:36.082204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:07:36.082204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:07:36.082204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 637/1258] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:07:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:36.083375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2cba28-722b-4cbb-a471-e827611ed708 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:36.189683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2cba28-722b-4cbb-a471-e827611ed708 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:36.225784 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0ffde-885b-43d5-a3a4-f02af059e13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:36.226492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0ffde-885b-43d5-a3a4-f02af059e13c None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:36.226778 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0ffde-885b-43d5-a3a4-f02af059e13c None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:36.227057 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0ffde-885b-43d5-a3a4-f02af059e13c None admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:36.227858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa0ffde-885b-43d5-a3a4-f02af059e13c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:36.228172 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa0ffde-885b-43d5-a3a4-f02af059e13c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:36.229636 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa0ffde-885b-43d5-a3a4-f02af059e13c None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:36.243727 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 622/1259] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:07:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:36.249858 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be1f54-b2f1-49aa-8246-ab9e4d4ebc98 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:36.276629 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:36.355748 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be1f54-b2f1-49aa-8246-ab9e4d4ebc98 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:36.395795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941bd19-a0ed-4faa-878d-64595d03e7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:36.396538 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941bd19-a0ed-4faa-878d-64595d03e7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:36.396891 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941bd19-a0ed-4faa-878d-64595d03e7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:36.397173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941bd19-a0ed-4faa-878d-64595d03e7e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:36.398033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941bd19-a0ed-4faa-878d-64595d03e7e9 None admin] RBAC: Adding query filter params (role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0, scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2, user.id=698828dd940f46e2b493ba55cd894eac) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:36.398400 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941bd19-a0ed-4faa-878d-64595d03e7e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:36.400019 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941bd19-a0ed-4faa-878d-64595d03e7e9 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:36.418161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 638/1260] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:07:36 2022] GET /identity/v3/role_assignments?user.id=698828dd940f46e2b493ba55cd894eac&scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2&role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:38.395813 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe54a2-a1b6-4983-bc70-8a02125c424c None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:38.396342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe54a2-a1b6-4983-bc70-8a02125c424c None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:38.396342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe54a2-a1b6-4983-bc70-8a02125c424c None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:38.397721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 623/1261] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:07:38.404062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861e7c8-84d7-42f4-b547-047dcbe27178 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:38.404584 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861e7c8-84d7-42f4-b547-047dcbe27178 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:38.404800 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861e7c8-84d7-42f4-b547-047dcbe27178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:38.425316 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-7861e7c8-84d7-42f4-b547-047dcbe27178 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:07:38.426609 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-7861e7c8-84d7-42f4-b547-047dcbe27178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:07:38.505871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 639/1262] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:07:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:07:38.528476 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe54a2-a1b6-4983-bc70-8a02125c424c None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:38.539689 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:38.635518 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe54a2-a1b6-4983-bc70-8a02125c424c None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:38.674446 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe630ec-8a99-4bb7-aa4a-170f80bf5c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:38.675512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe630ec-8a99-4bb7-aa4a-170f80bf5c37 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:38.675859 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe630ec-8a99-4bb7-aa4a-170f80bf5c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:38.676186 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe630ec-8a99-4bb7-aa4a-170f80bf5c37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:38.687114 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe630ec-8a99-4bb7-aa4a-170f80bf5c37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:07:38.696524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-8fe630ec-8a99-4bb7-aa4a-170f80bf5c37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:07:38.696524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:38.696524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:38.696524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:38.696524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:38.696524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:38.696524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:38.696524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:38.696524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:38.696524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:38.696524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:38.696524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:38.696524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:07:38.696524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:07:38.696524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:07:38.696524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:07:38.697737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:07:38.697737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:07:38.697737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:07:38.697737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:07:38.697737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:38.697737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:38.697737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:38.697737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:38.697737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:38.697737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:38.697737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:38.697737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:38.697737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:38.697737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:38.697737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:38.697737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:38.698734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:38.698734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:38.698734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:38.698734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:38.698734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:07:38.698734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:07:38.698734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:07:38.698734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:07:38.698734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:07:38.698734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:07:38.698734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:07:38.698734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:07:38.698734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 624/1263] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:07:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:38.705484 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861e7c8-84d7-42f4-b547-047dcbe27178 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:38.728864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:38.810804 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861e7c8-84d7-42f4-b547-047dcbe27178 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:38.843939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a641a71-0d28-4b1f-a822-2ba45b0a8ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:38.844603 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a641a71-0d28-4b1f-a822-2ba45b0a8ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:38.844895 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a641a71-0d28-4b1f-a822-2ba45b0a8ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:38.845178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a641a71-0d28-4b1f-a822-2ba45b0a8ff3 None admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:38.845925 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a641a71-0d28-4b1f-a822-2ba45b0a8ff3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:38.846269 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a641a71-0d28-4b1f-a822-2ba45b0a8ff3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:38.847641 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a641a71-0d28-4b1f-a822-2ba45b0a8ff3 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:38.855682 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 640/1264] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:07:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:07:38.861345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe630ec-8a99-4bb7-aa4a-170f80bf5c37 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:38.927196 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:38.960373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe630ec-8a99-4bb7-aa4a-170f80bf5c37 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:38.992635 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a70371-3c93-4e3a-89ae-0e9572b539b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:38.993413 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a70371-3c93-4e3a-89ae-0e9572b539b2 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:38.993699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a70371-3c93-4e3a-89ae-0e9572b539b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:38.993978 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a70371-3c93-4e3a-89ae-0e9572b539b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:39.004096 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a70371-3c93-4e3a-89ae-0e9572b539b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:39.005558 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a70371-3c93-4e3a-89ae-0e9572b539b2 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:39.022836 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-a5a70371-3c93-4e3a-89ae-0e9572b539b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:07:39.022836 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:39.022836 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:39.022836 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:39.022836 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:39.022836 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:39.022836 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:39.022836 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:39.022836 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:39.022836 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:39.022836 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:39.022836 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:39.022836 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:07:39.022836 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:07:39.022836 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:07:39.023904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:07:39.023904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:39.023904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:39.023904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:39.023904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:39.023904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:39.023904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:39.023904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:39.023904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:39.023904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:39.023904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:39.023904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:39.023904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:39.023904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:39.023904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:39.023904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:39.023904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:39.025038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:07:39.025038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:07:39.025038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:07:39.025038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:07:39.025038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 625/1265] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:07:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:39.029716 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a641a71-0d28-4b1f-a822-2ba45b0a8ff3 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:39.107479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:39.127413 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a641a71-0d28-4b1f-a822-2ba45b0a8ff3 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:39.159646 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf240a-1b89-4b80-8199-82f64e7f4a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:39.160305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf240a-1b89-4b80-8199-82f64e7f4a23 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:39.161158 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf240a-1b89-4b80-8199-82f64e7f4a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:39.161442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf240a-1b89-4b80-8199-82f64e7f4a23 None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:39.162180 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf240a-1b89-4b80-8199-82f64e7f4a23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:39.162489 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf240a-1b89-4b80-8199-82f64e7f4a23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:39.163845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf240a-1b89-4b80-8199-82f64e7f4a23 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:39.175198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 641/1266] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:39.181745 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a70371-3c93-4e3a-89ae-0e9572b539b2 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:39.277512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a70371-3c93-4e3a-89ae-0e9572b539b2 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:39.297843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:39.314486 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c61df7-fb44-46a9-bb8e-69508b05aa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:39.315290 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c61df7-fb44-46a9-bb8e-69508b05aa58 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:39.315574 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c61df7-fb44-46a9-bb8e-69508b05aa58 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:39.315848 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c61df7-fb44-46a9-bb8e-69508b05aa58 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:39.324053 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c61df7-fb44-46a9-bb8e-69508b05aa58 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:39.325493 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c61df7-fb44-46a9-bb8e-69508b05aa58 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:39.339392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-44c61df7-fb44-46a9-bb8e-69508b05aa58 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 13:07:39.339392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:39.339392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:39.339392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:39.339392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:39.339392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:39.339392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:39.339392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:39.339392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:39.339392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:39.339392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:39.339392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:39.339392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:07:39.339392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:07:39.339392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:07:39.339392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:07:39.340495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:39.340495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:39.340495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:07:39.340495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:07:39.340495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:07:39.340495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:07:39.340495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:39.340495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:39.340495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:39.340495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:39.340495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:39.340495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:39.340495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:39.340495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:39.340495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:39.340495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:39.340495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:39.340495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:39.341658 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:39.341658 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:39.341658 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:07:39.341658 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:07:39.341658 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:07:39.341658 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:07:39.341658 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:07:39.341658 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:07:39.341658 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 13:07:39.341658 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:07:39.341658 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 626/1267] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:07:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:39.346321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf240a-1b89-4b80-8199-82f64e7f4a23 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:39.450684 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf240a-1b89-4b80-8199-82f64e7f4a23 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:39.483969 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b146a3-3a86-493d-b956-0e20184c31da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:39.484640 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b146a3-3a86-493d-b956-0e20184c31da None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:39.484927 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b146a3-3a86-493d-b956-0e20184c31da None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:39.485207 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b146a3-3a86-493d-b956-0e20184c31da None admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:39.486042 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b146a3-3a86-493d-b956-0e20184c31da None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:39.486389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b146a3-3a86-493d-b956-0e20184c31da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:39.487826 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b146a3-3a86-493d-b956-0e20184c31da None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:39.496183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:39.504595 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 642/1268] 10.222.0.17 () {56 vars in 1143 bytes} [Tue Jul 12 13:07:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:39.510192 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c61df7-fb44-46a9-bb8e-69508b05aa58 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:39.607437 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c61df7-fb44-46a9-bb8e-69508b05aa58 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:39.640427 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955aa9d-5bac-4f33-aac1-ad351d5fd9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:39.641220 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955aa9d-5bac-4f33-aac1-ad351d5fd9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:39.641501 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955aa9d-5bac-4f33-aac1-ad351d5fd9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:39.641775 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955aa9d-5bac-4f33-aac1-ad351d5fd9a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:39.652553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955aa9d-5bac-4f33-aac1-ad351d5fd9a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:39.653981 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955aa9d-5bac-4f33-aac1-ad351d5fd9a6 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:39.671100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-3955aa9d-5bac-4f33-aac1-ad351d5fd9a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:07:39.671100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:39.671100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:39.671100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:39.671100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:39.671100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:39.671100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:39.671100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:39.671100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:39.671100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:39.671100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:39.671100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:39.671100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:07:39.671100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:07:39.671100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:07:39.672167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:07:39.672167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:39.672167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:39.672167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:39.672167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:39.672167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:39.672167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:39.672167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:39.672167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:39.672167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:39.672167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:39.672167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:39.672167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:39.672167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:39.672167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:39.672167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:39.672167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:39.673337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:07:39.673337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:07:39.673337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:07:39.673337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:07:39.673337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 627/1269] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:07:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:39.677967 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b146a3-3a86-493d-b956-0e20184c31da None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:39.774065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b146a3-3a86-493d-b956-0e20184c31da None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:39.806530 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35594fda-bf3e-42f2-bc14-2b2d445c6451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:39.807186 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35594fda-bf3e-42f2-bc14-2b2d445c6451 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:39.807475 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35594fda-bf3e-42f2-bc14-2b2d445c6451 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:39.807755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35594fda-bf3e-42f2-bc14-2b2d445c6451 None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:39.808470 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35594fda-bf3e-42f2-bc14-2b2d445c6451 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:39.808779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35594fda-bf3e-42f2-bc14-2b2d445c6451 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:39.810177 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35594fda-bf3e-42f2-bc14-2b2d445c6451 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:39.821529 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 643/1270] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:39.827011 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955aa9d-5bac-4f33-aac1-ad351d5fd9a6 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:39.857992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:39.923851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955aa9d-5bac-4f33-aac1-ad351d5fd9a6 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:39.956266 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f48834-ca2b-4c85-b23b-17a9c189046d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:39.957060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f48834-ca2b-4c85-b23b-17a9c189046d None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:39.957935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f48834-ca2b-4c85-b23b-17a9c189046d None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:39.958262 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f48834-ca2b-4c85-b23b-17a9c189046d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:39.964739 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f48834-ca2b-4c85-b23b-17a9c189046d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:39.966197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f48834-ca2b-4c85-b23b-17a9c189046d None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:39.980601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-f4f48834-ca2b-4c85-b23b-17a9c189046d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:07:39.980601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:39.980601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:39.980601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:39.980601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:39.980601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:39.980601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:39.980601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:39.980601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:39.980601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:39.980601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:39.980601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:39.980601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:07:39.980601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:07:39.980601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:07:39.981617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:07:39.981617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:39.981617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:39.981617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:39.981617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:39.981617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:39.981617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:39.981617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:39.981617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:39.981617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:39.981617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:39.981617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:39.981617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:39.981617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:39.981617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:39.981617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:39.981617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:39.982749 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:07:39.982749 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:07:39.982749 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:07:39.982749 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:07:39.982749 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:07:39.982749 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:07:39.982749 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:07:39.982749 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:07:39.982749 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 628/1271] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:07:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:39.987532 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35594fda-bf3e-42f2-bc14-2b2d445c6451 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:40.044265 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:40.084770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35594fda-bf3e-42f2-bc14-2b2d445c6451 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:40.117229 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24b39b-8ec1-4d93-96d8-7edb7a10e6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:40.117889 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24b39b-8ec1-4d93-96d8-7edb7a10e6af None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:40.118208 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24b39b-8ec1-4d93-96d8-7edb7a10e6af None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:40.118488 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24b39b-8ec1-4d93-96d8-7edb7a10e6af None admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:40.119269 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24b39b-8ec1-4d93-96d8-7edb7a10e6af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:40.119583 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24b39b-8ec1-4d93-96d8-7edb7a10e6af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:40.121003 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24b39b-8ec1-4d93-96d8-7edb7a10e6af None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:40.133326 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 644/1272] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:07:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:40.139664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f48834-ca2b-4c85-b23b-17a9c189046d None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:40.228889 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:40.237807 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f48834-ca2b-4c85-b23b-17a9c189046d None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:40.271764 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991dfc75-f44a-425f-bf93-dd4b33b8782f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:40.272662 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991dfc75-f44a-425f-bf93-dd4b33b8782f None admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:40.272951 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991dfc75-f44a-425f-bf93-dd4b33b8782f None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:40.273233 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991dfc75-f44a-425f-bf93-dd4b33b8782f None admin] PATH_INFO: `/v3/projects/cd70432d4e5a4e25a4a6def32ffc6ee2/users/698828dd940f46e2b493ba55cd894eac/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:40.275221 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991dfc75-f44a-425f-bf93-dd4b33b8782f None admin] RBAC: Authorizing `identity:create_grant(project_id=cd70432d4e5a4e25a4a6def32ffc6ee2, user_id=698828dd940f46e2b493ba55cd894eac, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:40.276659 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991dfc75-f44a-425f-bf93-dd4b33b8782f None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:40.289920 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 629/1273] 10.222.0.17 () {58 vars in 1439 bytes} [Tue Jul 12 13:07:40 2022] PUT /identity/v3/projects/cd70432d4e5a4e25a4a6def32ffc6ee2/users/698828dd940f46e2b493ba55cd894eac/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:07:42.338811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20edad-5745-4308-b4a9-36cb48fb3e35 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:42.339346 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20edad-5745-4308-b4a9-36cb48fb3e35 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:42.339346 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20edad-5745-4308-b4a9-36cb48fb3e35 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:42.340721 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 645/1274] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:07:42.345826 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5093297-6f4a-437c-9ec5-44f7708db2ad None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:42.346220 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5093297-6f4a-437c-9ec5-44f7708db2ad None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:42.346436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5093297-6f4a-437c-9ec5-44f7708db2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:42.363408 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-d5093297-6f4a-437c-9ec5-44f7708db2ad None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:07:42.365186 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-d5093297-6f4a-437c-9ec5-44f7708db2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:07:42.429436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 630/1275] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:07:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:07:42.452843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20edad-5745-4308-b4a9-36cb48fb3e35 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:42.549335 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20edad-5745-4308-b4a9-36cb48fb3e35 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:42.565447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:42.581353 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18e58c-f59c-4230-9ca9-668ec9238c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:42.582168 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18e58c-f59c-4230-9ca9-668ec9238c78 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:42.582973 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18e58c-f59c-4230-9ca9-668ec9238c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:42.583254 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18e58c-f59c-4230-9ca9-668ec9238c78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:42.592937 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18e58c-f59c-4230-9ca9-668ec9238c78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:07:42.601007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-ab18e58c-f59c-4230-9ca9-668ec9238c78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:07:42.601007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:42.601007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:42.601007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:42.601007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:42.601007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:42.601007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:42.601007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:42.601007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:42.601007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:42.601007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:42.601007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:42.601007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:07:42.601007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:07:42.601007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:07:42.601007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:07:42.602135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:07:42.602135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:07:42.602135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:07:42.602135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:07:42.602135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:42.602135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:42.602135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:42.602135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:42.602135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:42.602135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:42.602135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:42.602135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:42.602135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:42.602135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:42.602135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:42.602135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:42.603268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:42.603268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:42.603268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:42.603268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:42.603268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:07:42.603268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:07:42.603268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:07:42.603268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:07:42.603268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:07:42.603268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:07:42.603268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:07:42.603268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:07:42.603268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 646/1276] 10.222.0.17 () {56 vars in 1096 bytes} [Tue Jul 12 13:07:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:42.610125 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5093297-6f4a-437c-9ec5-44f7708db2ad None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:42.690365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:42.709827 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5093297-6f4a-437c-9ec5-44f7708db2ad None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:42.744046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b724a-8a37-482d-b7ad-7af01064b47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:42.744712 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b724a-8a37-482d-b7ad-7af01064b47b None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:42.744997 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b724a-8a37-482d-b7ad-7af01064b47b None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:42.745277 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b724a-8a37-482d-b7ad-7af01064b47b None admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:42.746019 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b724a-8a37-482d-b7ad-7af01064b47b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:42.746356 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b724a-8a37-482d-b7ad-7af01064b47b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:42.747728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b724a-8a37-482d-b7ad-7af01064b47b None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:42.756190 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 631/1277] 10.222.0.17 () {56 vars in 1099 bytes} [Tue Jul 12 13:07:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:42.762062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18e58c-f59c-4230-9ca9-668ec9238c78 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:42.857861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18e58c-f59c-4230-9ca9-668ec9238c78 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:42.889956 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cb2c1-7c79-497f-a924-b40d6aca82aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:42.890764 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cb2c1-7c79-497f-a924-b40d6aca82aa None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:42.891054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cb2c1-7c79-497f-a924-b40d6aca82aa None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:42.891336 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cb2c1-7c79-497f-a924-b40d6aca82aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:42.901443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5cb2c1-7c79-497f-a924-b40d6aca82aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:42.902918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5cb2c1-7c79-497f-a924-b40d6aca82aa None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:42.920095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-0b5cb2c1-7c79-497f-a924-b40d6aca82aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:07:42.920095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:42.920095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:42.920095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:42.920095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:42.920095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:42.920095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:42.920095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:42.920095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:42.920095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:42.920095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:42.920095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:42.920095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:07:42.920095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:07:42.920095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:07:42.921140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:07:42.921140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:42.921140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:42.921140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:42.921140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:42.921140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:42.921140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:42.921140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:42.921140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:42.921140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:42.921140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:42.921140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:42.921140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:42.921140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:42.921140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:42.921140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:42.921140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:42.922320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:07:42.922320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:07:42.922320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:07:42.922320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:07:42.922320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 647/1278] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:42.927358 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b724a-8a37-482d-b7ad-7af01064b47b None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:43.023992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b724a-8a37-482d-b7ad-7af01064b47b None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:43.055355 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d539b0-bf9d-491b-8c21-26e2c0a3f939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:43.056006 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d539b0-bf9d-491b-8c21-26e2c0a3f939 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:43.056292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d539b0-bf9d-491b-8c21-26e2c0a3f939 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:43.056571 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d539b0-bf9d-491b-8c21-26e2c0a3f939 None admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:43.057281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d539b0-bf9d-491b-8c21-26e2c0a3f939 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:43.057588 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d539b0-bf9d-491b-8c21-26e2c0a3f939 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:43.058967 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d539b0-bf9d-491b-8c21-26e2c0a3f939 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:43.070824 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 632/1279] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:07:43.076126 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cb2c1-7c79-497f-a924-b40d6aca82aa None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:43.105949 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:43.173985 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cb2c1-7c79-497f-a924-b40d6aca82aa None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:43.207011 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ee13e-6c55-465f-992a-58cf28bfd9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:43.207840 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ee13e-6c55-465f-992a-58cf28bfd9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:43.208127 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ee13e-6c55-465f-992a-58cf28bfd9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:43.208405 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ee13e-6c55-465f-992a-58cf28bfd9e9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:43.215701 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ee13e-6c55-465f-992a-58cf28bfd9e9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:43.217151 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ee13e-6c55-465f-992a-58cf28bfd9e9 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:43.231416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-016ee13e-6c55-465f-992a-58cf28bfd9e9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 13:07:43.231416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:43.231416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:43.231416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:43.231416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:43.231416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:43.231416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:43.231416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:43.231416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:43.231416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:43.231416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:43.231416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:43.231416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:07:43.231416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:07:43.231416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:07:43.231416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:07:43.232337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:43.232337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:43.232337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:07:43.232337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:07:43.232337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:07:43.232337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:07:43.232337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:43.232337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:43.232337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:43.232337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:43.232337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:43.232337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:43.232337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:43.232337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:43.232337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:43.232337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:43.232337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:43.232337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:43.233377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:43.233377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:43.233377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:07:43.233377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:07:43.233377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:07:43.233377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:07:43.233377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:07:43.233377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:07:43.233377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 13:07:43.233377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:07:43.233377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 648/1280] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:07:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:43.238372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d539b0-bf9d-491b-8c21-26e2c0a3f939 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:43.242652 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:43.338714 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d539b0-bf9d-491b-8c21-26e2c0a3f939 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:43.371712 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea067a8a-85ca-403e-9555-ce3146c04214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:43.372453 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea067a8a-85ca-403e-9555-ce3146c04214 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:43.372745 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea067a8a-85ca-403e-9555-ce3146c04214 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:43.373026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea067a8a-85ca-403e-9555-ce3146c04214 None admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:43.373854 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea067a8a-85ca-403e-9555-ce3146c04214 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:43.374195 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea067a8a-85ca-403e-9555-ce3146c04214 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:43.375621 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea067a8a-85ca-403e-9555-ce3146c04214 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:43.392937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 633/1281] 10.222.0.17 () {56 vars in 1143 bytes} [Tue Jul 12 13:07:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:43.398541 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ee13e-6c55-465f-992a-58cf28bfd9e9 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:43.486193 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:43.496451 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ee13e-6c55-465f-992a-58cf28bfd9e9 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:43.529058 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62f4f8-a072-4cf0-881b-8bb083fa0b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:43.529698 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62f4f8-a072-4cf0-881b-8bb083fa0b8e None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:43.529988 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62f4f8-a072-4cf0-881b-8bb083fa0b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:43.530300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62f4f8-a072-4cf0-881b-8bb083fa0b8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:43.596640 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62f4f8-a072-4cf0-881b-8bb083fa0b8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:43.598631 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62f4f8-a072-4cf0-881b-8bb083fa0b8e None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:43.684749 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:43.695530 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 649/1282] 10.222.0.17 () {58 vars in 1282 bytes} [Tue Jul 12 13:07:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:07:43.701089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea067a8a-85ca-403e-9555-ce3146c04214 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:43.761434 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:43.799014 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea067a8a-85ca-403e-9555-ce3146c04214 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:43.831535 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b49e31-2ed8-4d3a-bc20-6dd15afd6ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:43.832325 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b49e31-2ed8-4d3a-bc20-6dd15afd6ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:43.832614 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b49e31-2ed8-4d3a-bc20-6dd15afd6ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:43.832892 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b49e31-2ed8-4d3a-bc20-6dd15afd6ea4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:43.842724 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b49e31-2ed8-4d3a-bc20-6dd15afd6ea4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:43.844161 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b49e31-2ed8-4d3a-bc20-6dd15afd6ea4 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:43.861624 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-f6b49e31-2ed8-4d3a-bc20-6dd15afd6ea4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:07:43.861624 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:43.861624 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:43.861624 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:43.861624 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:43.861624 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:43.861624 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:43.861624 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:43.861624 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:43.861624 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:43.861624 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:43.861624 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:43.861624 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:07:43.861624 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:07:43.861624 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:07:43.862803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:07:43.862803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:43.862803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:43.862803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:43.862803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:43.862803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:43.862803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:43.862803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:43.862803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:43.862803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:43.862803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:43.862803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:43.862803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:43.862803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:43.862803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:43.862803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:43.862803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:43.864721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:07:43.864721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:07:43.864721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:07:43.864721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:07:43.864721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 634/1283] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:43.868894 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62f4f8-a072-4cf0-881b-8bb083fa0b8e None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:43.963892 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62f4f8-a072-4cf0-881b-8bb083fa0b8e None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:43.996895 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d8fc7-606a-49de-9651-52de14d3f376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:43.997545 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d8fc7-606a-49de-9651-52de14d3f376 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:43.997833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d8fc7-606a-49de-9651-52de14d3f376 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:43.998143 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d8fc7-606a-49de-9651-52de14d3f376 None admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:43.998854 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d8fc7-606a-49de-9651-52de14d3f376 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:43.999163 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d8fc7-606a-49de-9651-52de14d3f376 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:44.000509 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d8fc7-606a-49de-9651-52de14d3f376 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:44.012231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 650/1284] 10.222.0.17 () {56 vars in 1109 bytes} [Tue Jul 12 13:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:44.017404 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b49e31-2ed8-4d3a-bc20-6dd15afd6ea4 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:44.110978 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b49e31-2ed8-4d3a-bc20-6dd15afd6ea4 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:44.124658 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:44.144814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52d50a-2f7a-4683-825b-368db0ec7f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:44.145596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52d50a-2f7a-4683-825b-368db0ec7f88 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:44.145879 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52d50a-2f7a-4683-825b-368db0ec7f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:44.146180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52d50a-2f7a-4683-825b-368db0ec7f88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:44.152582 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed52d50a-2f7a-4683-825b-368db0ec7f88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:44.154014 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed52d50a-2f7a-4683-825b-368db0ec7f88 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:44.167281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application [None req-ed52d50a-2f7a-4683-825b-368db0ec7f88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:07:44.167281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:44.167281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:44.167281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:44.167281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:44.167281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:44.167281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:44.167281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:44.167281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:44.167281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:44.167281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:44.167281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:44.167281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:07:44.167281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:07:44.167281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:07:44.168337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:07:44.168337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:44.168337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:44.168337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:44.168337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:44.168337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:44.168337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:44.168337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:44.168337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:44.168337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:44.168337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:44.168337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:44.168337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:44.168337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:44.168337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:44.168337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:44.168337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:44.169630 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:07:44.169630 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:07:44.169630 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:07:44.169630 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:07:44.169630 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:07:44.169630 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:07:44.169630 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:07:44.169630 dv-cinder-797608-55-smb devstack@keystone.service[80627]: ERROR keystone.server.flask.application Jul 12 13:07:44.169630 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 635/1285] 10.222.0.17 () {56 vars in 1111 bytes} [Tue Jul 12 13:07:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:44.174014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d8fc7-606a-49de-9651-52de14d3f376 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:44.222304 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:44.270486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d8fc7-606a-49de-9651-52de14d3f376 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:44.302608 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811bfce-3f25-4275-9802-a693723a89cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:44.303258 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811bfce-3f25-4275-9802-a693723a89cf None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:44.303542 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811bfce-3f25-4275-9802-a693723a89cf None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:44.303817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811bfce-3f25-4275-9802-a693723a89cf None admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:44.304588 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811bfce-3f25-4275-9802-a693723a89cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:44.304895 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811bfce-3f25-4275-9802-a693723a89cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:44.306327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811bfce-3f25-4275-9802-a693723a89cf None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:44.317831 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 651/1286] 10.222.0.17 () {56 vars in 1148 bytes} [Tue Jul 12 13:07:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:07:44.323806 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52d50a-2f7a-4683-825b-368db0ec7f88 None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:44.421726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52d50a-2f7a-4683-825b-368db0ec7f88 None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:44.454104 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a22937-185b-4e7d-8f03-891d1a58e133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:44.454779 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a22937-185b-4e7d-8f03-891d1a58e133 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:44.455068 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a22937-185b-4e7d-8f03-891d1a58e133 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:44.455350 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a22937-185b-4e7d-8f03-891d1a58e133 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:44.456175 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a22937-185b-4e7d-8f03-891d1a58e133 None admin] RBAC: Adding query filter params (role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0, scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2, user.id=698828dd940f46e2b493ba55cd894eac) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:44.456491 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a22937-185b-4e7d-8f03-891d1a58e133 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:44.457924 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a22937-185b-4e7d-8f03-891d1a58e133 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:44.463938 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 636/1287] 10.222.0.17 () {56 vars in 1374 bytes} [Tue Jul 12 13:07:44 2022] GET /identity/v3/role_assignments?user.id=698828dd940f46e2b493ba55cd894eac&scope.project.id=cd70432d4e5a4e25a4a6def32ffc6ee2&role.id=4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:46.466418 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39622297-5ce2-46c7-9b95-39eb9d6eaa5e None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:46.467055 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39622297-5ce2-46c7-9b95-39eb9d6eaa5e None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:46.467055 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39622297-5ce2-46c7-9b95-39eb9d6eaa5e None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:46.468338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 652/1288] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:07:46.473446 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bab141-4aae-41a2-b842-3f7e1263fc01 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:46.473838 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bab141-4aae-41a2-b842-3f7e1263fc01 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:46.474018 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bab141-4aae-41a2-b842-3f7e1263fc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:46.490944 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-c8bab141-4aae-41a2-b842-3f7e1263fc01 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:07:46.492137 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-c8bab141-4aae-41a2-b842-3f7e1263fc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:07:46.521121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:46.558039 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 637/1289] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:07:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:07:46.579562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39622297-5ce2-46c7-9b95-39eb9d6eaa5e None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:46.677784 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39622297-5ce2-46c7-9b95-39eb9d6eaa5e None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:46.688434 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:46.711167 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd4523-5071-4022-913e-7f5b3b065a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:46.711968 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd4523-5071-4022-913e-7f5b3b065a9d None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:46.712255 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd4523-5071-4022-913e-7f5b3b065a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:46.712534 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd4523-5071-4022-913e-7f5b3b065a9d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:46.713185 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd4523-5071-4022-913e-7f5b3b065a9d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:46.714598 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd4523-5071-4022-913e-7f5b3b065a9d None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:46.726833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-debd4523-5071-4022-913e-7f5b3b065a9d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 13:07:46.726833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:46.726833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:07:46.726833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:07:46.726833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:07:46.726833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:07:46.726833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:07:46.726833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:07:46.726833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 13:07:46.726833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:07:46.726833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:07:46.726833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:07:46.726833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:46.726833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:46.726833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:46.726833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:46.726833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:46.728124 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:46.728124 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:46.728124 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:46.728124 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:46.728124 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:46.728124 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:46.728124 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:07:46.728124 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:07:46.728124 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:07:46.728124 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:07:46.728124 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:46.728124 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:46.728124 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:46.728124 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:46.728124 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:46.728124 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:46.729300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:46.729300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:46.729300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:46.729300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:46.729300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:46.729300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:46.729300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:46.729300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:46.729300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:46.729300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:46.729300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:07:46.729300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:07:46.729300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 13:07:46.729300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:07:46.729300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 653/1290] 10.222.0.17 () {56 vars in 1117 bytes} [Tue Jul 12 13:07:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:46.733811 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bab141-4aae-41a2-b842-3f7e1263fc01 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:46.830328 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bab141-4aae-41a2-b842-3f7e1263fc01 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:46.863027 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a73c98-e799-4bba-b772-088c09ca6065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:46.864300 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a73c98-e799-4bba-b772-088c09ca6065 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:46.864586 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a73c98-e799-4bba-b772-088c09ca6065 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:46.864862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a73c98-e799-4bba-b772-088c09ca6065 None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:46.865559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a73c98-e799-4bba-b772-088c09ca6065 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:46.865866 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a73c98-e799-4bba-b772-088c09ca6065 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:46.867253 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a73c98-e799-4bba-b772-088c09ca6065 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:46.871933 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 638/1291] 10.222.0.17 () {56 vars in 1116 bytes} [Tue Jul 12 13:07:46 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:46.877576 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd4523-5071-4022-913e-7f5b3b065a9d None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:46.975500 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd4523-5071-4022-913e-7f5b3b065a9d None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:47.007003 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c8ef1-98cc-4f77-8562-9c70deb8a876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:47.007605 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c8ef1-98cc-4f77-8562-9c70deb8a876 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:47.007918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c8ef1-98cc-4f77-8562-9c70deb8a876 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:47.008199 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c8ef1-98cc-4f77-8562-9c70deb8a876 None admin] PATH_INFO: `/v3/services` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:47.008900 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c8ef1-98cc-4f77-8562-9c70deb8a876 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:47.009210 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c8ef1-98cc-4f77-8562-9c70deb8a876 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:47.010621 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c8ef1-98cc-4f77-8562-9c70deb8a876 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:47.015156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 654/1292] 10.222.0.17 () {56 vars in 1116 bytes} [Tue Jul 12 13:07:46 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:49.016198 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bce03b-cbdf-46fe-b723-2f02789fe087 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:49.016759 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bce03b-cbdf-46fe-b723-2f02789fe087 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:49.016759 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bce03b-cbdf-46fe-b723-2f02789fe087 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:49.018168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 639/1293] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:07:49.023925 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa5eb4-efac-452f-9e00-9b6c5ba7e348 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:49.024325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa5eb4-efac-452f-9e00-9b6c5ba7e348 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:49.024485 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa5eb4-efac-452f-9e00-9b6c5ba7e348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:49.040826 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-6cfa5eb4-efac-452f-9e00-9b6c5ba7e348 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:07:49.042017 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-6cfa5eb4-efac-452f-9e00-9b6c5ba7e348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:07:49.070796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:49.109201 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 655/1294] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:07:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:07:49.132115 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bce03b-cbdf-46fe-b723-2f02789fe087 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:49.163187 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:49.233585 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bce03b-cbdf-46fe-b723-2f02789fe087 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:49.268149 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b19b1f-77cf-446f-bb0f-acbb9f1f1f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:49.268738 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b19b1f-77cf-446f-bb0f-acbb9f1f1f7c None admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:49.269025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b19b1f-77cf-446f-bb0f-acbb9f1f1f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:49.269302 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b19b1f-77cf-446f-bb0f-acbb9f1f1f7c None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:49.270054 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b19b1f-77cf-446f-bb0f-acbb9f1f1f7c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:49.271437 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b19b1f-77cf-446f-bb0f-acbb9f1f1f7c None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:49.284256 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 640/1295] 10.222.0.17 () {60 vars in 1141 bytes} [Tue Jul 12 13:07:49 2022] POST /identity/v3/services => generated 246 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:07:51.302079 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb045c-0d86-4062-a692-d6e46c9c92e2 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:51.302637 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb045c-0d86-4062-a692-d6e46c9c92e2 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:51.302753 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb045c-0d86-4062-a692-d6e46c9c92e2 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:51.304032 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 656/1296] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:07:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:07:51.309374 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3623f2e-7b8a-40f2-96a8-8ffd9d2a2f23 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:51.309764 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3623f2e-7b8a-40f2-96a8-8ffd9d2a2f23 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:51.309935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3623f2e-7b8a-40f2-96a8-8ffd9d2a2f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:51.326330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-b3623f2e-7b8a-40f2-96a8-8ffd9d2a2f23 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:07:51.327512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-b3623f2e-7b8a-40f2-96a8-8ffd9d2a2f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:07:51.399016 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 641/1297] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:07:51 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:07:51.430564 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb045c-0d86-4062-a692-d6e46c9c92e2 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:51.542779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb045c-0d86-4062-a692-d6e46c9c92e2 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:51.575745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394d20f-678c-4af5-8306-158a9a1562a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:51.576482 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394d20f-678c-4af5-8306-158a9a1562a1 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:51.576771 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394d20f-678c-4af5-8306-158a9a1562a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:51.577051 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394d20f-678c-4af5-8306-158a9a1562a1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:51.577705 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394d20f-678c-4af5-8306-158a9a1562a1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:51.579112 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394d20f-678c-4af5-8306-158a9a1562a1 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:51.591581 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-7394d20f-678c-4af5-8306-158a9a1562a1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 13:07:51.591581 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:51.591581 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:07:51.591581 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:07:51.591581 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:07:51.591581 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:07:51.591581 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:07:51.591581 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:07:51.591581 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 13:07:51.591581 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:07:51.591581 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:07:51.591581 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:07:51.591581 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:51.591581 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:51.591581 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:51.591581 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:51.591581 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:51.592741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:51.592741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:51.592741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:51.592741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:51.592741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:51.592741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:51.592741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:07:51.592741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:07:51.592741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:07:51.592741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:07:51.592741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:51.592741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:51.592741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:51.592741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:51.592741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:51.592741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:51.593943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:51.593943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:51.593943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:51.593943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:51.593943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:51.593943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:51.593943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:51.593943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:51.593943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:51.593943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:51.593943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:07:51.593943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:07:51.593943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 13:07:51.593943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:07:51.593943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 657/1298] 10.222.0.17 () {56 vars in 1117 bytes} [Tue Jul 12 13:07:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:51.601623 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3623f2e-7b8a-40f2-96a8-8ffd9d2a2f23 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:51.626021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:51.710528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3623f2e-7b8a-40f2-96a8-8ffd9d2a2f23 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:51.745164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014ce61-b031-4114-bbcb-803ac7758bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:51.745819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014ce61-b031-4114-bbcb-803ac7758bba None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:51.746095 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014ce61-b031-4114-bbcb-803ac7758bba None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:51.746399 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014ce61-b031-4114-bbcb-803ac7758bba None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:51.747096 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014ce61-b031-4114-bbcb-803ac7758bba None admin] RBAC: Adding query filter params (name=placement) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:51.747403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014ce61-b031-4114-bbcb-803ac7758bba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:51.748756 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014ce61-b031-4114-bbcb-803ac7758bba None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:51.753843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 642/1299] 10.222.0.17 () {56 vars in 1116 bytes} [Tue Jul 12 13:07:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:51.759773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394d20f-678c-4af5-8306-158a9a1562a1 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:51.791177 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:51.858334 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394d20f-678c-4af5-8306-158a9a1562a1 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:51.891117 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebb9c5-72ce-4f21-a01f-ef06e71dae5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:51.891774 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebb9c5-72ce-4f21-a01f-ef06e71dae5d None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:51.892086 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebb9c5-72ce-4f21-a01f-ef06e71dae5d None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:51.892370 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebb9c5-72ce-4f21-a01f-ef06e71dae5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:51.893220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebb9c5-72ce-4f21-a01f-ef06e71dae5d None admin] RBAC: Adding query filter params (interface=public, service_id=f11d2cfa5f274280be16c3fc2a610b7e, region_id=RegionOne) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:51.893560 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebb9c5-72ce-4f21-a01f-ef06e71dae5d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:51.895617 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebb9c5-72ce-4f21-a01f-ef06e71dae5d None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:51.900570 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 658/1300] 10.222.0.17 () {56 vars in 1251 bytes} [Tue Jul 12 13:07:51 2022] GET /identity/v3/endpoints?service_id=f11d2cfa5f274280be16c3fc2a610b7e&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:51.906276 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014ce61-b031-4114-bbcb-803ac7758bba None admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:51.986257 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:52.004723 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014ce61-b031-4114-bbcb-803ac7758bba None admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:52.038010 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051df654-cf10-4902-a8bd-3febb2c8673e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:52.038699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051df654-cf10-4902-a8bd-3febb2c8673e None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:52.038988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051df654-cf10-4902-a8bd-3febb2c8673e None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:52.039265 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051df654-cf10-4902-a8bd-3febb2c8673e None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:52.039942 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051df654-cf10-4902-a8bd-3febb2c8673e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:52.041297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051df654-cf10-4902-a8bd-3febb2c8673e None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:52.047964 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 643/1301] 10.222.0.17 () {56 vars in 1087 bytes} [Tue Jul 12 13:07:51 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:07:54.048101 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a596b66-d29e-4aa6-a069-c33763aba195 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:54.048629 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a596b66-d29e-4aa6-a069-c33763aba195 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:54.048745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a596b66-d29e-4aa6-a069-c33763aba195 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:54.050283 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 659/1302] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:07:54.055212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae838a87-de45-48ef-b934-473b60269c71 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:54.055590 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae838a87-de45-48ef-b934-473b60269c71 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:54.055772 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae838a87-de45-48ef-b934-473b60269c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:54.072601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-ae838a87-de45-48ef-b934-473b60269c71 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:07:54.073779 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-ae838a87-de45-48ef-b934-473b60269c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:07:54.139027 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 644/1303] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:07:54 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:07:54.161986 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a596b66-d29e-4aa6-a069-c33763aba195 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:54.255647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:54.263066 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a596b66-d29e-4aa6-a069-c33763aba195 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:54.295830 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6933057-d89e-4310-9814-5f63d39da5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:54.296628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6933057-d89e-4310-9814-5f63d39da5d1 None admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:54.296910 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6933057-d89e-4310-9814-5f63d39da5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:54.297179 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6933057-d89e-4310-9814-5f63d39da5d1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:54.297816 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6933057-d89e-4310-9814-5f63d39da5d1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:54.299266 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6933057-d89e-4310-9814-5f63d39da5d1 None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:54.311388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application [None req-a6933057-d89e-4310-9814-5f63d39da5d1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 13:07:54.311388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:54.311388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:07:54.311388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:07:54.311388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:07:54.311388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:07:54.311388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:07:54.311388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:07:54.311388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 13:07:54.311388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:07:54.311388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:07:54.311388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:07:54.311388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:07:54.311388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:07:54.311388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:07:54.311388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:07:54.311388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:07:54.312545 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:07:54.312545 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:07:54.312545 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:07:54.312545 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:07:54.312545 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:07:54.312545 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:07:54.312545 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:07:54.312545 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:07:54.312545 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:07:54.312545 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:07:54.312545 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:07:54.312545 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:07:54.312545 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:07:54.312545 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:07:54.312545 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:07:54.312545 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:07:54.313456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:07:54.313456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application with Lock( Jul 12 13:07:54.313456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:07:54.313456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:07:54.313456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:07:54.313456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:07:54.313456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:07:54.313456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:07:54.313456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:07:54.313456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:07:54.313456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:07:54.313456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:07:54.313456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 13:07:54.313456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: ERROR keystone.server.flask.application Jul 12 13:07:54.313456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 660/1304] 10.222.0.17 () {56 vars in 1117 bytes} [Tue Jul 12 13:07:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:07:54.318895 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae838a87-de45-48ef-b934-473b60269c71 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:54.392311 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:54.419014 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae838a87-de45-48ef-b934-473b60269c71 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:54.458885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9d675-8d24-44b0-acf9-f1d14e6d7e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:54.459766 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9d675-8d24-44b0-acf9-f1d14e6d7e02 None admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:54.460074 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9d675-8d24-44b0-acf9-f1d14e6d7e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:54.460374 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9d675-8d24-44b0-acf9-f1d14e6d7e02 None admin] PATH_INFO: `/v3/services` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:54.461175 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9d675-8d24-44b0-acf9-f1d14e6d7e02 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:07:54.461511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9d675-8d24-44b0-acf9-f1d14e6d7e02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:54.463073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9d675-8d24-44b0-acf9-f1d14e6d7e02 None admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:54.469187 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 645/1305] 10.222.0.17 () {56 vars in 1116 bytes} [Tue Jul 12 13:07:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:07:54.476026 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6933057-d89e-4310-9814-5f63d39da5d1 None admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:07:54.573205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6933057-d89e-4310-9814-5f63d39da5d1 None admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:07:54.605664 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366879f-1411-44dd-b077-ed506143e60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:07:54.606347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366879f-1411-44dd-b077-ed506143e60e None admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:07:54.606633 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366879f-1411-44dd-b077-ed506143e60e None admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:07:54.606909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366879f-1411-44dd-b077-ed506143e60e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:07:54.607642 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366879f-1411-44dd-b077-ed506143e60e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:07:54.609008 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366879f-1411-44dd-b077-ed506143e60e None admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:07:54.627729 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 661/1306] 10.222.0.17 () {60 vars in 1144 bytes} [Tue Jul 12 13:07:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:08:04.466281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=30 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:08:04.624105 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:08:58.338742 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8508f-0c41-4999-bec8-5cb61751fcca None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:08:58.339258 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8508f-0c41-4999-bec8-5cb61751fcca None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:08:58.339356 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8508f-0c41-4999-bec8-5cb61751fcca None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:08:58.341015 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 646/1307] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:08:58.346085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be20c9-aebc-4671-9cd5-406a88fa1a41 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:08:58.347150 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be20c9-aebc-4671-9cd5-406a88fa1a41 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:08:58.347246 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be20c9-aebc-4671-9cd5-406a88fa1a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:08:58.506490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-44be20c9-aebc-4671-9cd5-406a88fa1a41 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:08:58.508087 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-44be20c9-aebc-4671-9cd5-406a88fa1a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:08:58.649770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 662/1308] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:08:58.700047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8ecb2-b7f6-4397-acac-0e0abc9038e2 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:08:58.700387 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8ecb2-b7f6-4397-acac-0e0abc9038e2 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:08:58.700623 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8ecb2-b7f6-4397-acac-0e0abc9038e2 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:08:58.702279 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 647/1309] 10.222.0.17 () {54 vars in 964 bytes} [Tue Jul 12 13:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:08:58.708790 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea494f-7728-46c6-80bc-7ad8f6545848 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:08:58.709088 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea494f-7728-46c6-80bc-7ad8f6545848 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:08:58.709394 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea494f-7728-46c6-80bc-7ad8f6545848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:08:58.804109 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-4eea494f-7728-46c6-80bc-7ad8f6545848 None None] MFA Rules not processed for user `0f39694be5f447f9a25dacf7e4c99a4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:08:58.805686 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-4eea494f-7728-46c6-80bc-7ad8f6545848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:08:58.829340 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:08:58.894174 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 663/1310] 10.222.0.17 () {58 vars in 1061 bytes} [Tue Jul 12 13:08:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:08:58.903045 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8ecb2-b7f6-4397-acac-0e0abc9038e2 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:08:58.904857 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-41d8ecb2-b7f6-4397-acac-0e0abc9038e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:08:59.052379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8ecb2-b7f6-4397-acac-0e0abc9038e2 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:08:59.141035 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182957f3-ca72-49a6-92cd-547123e1cfbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:08:59.141701 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182957f3-ca72-49a6-92cd-547123e1cfbf service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:08:59.141993 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182957f3-ca72-49a6-92cd-547123e1cfbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:08:59.142305 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182957f3-ca72-49a6-92cd-547123e1cfbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:08:59.144566 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-182957f3-ca72-49a6-92cd-547123e1cfbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:08:59.208129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:08:59.271481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182957f3-ca72-49a6-92cd-547123e1cfbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:08:59.273288 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182957f3-ca72-49a6-92cd-547123e1cfbf service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:08:59.294039 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 648/1311] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:08:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:09:01.641194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9355d-9c86-4bde-b14c-813e19352100 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:01.641729 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9355d-9c86-4bde-b14c-813e19352100 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:01.641911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9355d-9c86-4bde-b14c-813e19352100 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:01.643980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 664/1312] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:09:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:09:01.649331 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b38748-4cdf-4568-886d-8de8f28b9d98 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:01.649746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b38748-4cdf-4568-886d-8de8f28b9d98 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:01.649933 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b38748-4cdf-4568-886d-8de8f28b9d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:01.732655 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-46b38748-4cdf-4568-886d-8de8f28b9d98 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:09:01.734300 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-46b38748-4cdf-4568-886d-8de8f28b9d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:01.829390 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 649/1313] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:09:01.867309 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9355d-9c86-4bde-b14c-813e19352100 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:09:01.868889 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-c8c9355d-9c86-4bde-b14c-813e19352100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:01.980479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9355d-9c86-4bde-b14c-813e19352100 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:09:02.054844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:02.057391 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b2ed4-7d86-4183-adcd-a4623eb2c873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:09:02.058036 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b2ed4-7d86-4183-adcd-a4623eb2c873 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:02.058589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b2ed4-7d86-4183-adcd-a4623eb2c873 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:02.058914 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b2ed4-7d86-4183-adcd-a4623eb2c873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:02.060964 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-b79b2ed4-7d86-4183-adcd-a4623eb2c873 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:02.170440 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b2ed4-7d86-4183-adcd-a4623eb2c873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:09:02.171802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b2ed4-7d86-4183-adcd-a4623eb2c873 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:09:02.190861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 665/1314] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:09:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:09:04.501533 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa3136-dbbb-4d0f-a8ea-b055ab93c72f None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:04.502642 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa3136-dbbb-4d0f-a8ea-b055ab93c72f None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:04.502642 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa3136-dbbb-4d0f-a8ea-b055ab93c72f None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:04.504118 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 650/1315] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:09:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:09:04.509164 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40254bb7-fcf9-435a-a7fd-9a624cc0082d None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:04.509599 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40254bb7-fcf9-435a-a7fd-9a624cc0082d None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:04.509727 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40254bb7-fcf9-435a-a7fd-9a624cc0082d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:04.573532 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-40254bb7-fcf9-435a-a7fd-9a624cc0082d None None] MFA Rules not processed for user `83d847fc6deb46e7aec5aa75d815215c`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:09:04.574791 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-40254bb7-fcf9-435a-a7fd-9a624cc0082d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:04.627465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:04.673578 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 666/1316] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:09:04 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:09:04.727662 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f18b7-7d20-4e88-b1ca-fc9529b5cb28 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:04.727954 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f18b7-7d20-4e88-b1ca-fc9529b5cb28 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:04.728235 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f18b7-7d20-4e88-b1ca-fc9529b5cb28 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:04.729611 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 651/1317] 10.222.0.17 () {54 vars in 964 bytes} [Tue Jul 12 13:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:09:04.735482 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda5dda-14d4-47d4-b32c-5c95d2646a78 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:04.735777 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda5dda-14d4-47d4-b32c-5c95d2646a78 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:04.736062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda5dda-14d4-47d4-b32c-5c95d2646a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:04.810444 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-6eda5dda-14d4-47d4-b32c-5c95d2646a78 None None] MFA Rules not processed for user `0f39694be5f447f9a25dacf7e4c99a4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:09:04.811584 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-6eda5dda-14d4-47d4-b32c-5c95d2646a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:04.887197 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 667/1318] 10.222.0.17 () {58 vars in 1061 bytes} [Tue Jul 12 13:09:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:09:04.896632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f18b7-7d20-4e88-b1ca-fc9529b5cb28 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:09:04.898217 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-448f18b7-7d20-4e88-b1ca-fc9529b5cb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:04.908065 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:05.004915 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f18b7-7d20-4e88-b1ca-fc9529b5cb28 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:09:05.091103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7edac-d6c4-4600-84af-533faff7c407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:09:05.091681 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7edac-d6c4-4600-84af-533faff7c407 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:05.091967 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7edac-d6c4-4600-84af-533faff7c407 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:05.092243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7edac-d6c4-4600-84af-533faff7c407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:05.093972 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-91b7edac-d6c4-4600-84af-533faff7c407 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:05.163387 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:05.214864 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7edac-d6c4-4600-84af-533faff7c407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:09:05.216341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7edac-d6c4-4600-84af-533faff7c407 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:09:05.237772 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 652/1319] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:09:04 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:09:08.195024 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b12f76-9aab-48a7-bc04-e09794e8c5ec None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:08.195585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b12f76-9aab-48a7-bc04-e09794e8c5ec None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:08.195585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b12f76-9aab-48a7-bc04-e09794e8c5ec None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:08.196975 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 668/1320] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:09:08.202095 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584bfb7-a147-47b8-ba48-b920edaac563 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:08.202494 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584bfb7-a147-47b8-ba48-b920edaac563 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:08.202685 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584bfb7-a147-47b8-ba48-b920edaac563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:08.268286 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-a584bfb7-a147-47b8-ba48-b920edaac563 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:09:08.269495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-a584bfb7-a147-47b8-ba48-b920edaac563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:08.361558 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 653/1321] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:09:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:09:08.400274 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b12f76-9aab-48a7-bc04-e09794e8c5ec None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:09:08.401837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-80b12f76-9aab-48a7-bc04-e09794e8c5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:08.452161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:08.506221 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b12f76-9aab-48a7-bc04-e09794e8c5ec None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:09:08.578599 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557a8a2-fc7c-404e-a1e6-db74b3f82d81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:09:08.579253 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557a8a2-fc7c-404e-a1e6-db74b3f82d81 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:08.579542 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557a8a2-fc7c-404e-a1e6-db74b3f82d81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:08.579824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557a8a2-fc7c-404e-a1e6-db74b3f82d81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:08.581505 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-b557a8a2-fc7c-404e-a1e6-db74b3f82d81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:08.675151 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:08.688894 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557a8a2-fc7c-404e-a1e6-db74b3f82d81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:09:08.690363 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557a8a2-fc7c-404e-a1e6-db74b3f82d81 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:09:08.708807 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 669/1322] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:09:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:09:11.398721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a9212-47b2-4bbc-a4da-23e9e2aebd6b None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:11.399291 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a9212-47b2-4bbc-a4da-23e9e2aebd6b None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:11.399291 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a9212-47b2-4bbc-a4da-23e9e2aebd6b None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:11.400669 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 654/1323] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:09:11.406031 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f4ad1-04d7-4972-b585-7f07e2fa09d0 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:11.406496 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f4ad1-04d7-4972-b585-7f07e2fa09d0 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:11.406753 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f4ad1-04d7-4972-b585-7f07e2fa09d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:11.473649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-074f4ad1-04d7-4972-b585-7f07e2fa09d0 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:09:11.474888 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-074f4ad1-04d7-4972-b585-7f07e2fa09d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:11.583939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 670/1324] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:09:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:09:11.621624 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a9212-47b2-4bbc-a4da-23e9e2aebd6b None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:09:11.623215 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-cb5a9212-47b2-4bbc-a4da-23e9e2aebd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:11.644329 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:11.736493 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a9212-47b2-4bbc-a4da-23e9e2aebd6b None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:09:11.808908 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6274ee-d2f6-4439-bfd6-0699d3ae6f63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:09:11.809558 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6274ee-d2f6-4439-bfd6-0699d3ae6f63 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:11.809839 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6274ee-d2f6-4439-bfd6-0699d3ae6f63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:11.810141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6274ee-d2f6-4439-bfd6-0699d3ae6f63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:11.811762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-5e6274ee-d2f6-4439-bfd6-0699d3ae6f63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:11.882212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:11.921174 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6274ee-d2f6-4439-bfd6-0699d3ae6f63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:09:11.922735 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6274ee-d2f6-4439-bfd6-0699d3ae6f63 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:09:11.941156 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 655/1325] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:09:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:09:14.024849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad4743-d467-4b2d-b2aa-a82663516a33 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:14.025363 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad4743-d467-4b2d-b2aa-a82663516a33 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:14.025363 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad4743-d467-4b2d-b2aa-a82663516a33 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:14.026813 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 671/1326] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:09:14.032071 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531b1b1-903f-4dea-8697-f59a9ffeb5ae None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:14.032489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531b1b1-903f-4dea-8697-f59a9ffeb5ae None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:14.032637 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531b1b1-903f-4dea-8697-f59a9ffeb5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:14.097434 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-0531b1b1-903f-4dea-8697-f59a9ffeb5ae None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:09:14.098664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-0531b1b1-903f-4dea-8697-f59a9ffeb5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:14.193482 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 656/1327] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:09:14.230558 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad4743-d467-4b2d-b2aa-a82663516a33 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:09:14.232115 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-0dad4743-d467-4b2d-b2aa-a82663516a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:14.294971 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:14.341410 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad4743-d467-4b2d-b2aa-a82663516a33 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:09:14.422067 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc71fc-5999-4182-9a54-15f2ee753135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:09:14.422764 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc71fc-5999-4182-9a54-15f2ee753135 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:14.423048 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc71fc-5999-4182-9a54-15f2ee753135 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:14.423325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc71fc-5999-4182-9a54-15f2ee753135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:14.425663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-69fc71fc-5999-4182-9a54-15f2ee753135 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:14.530803 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:14.534076 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc71fc-5999-4182-9a54-15f2ee753135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:09:14.536086 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc71fc-5999-4182-9a54-15f2ee753135 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:09:14.555792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 672/1328] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:09:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:09:16.644368 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ac388-b679-4ba8-a862-071245fb3552 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:16.644934 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ac388-b679-4ba8-a862-071245fb3552 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:16.644934 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ac388-b679-4ba8-a862-071245fb3552 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:16.646377 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 657/1329] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:09:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:09:16.651603 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44de8ae-9868-495e-859e-50f54d1e62dc None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:16.652365 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44de8ae-9868-495e-859e-50f54d1e62dc None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:16.652656 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44de8ae-9868-495e-859e-50f54d1e62dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:16.723515 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-e44de8ae-9868-495e-859e-50f54d1e62dc None None] MFA Rules not processed for user `83d847fc6deb46e7aec5aa75d815215c`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:09:16.724752 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-e44de8ae-9868-495e-859e-50f54d1e62dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:16.824122 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 673/1330] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:09:16 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:09:16.861173 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ac388-b679-4ba8-a862-071245fb3552 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:09:16.862724 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-366ac388-b679-4ba8-a862-071245fb3552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:16.894336 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:16.968172 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ac388-b679-4ba8-a862-071245fb3552 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:09:17.043027 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee6a7e-20a3-4e74-a4fb-1118f85d4212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:09:17.043681 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee6a7e-20a3-4e74-a4fb-1118f85d4212 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:17.043967 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee6a7e-20a3-4e74-a4fb-1118f85d4212 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:17.044245 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee6a7e-20a3-4e74-a4fb-1118f85d4212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:17.045881 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-2dee6a7e-20a3-4e74-a4fb-1118f85d4212 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:17.121923 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:17.168233 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee6a7e-20a3-4e74-a4fb-1118f85d4212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:09:17.169707 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee6a7e-20a3-4e74-a4fb-1118f85d4212 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:09:17.192359 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 658/1331] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:09:16 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:09:19.455202 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840875eb-3305-4fdc-a7a5-3e1b72d8b329 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:19.455743 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840875eb-3305-4fdc-a7a5-3e1b72d8b329 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:19.455878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840875eb-3305-4fdc-a7a5-3e1b72d8b329 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:19.457180 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 674/1332] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:09:19.462974 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbb7ef-bfb7-42d4-92fe-985c04e4595d None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:19.463360 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbb7ef-bfb7-42d4-92fe-985c04e4595d None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:19.463541 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbb7ef-bfb7-42d4-92fe-985c04e4595d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:19.528303 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-73cbb7ef-bfb7-42d4-92fe-985c04e4595d None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:09:19.529534 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-73cbb7ef-bfb7-42d4-92fe-985c04e4595d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:19.625673 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 659/1333] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:09:19.660845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840875eb-3305-4fdc-a7a5-3e1b72d8b329 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:09:19.662417 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-840875eb-3305-4fdc-a7a5-3e1b72d8b329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:19.731594 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:19.765785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840875eb-3305-4fdc-a7a5-3e1b72d8b329 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:09:19.836840 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54799d80-65b0-4ce2-860b-4d3e3d738000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:09:19.837490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54799d80-65b0-4ce2-860b-4d3e3d738000 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:19.837778 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54799d80-65b0-4ce2-860b-4d3e3d738000 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:19.838059 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54799d80-65b0-4ce2-860b-4d3e3d738000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:19.839729 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-54799d80-65b0-4ce2-860b-4d3e3d738000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:19.947399 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54799d80-65b0-4ce2-860b-4d3e3d738000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:09:19.948833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54799d80-65b0-4ce2-860b-4d3e3d738000 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:09:19.959076 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:19.967771 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 675/1334] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:09:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:09:22.013835 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be53030-4cb4-4b7d-a3d6-ac9024e9b1fb None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:22.014399 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be53030-4cb4-4b7d-a3d6-ac9024e9b1fb None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:22.014496 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be53030-4cb4-4b7d-a3d6-ac9024e9b1fb None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:22.015822 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 660/1335] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:09:22.021401 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf3e38-f59b-434d-9a48-c3e3000353d4 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:22.021814 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf3e38-f59b-434d-9a48-c3e3000353d4 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:22.021962 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf3e38-f59b-434d-9a48-c3e3000353d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:22.084632 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-dabf3e38-f59b-434d-9a48-c3e3000353d4 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:09:22.085831 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-dabf3e38-f59b-434d-9a48-c3e3000353d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:22.179939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 676/1336] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:09:22.218990 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be53030-4cb4-4b7d-a3d6-ac9024e9b1fb None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:09:22.220566 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-7be53030-4cb4-4b7d-a3d6-ac9024e9b1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:22.260843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:22.324353 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be53030-4cb4-4b7d-a3d6-ac9024e9b1fb None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:09:22.397128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577d3b8-c737-474d-8068-f23aabc8e6ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:09:22.397782 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577d3b8-c737-474d-8068-f23aabc8e6ca service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:22.398068 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577d3b8-c737-474d-8068-f23aabc8e6ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:22.398375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577d3b8-c737-474d-8068-f23aabc8e6ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:22.400008 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-d577d3b8-c737-474d-8068-f23aabc8e6ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:22.481633 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:22.508116 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577d3b8-c737-474d-8068-f23aabc8e6ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:09:22.509548 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577d3b8-c737-474d-8068-f23aabc8e6ca service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:09:22.529034 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 661/1337] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:09:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:09:25.020635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b8065-e936-44cd-9fff-01c32f28dfb0 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:25.021203 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b8065-e936-44cd-9fff-01c32f28dfb0 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:25.021203 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b8065-e936-44cd-9fff-01c32f28dfb0 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:25.022599 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 677/1338] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:09:25.027834 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f160c54-4f5c-4dcc-85e0-7c1bfa3af2ce None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:25.028262 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f160c54-4f5c-4dcc-85e0-7c1bfa3af2ce None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:25.028387 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f160c54-4f5c-4dcc-85e0-7c1bfa3af2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:25.092156 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-2f160c54-4f5c-4dcc-85e0-7c1bfa3af2ce None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:09:25.093375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-2f160c54-4f5c-4dcc-85e0-7c1bfa3af2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:25.189876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 662/1339] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:09:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:09:25.227291 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b8065-e936-44cd-9fff-01c32f28dfb0 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:09:25.228845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a33b8065-e936-44cd-9fff-01c32f28dfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:25.305085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:25.332808 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b8065-e936-44cd-9fff-01c32f28dfb0 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:09:25.404767 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef8845-8359-42e7-b07c-93bf391575af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:09:25.405411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef8845-8359-42e7-b07c-93bf391575af service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:25.405696 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef8845-8359-42e7-b07c-93bf391575af service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:25.405971 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef8845-8359-42e7-b07c-93bf391575af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:25.407660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-0aef8845-8359-42e7-b07c-93bf391575af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:25.517239 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef8845-8359-42e7-b07c-93bf391575af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:09:25.518733 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef8845-8359-42e7-b07c-93bf391575af service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:09:25.538539 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 678/1340] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:09:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:09:29.604504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8138a3-6c33-4fce-995d-98f0bc93e080 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:29.605053 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8138a3-6c33-4fce-995d-98f0bc93e080 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:29.605053 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8138a3-6c33-4fce-995d-98f0bc93e080 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:29.606411 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 663/1341] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:09:29.611815 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4679c1-a0b4-4637-9213-fbe63df67eb3 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:29.612244 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4679c1-a0b4-4637-9213-fbe63df67eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:29.612356 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4679c1-a0b4-4637-9213-fbe63df67eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:29.616870 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:29.681207 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-9c4679c1-a0b4-4637-9213-fbe63df67eb3 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:09:29.682467 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-9c4679c1-a0b4-4637-9213-fbe63df67eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:29.780095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 679/1342] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:09:29.818780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8138a3-6c33-4fce-995d-98f0bc93e080 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:09:29.820301 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-7f8138a3-6c33-4fce-995d-98f0bc93e080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:29.868001 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:29.923842 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8138a3-6c33-4fce-995d-98f0bc93e080 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:09:29.998835 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2373e0d-cfb2-49d1-a7ac-8df055d59ced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:09:29.999483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2373e0d-cfb2-49d1-a7ac-8df055d59ced service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:29.999765 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2373e0d-cfb2-49d1-a7ac-8df055d59ced service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:30.000043 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2373e0d-cfb2-49d1-a7ac-8df055d59ced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:30.002242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-c2373e0d-cfb2-49d1-a7ac-8df055d59ced service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:30.095919 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:30.113363 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2373e0d-cfb2-49d1-a7ac-8df055d59ced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:09:30.114859 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2373e0d-cfb2-49d1-a7ac-8df055d59ced service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:09:30.133748 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 664/1343] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:09:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:09:32.787279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5746e-a306-4090-bb2c-14778ab69390 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:32.787831 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5746e-a306-4090-bb2c-14778ab69390 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:32.787831 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5746e-a306-4090-bb2c-14778ab69390 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:32.789243 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 680/1344] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:09:32.795090 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f7640-45d5-46ac-a306-a6501fd925fa None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:32.795653 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f7640-45d5-46ac-a306-a6501fd925fa None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:32.795653 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f7640-45d5-46ac-a306-a6501fd925fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:32.867754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-778f7640-45d5-46ac-a306-a6501fd925fa None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:09:32.868988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-778f7640-45d5-46ac-a306-a6501fd925fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:32.970064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 665/1345] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:09:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:09:33.006661 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5746e-a306-4090-bb2c-14778ab69390 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:09:33.008229 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-cde5746e-a306-4090-bb2c-14778ab69390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:33.095389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:33.112463 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5746e-a306-4090-bb2c-14778ab69390 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:09:33.185300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044c276-3f9d-422b-9962-5d7fa11afc8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:09:33.185869 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044c276-3f9d-422b-9962-5d7fa11afc8b service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:33.186249 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044c276-3f9d-422b-9962-5d7fa11afc8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:33.186537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044c276-3f9d-422b-9962-5d7fa11afc8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:33.189568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-d044c276-3f9d-422b-9962-5d7fa11afc8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:33.298642 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044c276-3f9d-422b-9962-5d7fa11afc8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:09:33.300195 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044c276-3f9d-422b-9962-5d7fa11afc8b service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:09:33.318410 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 681/1346] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:09:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:09:37.518323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533f7b7-0447-4341-b33f-34b663daee2e None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:37.519687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533f7b7-0447-4341-b33f-34b663daee2e None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:37.520113 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533f7b7-0447-4341-b33f-34b663daee2e None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:37.523100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 666/1347] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:09:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:09:37.528284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e446cd3-5ba5-46c0-a1cf-951f82598b7d None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:37.528710 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e446cd3-5ba5-46c0-a1cf-951f82598b7d None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:37.528887 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e446cd3-5ba5-46c0-a1cf-951f82598b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:37.545576 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:37.604825 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-2e446cd3-5ba5-46c0-a1cf-951f82598b7d None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:09:37.606080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-2e446cd3-5ba5-46c0-a1cf-951f82598b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:37.716083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 682/1348] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:09:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:09:37.754517 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533f7b7-0447-4341-b33f-34b663daee2e None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:09:37.756153 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-3533f7b7-0447-4341-b33f-34b663daee2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:37.818048 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:37.866790 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533f7b7-0447-4341-b33f-34b663daee2e None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:09:37.944207 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84041713-984d-4353-8b6a-8c7a0f636037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:09:37.944874 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84041713-984d-4353-8b6a-8c7a0f636037 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:37.945162 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84041713-984d-4353-8b6a-8c7a0f636037 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:37.945439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84041713-984d-4353-8b6a-8c7a0f636037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:37.947134 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-84041713-984d-4353-8b6a-8c7a0f636037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:38.058260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:38.062000 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84041713-984d-4353-8b6a-8c7a0f636037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:09:38.063968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84041713-984d-4353-8b6a-8c7a0f636037 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:09:38.083064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 667/1349] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:09:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:09:43.025024 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ee8ac-959e-479a-8f5a-1a970c8bf7e6 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:43.025024 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ee8ac-959e-479a-8f5a-1a970c8bf7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:43.025708 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ee8ac-959e-479a-8f5a-1a970c8bf7e6 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:43.027005 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 683/1350] 10.222.0.17 () {54 vars in 921 bytes} [Tue Jul 12 13:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:09:43.031807 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9bdd3-0f01-477c-9522-0f2b120d6f5a None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:43.032232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9bdd3-0f01-477c-9522-0f2b120d6f5a None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:43.033013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9bdd3-0f01-477c-9522-0f2b120d6f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:43.143170 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-01d9bdd3-0f01-477c-9522-0f2b120d6f5a None None] MFA Rules not processed for user `698828dd940f46e2b493ba55cd894eac`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:09:43.145880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-01d9bdd3-0f01-477c-9522-0f2b120d6f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:43.288918 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 668/1351] 10.222.0.17 () {58 vars in 1018 bytes} [Tue Jul 12 13:09:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:09:47.595048 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf910d-b20a-4915-9ae0-cb8ee98cf97b None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:47.595595 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf910d-b20a-4915-9ae0-cb8ee98cf97b None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:47.595857 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf910d-b20a-4915-9ae0-cb8ee98cf97b None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:47.597735 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 684/1352] 10.222.0.17 () {54 vars in 921 bytes} [Tue Jul 12 13:09:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:09:47.602580 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ead804-7f5e-435b-8aef-11fa447480e6 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:47.603026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ead804-7f5e-435b-8aef-11fa447480e6 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:47.603185 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ead804-7f5e-435b-8aef-11fa447480e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:47.665393 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:47.697692 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-77ead804-7f5e-435b-8aef-11fa447480e6 None None] MFA Rules not processed for user `698828dd940f46e2b493ba55cd894eac`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:09:47.699305 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-77ead804-7f5e-435b-8aef-11fa447480e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:47.713685 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=59 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:47.821425 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 669/1353] 10.222.0.17 () {58 vars in 1018 bytes} [Tue Jul 12 13:09:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:09:48.981631 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbf499-1d00-44ef-9922-40eedb3623b4 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:48.982190 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbf499-1d00-44ef-9922-40eedb3623b4 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:48.982292 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbf499-1d00-44ef-9922-40eedb3623b4 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:48.983596 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 685/1354] 10.222.0.17 () {54 vars in 921 bytes} [Tue Jul 12 13:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:09:48.988796 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8160e4b-a0e8-476c-b1cc-4c269db48017 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:48.989226 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8160e4b-a0e8-476c-b1cc-4c269db48017 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:48.989429 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8160e4b-a0e8-476c-b1cc-4c269db48017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:49.065899 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-b8160e4b-a0e8-476c-b1cc-4c269db48017 None None] MFA Rules not processed for user `698828dd940f46e2b493ba55cd894eac`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:09:49.067148 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-b8160e4b-a0e8-476c-b1cc-4c269db48017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:49.111487 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:49.178678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 670/1355] 10.222.0.17 () {58 vars in 1018 bytes} [Tue Jul 12 13:09:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:09:52.719063 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17270af3-2601-47ab-bc55-863adfd89903 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:52.720064 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17270af3-2601-47ab-bc55-863adfd89903 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:52.720522 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17270af3-2601-47ab-bc55-863adfd89903 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:52.722159 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 686/1356] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:09:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:09:52.729160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf880106-625b-454f-ae75-61c29521b052 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:52.729643 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf880106-625b-454f-ae75-61c29521b052 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:52.729746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf880106-625b-454f-ae75-61c29521b052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:52.811076 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-bf880106-625b-454f-ae75-61c29521b052 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:09:52.812653 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-bf880106-625b-454f-ae75-61c29521b052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:52.915777 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 671/1357] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:09:52.968876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b310222-4d32-43ef-826c-5ac3412f2153 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:52.969304 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b310222-4d32-43ef-826c-5ac3412f2153 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:52.970306 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b310222-4d32-43ef-826c-5ac3412f2153 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:52.971890 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 687/1358] 10.222.0.17 () {54 vars in 961 bytes} [Tue Jul 12 13:09:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:09:52.981775 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9d638-1225-46cc-84c2-26ef259ff055 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:52.982324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9d638-1225-46cc-84c2-26ef259ff055 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:52.982831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9d638-1225-46cc-84c2-26ef259ff055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:53.003293 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:53.069308 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-e1c9d638-1225-46cc-84c2-26ef259ff055 None None] MFA Rules not processed for user `e52dfce1b06346bfbde6ee33e7f6f249`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:09:53.070559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-e1c9d638-1225-46cc-84c2-26ef259ff055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:53.192293 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 672/1359] 10.222.0.17 () {58 vars in 1058 bytes} [Tue Jul 12 13:09:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:09:53.200151 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b310222-4d32-43ef-826c-5ac3412f2153 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:09:53.201659 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-0b310222-4d32-43ef-826c-5ac3412f2153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:53.366674 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b310222-4d32-43ef-826c-5ac3412f2153 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:09:53.451199 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:53.497359 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10875e6a-8653-459a-b0e9-f9712a04102c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:09:53.498022 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10875e6a-8653-459a-b0e9-f9712a04102c service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:53.498343 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10875e6a-8653-459a-b0e9-f9712a04102c service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:53.498622 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10875e6a-8653-459a-b0e9-f9712a04102c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:53.500488 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-10875e6a-8653-459a-b0e9-f9712a04102c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:53.607881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10875e6a-8653-459a-b0e9-f9712a04102c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:09:53.609591 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10875e6a-8653-459a-b0e9-f9712a04102c service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:09:53.629403 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 688/1360] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:09:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:09:55.882214 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb7fd7-ab17-446c-aa1c-e40258ebfb36 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:55.882750 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb7fd7-ab17-446c-aa1c-e40258ebfb36 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:55.882896 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb7fd7-ab17-446c-aa1c-e40258ebfb36 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:55.884292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 673/1361] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:09:55.889750 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4011e-15de-4bb2-93b3-9599ca769f03 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:55.890276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4011e-15de-4bb2-93b3-9599ca769f03 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:55.890390 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4011e-15de-4bb2-93b3-9599ca769f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:55.964133 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-62e4011e-15de-4bb2-93b3-9599ca769f03 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:09:55.965440 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-62e4011e-15de-4bb2-93b3-9599ca769f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:56.004580 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:56.067083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 689/1362] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:09:56.114267 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb7fd7-ab17-446c-aa1c-e40258ebfb36 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:09:56.116072 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-b0eb7fd7-ab17-446c-aa1c-e40258ebfb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:56.199900 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:56.294462 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb7fd7-ab17-446c-aa1c-e40258ebfb36 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:09:56.456490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351a5b7-fd1b-4b3b-8ce9-b6af7afa93b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:09:56.457141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351a5b7-fd1b-4b3b-8ce9-b6af7afa93b4 service nova] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:56.457434 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351a5b7-fd1b-4b3b-8ce9-b6af7afa93b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:56.457716 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351a5b7-fd1b-4b3b-8ce9-b6af7afa93b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:56.459424 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-6351a5b7-fd1b-4b3b-8ce9-b6af7afa93b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:56.483363 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:56.554608 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351a5b7-fd1b-4b3b-8ce9-b6af7afa93b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:09:56.556614 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351a5b7-fd1b-4b3b-8ce9-b6af7afa93b4 service nova] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:09:56.578273 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 674/1363] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:09:58.962433 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff954d-d2b9-40ba-835f-3989582100d0 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:58.962985 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff954d-d2b9-40ba-835f-3989582100d0 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:58.962985 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff954d-d2b9-40ba-835f-3989582100d0 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:58.964363 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 690/1364] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:09:58.970232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bbca8-56ab-4df2-a7f3-2b627b814ed1 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:58.970656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bbca8-56ab-4df2-a7f3-2b627b814ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:58.970851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bbca8-56ab-4df2-a7f3-2b627b814ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:59.056112 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-cd5bbca8-56ab-4df2-a7f3-2b627b814ed1 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:09:59.057330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-cd5bbca8-56ab-4df2-a7f3-2b627b814ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:59.172446 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:59.182435 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 675/1365] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:09:59.223257 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8621c0-c23d-459b-ab41-24fb76180969 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:59.223912 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8621c0-c23d-459b-ab41-24fb76180969 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:59.224462 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8621c0-c23d-459b-ab41-24fb76180969 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:59.226402 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 691/1366] 10.222.0.17 () {54 vars in 961 bytes} [Tue Jul 12 13:09:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:09:59.231405 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1af7d1-1937-41e0-837b-1bc3e457029b None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:59.231809 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1af7d1-1937-41e0-837b-1bc3e457029b None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:59.232100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1af7d1-1937-41e0-837b-1bc3e457029b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:59.312095 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-cc1af7d1-1937-41e0-837b-1bc3e457029b None None] MFA Rules not processed for user `e52dfce1b06346bfbde6ee33e7f6f249`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:09:59.313818 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-cc1af7d1-1937-41e0-837b-1bc3e457029b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:59.441265 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 676/1367] 10.222.0.17 () {58 vars in 1058 bytes} [Tue Jul 12 13:09:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:09:59.449102 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8621c0-c23d-459b-ab41-24fb76180969 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:09:59.450639 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-bc8621c0-c23d-459b-ab41-24fb76180969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:59.620718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8621c0-c23d-459b-ab41-24fb76180969 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:09:59.644275 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:59.755230 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0f4c5-8b2a-4166-bb46-2c027809a5f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:09:59.755896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0f4c5-8b2a-4166-bb46-2c027809a5f9 service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:09:59.756185 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0f4c5-8b2a-4166-bb46-2c027809a5f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:09:59.756468 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0f4c5-8b2a-4166-bb46-2c027809a5f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:09:59.758153 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-fdb0f4c5-8b2a-4166-bb46-2c027809a5f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:09:59.862625 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0f4c5-8b2a-4166-bb46-2c027809a5f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:09:59.864244 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0f4c5-8b2a-4166-bb46-2c027809a5f9 service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:09:59.889378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 692/1368] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:09:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:10:00.902391 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7ca58-d39c-4920-a739-e5660bc7488f None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:00.902953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7ca58-d39c-4920-a739-e5660bc7488f None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:00.902953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7ca58-d39c-4920-a739-e5660bc7488f None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:00.904445 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 677/1369] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:10:00.909445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94a7de-373d-4e1b-af2d-2b673b32aaa9 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:00.909849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94a7de-373d-4e1b-af2d-2b673b32aaa9 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:00.910046 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94a7de-373d-4e1b-af2d-2b673b32aaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:00.942492 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:00.980327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-4b94a7de-373d-4e1b-af2d-2b673b32aaa9 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:10:00.981551 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-4b94a7de-373d-4e1b-af2d-2b673b32aaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:01.103987 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 693/1370] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:10:01.451683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4f2a9-68ba-477c-86c1-90dfbb3b65c0 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:01.451683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4f2a9-68ba-477c-86c1-90dfbb3b65c0 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:01.451683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4f2a9-68ba-477c-86c1-90dfbb3b65c0 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:01.452701 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 678/1371] 10.222.0.17 () {54 vars in 963 bytes} [Tue Jul 12 13:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:10:01.457060 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc820f7-6614-49c8-b8cd-d4db6e2f1b73 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:01.457357 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc820f7-6614-49c8-b8cd-d4db6e2f1b73 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:01.457640 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc820f7-6614-49c8-b8cd-d4db6e2f1b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:01.536847 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-ddc820f7-6614-49c8-b8cd-d4db6e2f1b73 None None] MFA Rules not processed for user `e8b89afc60864451ba7b5a0a6d190628`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:10:01.538076 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-ddc820f7-6614-49c8-b8cd-d4db6e2f1b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:01.589658 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:01.623907 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 694/1372] 10.222.0.17 () {58 vars in 1060 bytes} [Tue Jul 12 13:10:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:10:01.631937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4f2a9-68ba-477c-86c1-90dfbb3b65c0 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:10:01.633698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-94a4f2a9-68ba-477c-86c1-90dfbb3b65c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:01.704981 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:01.764749 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4f2a9-68ba-477c-86c1-90dfbb3b65c0 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:10:01.846606 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32983629-9d03-463c-96ed-e37bb806604e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:10:01.847434 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32983629-9d03-463c-96ed-e37bb806604e service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:01.847818 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32983629-9d03-463c-96ed-e37bb806604e service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:01.848194 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32983629-9d03-463c-96ed-e37bb806604e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:01.850203 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-32983629-9d03-463c-96ed-e37bb806604e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:01.957387 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:01.972974 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32983629-9d03-463c-96ed-e37bb806604e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:10:01.975287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32983629-9d03-463c-96ed-e37bb806604e service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:10:01.995554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 679/1373] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:10:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:10:02.040741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e45cbb-9d98-4992-8356-61781bad60a3 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:02.041183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e45cbb-9d98-4992-8356-61781bad60a3 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:02.041821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e45cbb-9d98-4992-8356-61781bad60a3 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:02.044339 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 695/1374] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:10:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:10:02.049650 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bc6d8-9a43-4041-9313-f388ceb61fb9 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:02.049899 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bc6d8-9a43-4041-9313-f388ceb61fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:02.050215 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bc6d8-9a43-4041-9313-f388ceb61fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:02.128672 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-784bc6d8-9a43-4041-9313-f388ceb61fb9 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:10:02.130267 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-784bc6d8-9a43-4041-9313-f388ceb61fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:02.262553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 680/1375] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:10:02.307420 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e45cbb-9d98-4992-8356-61781bad60a3 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:10:02.309315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-d0e45cbb-9d98-4992-8356-61781bad60a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:02.456203 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e45cbb-9d98-4992-8356-61781bad60a3 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:10:02.508494 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:02.571833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cae32-ba21-48f2-8e87-90a013b16605 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:10:02.572490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cae32-ba21-48f2-8e87-90a013b16605 service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:02.572779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cae32-ba21-48f2-8e87-90a013b16605 service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:02.573057 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cae32-ba21-48f2-8e87-90a013b16605 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:02.574732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-849cae32-ba21-48f2-8e87-90a013b16605 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:02.665534 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849cae32-ba21-48f2-8e87-90a013b16605 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:10:02.667383 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849cae32-ba21-48f2-8e87-90a013b16605 service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:10:02.690367 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 696/1376] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:10:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:10:04.739645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a996d2b-5272-4bf4-8714-9edcf30ab2b0 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:04.740164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a996d2b-5272-4bf4-8714-9edcf30ab2b0 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:04.740261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a996d2b-5272-4bf4-8714-9edcf30ab2b0 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:04.741579 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 681/1377] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:10:04.746658 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6605a-506d-40d6-95ee-203d6b060fb8 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:04.747069 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6605a-506d-40d6-95ee-203d6b060fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:04.747213 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6605a-506d-40d6-95ee-203d6b060fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:04.818314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-4bb6605a-506d-40d6-95ee-203d6b060fb8 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:10:04.819472 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-4bb6605a-506d-40d6-95ee-203d6b060fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:04.826441 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:04.923254 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 697/1378] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:10:04.966915 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a996d2b-5272-4bf4-8714-9edcf30ab2b0 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:10:04.968445 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-9a996d2b-5272-4bf4-8714-9edcf30ab2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:05.049073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:05.130760 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a996d2b-5272-4bf4-8714-9edcf30ab2b0 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:10:05.245193 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7ea2c-b588-4348-8cde-9ed7f898cd0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:10:05.245851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7ea2c-b588-4348-8cde-9ed7f898cd0d service nova] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:05.246156 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7ea2c-b588-4348-8cde-9ed7f898cd0d service nova] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:05.246433 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7ea2c-b588-4348-8cde-9ed7f898cd0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:05.248058 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-0fb7ea2c-b588-4348-8cde-9ed7f898cd0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:05.272241 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:05.343878 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7ea2c-b588-4348-8cde-9ed7f898cd0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:10:05.345525 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7ea2c-b588-4348-8cde-9ed7f898cd0d service nova] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:10:05.366237 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 682/1379] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:10:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:10:07.470221 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f808c7-ce6b-44be-9eb1-cae35b55038d None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:07.470758 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f808c7-ce6b-44be-9eb1-cae35b55038d None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:07.470758 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f808c7-ce6b-44be-9eb1-cae35b55038d None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:07.472304 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 698/1380] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:10:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:10:07.477447 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0911d-e69d-4a33-b225-03ea8efb5405 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:07.477869 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0911d-e69d-4a33-b225-03ea8efb5405 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:07.478096 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0911d-e69d-4a33-b225-03ea8efb5405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:07.551822 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-87f0911d-e69d-4a33-b225-03ea8efb5405 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:10:07.553154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-87f0911d-e69d-4a33-b225-03ea8efb5405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:07.658055 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:07.665839 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 683/1381] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:10:07.710508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f808c7-ce6b-44be-9eb1-cae35b55038d None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:10:07.712037 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-c5f808c7-ce6b-44be-9eb1-cae35b55038d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:07.853445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:07.872022 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f808c7-ce6b-44be-9eb1-cae35b55038d None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:10:07.993862 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4537737-f496-44ff-a4da-cd31f3ca5b6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:10:07.994709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4537737-f496-44ff-a4da-cd31f3ca5b6f service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:07.995092 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4537737-f496-44ff-a4da-cd31f3ca5b6f service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:07.995462 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4537737-f496-44ff-a4da-cd31f3ca5b6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:07.997325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-e4537737-f496-44ff-a4da-cd31f3ca5b6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:08.095754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4537737-f496-44ff-a4da-cd31f3ca5b6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:10:08.097432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4537737-f496-44ff-a4da-cd31f3ca5b6f service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:10:08.109089 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:08.118969 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 699/1382] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:10:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:10:10.404012 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed061b-3889-4183-b504-409bb0d2282a None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:10.404547 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed061b-3889-4183-b504-409bb0d2282a None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:10.404770 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed061b-3889-4183-b504-409bb0d2282a None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:10.407268 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 684/1383] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:10:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:10:10.413498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2531d2-e502-47c0-993d-292191820e70 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:10.413920 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2531d2-e502-47c0-993d-292191820e70 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:10.414065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2531d2-e502-47c0-993d-292191820e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:10.482181 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-4d2531d2-e502-47c0-993d-292191820e70 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:10:10.483457 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-4d2531d2-e502-47c0-993d-292191820e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:10.593084 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 700/1384] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:10:10.646097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed061b-3889-4183-b504-409bb0d2282a None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:10:10.647838 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-0fed061b-3889-4183-b504-409bb0d2282a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:10.816617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed061b-3889-4183-b504-409bb0d2282a None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:10:10.890524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:10.944047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc513bcb-cb9a-41ed-9bd3-f0b4f506996c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:10:10.944919 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc513bcb-cb9a-41ed-9bd3-f0b4f506996c service nova] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:10.945289 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc513bcb-cb9a-41ed-9bd3-f0b4f506996c service nova] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:10.945664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc513bcb-cb9a-41ed-9bd3-f0b4f506996c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:10.947906 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-dc513bcb-cb9a-41ed-9bd3-f0b4f506996c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:11.053285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc513bcb-cb9a-41ed-9bd3-f0b4f506996c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:10:11.054967 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc513bcb-cb9a-41ed-9bd3-f0b4f506996c service nova] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:10:11.073297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 685/1385] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:10:13.117765 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01afe9c-7d42-41b7-913f-1f5983f42c51 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:13.118377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01afe9c-7d42-41b7-913f-1f5983f42c51 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:13.118377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01afe9c-7d42-41b7-913f-1f5983f42c51 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:13.119718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 701/1386] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:10:13.126016 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98659a86-aaf3-4643-b95b-41b6d8633c0f None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:13.126462 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98659a86-aaf3-4643-b95b-41b6d8633c0f None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:13.126764 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98659a86-aaf3-4643-b95b-41b6d8633c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:13.214585 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-98659a86-aaf3-4643-b95b-41b6d8633c0f None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:10:13.216290 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-98659a86-aaf3-4643-b95b-41b6d8633c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:13.260702 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:13.326251 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 686/1387] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:10:13.372518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01afe9c-7d42-41b7-913f-1f5983f42c51 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:10:13.374648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-e01afe9c-7d42-41b7-913f-1f5983f42c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:13.458415 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:13.550097 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01afe9c-7d42-41b7-913f-1f5983f42c51 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:10:13.666078 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427cade-5d15-43be-a97a-328bd6e9d9ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:10:13.666834 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427cade-5d15-43be-a97a-328bd6e9d9ea service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:13.667173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427cade-5d15-43be-a97a-328bd6e9d9ea service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:13.667400 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427cade-5d15-43be-a97a-328bd6e9d9ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:13.669100 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-6427cade-5d15-43be-a97a-328bd6e9d9ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:13.716300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:13.783449 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427cade-5d15-43be-a97a-328bd6e9d9ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:10:13.785548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427cade-5d15-43be-a97a-328bd6e9d9ea service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:10:13.808939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 702/1388] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:10:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:10:15.905926 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc92f71-2a22-4f67-9fd0-ae0b372bc318 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:15.906550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc92f71-2a22-4f67-9fd0-ae0b372bc318 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:15.906665 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc92f71-2a22-4f67-9fd0-ae0b372bc318 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:15.908010 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 687/1389] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:10:15.913254 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c4b7b-8e3d-485c-b411-156af19d34e5 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:15.913677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c4b7b-8e3d-485c-b411-156af19d34e5 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:15.913847 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c4b7b-8e3d-485c-b411-156af19d34e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:15.983607 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-187c4b7b-8e3d-485c-b411-156af19d34e5 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:10:15.984870 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-187c4b7b-8e3d-485c-b411-156af19d34e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:16.084971 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 703/1390] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:10:16.128455 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc92f71-2a22-4f67-9fd0-ae0b372bc318 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:10:16.130075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-8cc92f71-2a22-4f67-9fd0-ae0b372bc318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:16.303160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc92f71-2a22-4f67-9fd0-ae0b372bc318 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:10:16.320918 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:16.417880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb8bec-7d21-4d5a-a6f4-0bc266cc9a0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:10:16.418563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb8bec-7d21-4d5a-a6f4-0bc266cc9a0a service nova] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:16.418848 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb8bec-7d21-4d5a-a6f4-0bc266cc9a0a service nova] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:16.419123 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb8bec-7d21-4d5a-a6f4-0bc266cc9a0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:16.420787 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-dccb8bec-7d21-4d5a-a6f4-0bc266cc9a0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:16.513900 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb8bec-7d21-4d5a-a6f4-0bc266cc9a0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:10:16.515538 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb8bec-7d21-4d5a-a6f4-0bc266cc9a0a service nova] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:10:16.534007 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 688/1391] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:10:17.385377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc88b3-7364-4c7e-b430-5d00c8319b54 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:17.386041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc88b3-7364-4c7e-b430-5d00c8319b54 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:17.386041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc88b3-7364-4c7e-b430-5d00c8319b54 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:17.387688 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 704/1392] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:10:17.392792 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5be79e-5ea9-4a8b-bc6f-b98ed1b612a8 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:17.393239 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5be79e-5ea9-4a8b-bc6f-b98ed1b612a8 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:17.393342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5be79e-5ea9-4a8b-bc6f-b98ed1b612a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:17.417806 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:17.461021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-9f5be79e-5ea9-4a8b-bc6f-b98ed1b612a8 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:10:17.462256 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-9f5be79e-5ea9-4a8b-bc6f-b98ed1b612a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:17.558233 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 689/1393] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:10:17.613124 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58b2be-2740-4848-a96e-b542eceb20de None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:17.613407 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58b2be-2740-4848-a96e-b542eceb20de None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:17.613728 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58b2be-2740-4848-a96e-b542eceb20de None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:17.615117 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 705/1394] 10.222.0.17 () {54 vars in 962 bytes} [Tue Jul 12 13:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:10:17.620361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542bb36-99fc-4ca7-9e79-324cbac305a9 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:17.620655 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542bb36-99fc-4ca7-9e79-324cbac305a9 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:17.620946 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542bb36-99fc-4ca7-9e79-324cbac305a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:17.708465 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-f542bb36-99fc-4ca7-9e79-324cbac305a9 None None] MFA Rules not processed for user `f7af0259f7f24dfdafbdfc1f613ebb42`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:10:17.709680 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-f542bb36-99fc-4ca7-9e79-324cbac305a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:17.751456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:17.788273 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 690/1395] 10.222.0.17 () {58 vars in 1059 bytes} [Tue Jul 12 13:10:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:10:17.795958 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58b2be-2740-4848-a96e-b542eceb20de None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:10:17.797977 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-6a58b2be-2740-4848-a96e-b542eceb20de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:17.812055 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:17.903005 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58b2be-2740-4848-a96e-b542eceb20de None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:10:17.976405 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8b9d1-699d-4ff1-9bf5-a4d34a0b0e00 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7af0259f7f24dfdafbdfc1f613ebb42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:10:17.977066 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8b9d1-699d-4ff1-9bf5-a4d34a0b0e00 service glance] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:17.977353 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8b9d1-699d-4ff1-9bf5-a4d34a0b0e00 service glance] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:17.977636 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8b9d1-699d-4ff1-9bf5-a4d34a0b0e00 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:17.979313 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-fbd8b9d1-699d-4ff1-9bf5-a4d34a0b0e00 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:18.048158 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:18.090169 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8b9d1-699d-4ff1-9bf5-a4d34a0b0e00 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:10:18.091627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8b9d1-699d-4ff1-9bf5-a4d34a0b0e00 service glance] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:10:18.111191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 706/1396] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:10:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:10:18.627922 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8052eb0-264a-45fb-a247-cd2f326fee08 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:18.628486 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8052eb0-264a-45fb-a247-cd2f326fee08 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:18.628486 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8052eb0-264a-45fb-a247-cd2f326fee08 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:18.629872 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 691/1397] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:10:18.635139 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854893c-6174-4e94-83ec-59b6d62f2da2 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:18.635570 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854893c-6174-4e94-83ec-59b6d62f2da2 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:18.635709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854893c-6174-4e94-83ec-59b6d62f2da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:18.716050 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-a854893c-6174-4e94-83ec-59b6d62f2da2 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:10:18.717302 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a854893c-6174-4e94-83ec-59b6d62f2da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:18.820022 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87202940-d315-4025-91a7-08d4642ab1d0 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:18.820206 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87202940-d315-4025-91a7-08d4642ab1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:18.820593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87202940-d315-4025-91a7-08d4642ab1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:18.827811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 707/1398] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:10:18.872952 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854893c-6174-4e94-83ec-59b6d62f2da2 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:10:18.874201 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a854893c-6174-4e94-83ec-59b6d62f2da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:18.891776 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-87202940-d315-4025-91a7-08d4642ab1d0 None None] MFA Rules not processed for user `72f556aac45c460cb573498aab7590fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:10:18.892971 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-87202940-d315-4025-91a7-08d4642ab1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:18.901290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:18.983765 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 692/1399] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Jul 12 13:10:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:10:18.990552 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854893c-6174-4e94-83ec-59b6d62f2da2 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:10:19.028729 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c33e6-2375-4056-8fd1-9aa676f133c7 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:19.029488 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c33e6-2375-4056-8fd1-9aa676f133c7 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:19.029488 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c33e6-2375-4056-8fd1-9aa676f133c7 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:19.030909 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 693/1400] 10.222.0.17 () {54 vars in 942 bytes} [Tue Jul 12 13:10:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:10:19.037088 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856d5a4-cc1e-49a0-be5b-92da2b141e66 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:19.037386 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856d5a4-cc1e-49a0-be5b-92da2b141e66 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:19.037672 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856d5a4-cc1e-49a0-be5b-92da2b141e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:19.107734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:19.116256 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-2856d5a4-cc1e-49a0-be5b-92da2b141e66 None None] MFA Rules not processed for user `fe10f0f42b8247c99ed5f88eff5065e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:10:19.117412 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1f7b5-2cba-4532-90c4-710231eab5f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:10:19.117578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-2856d5a4-cc1e-49a0-be5b-92da2b141e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:19.118069 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1f7b5-2cba-4532-90c4-710231eab5f5 service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:19.118385 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1f7b5-2cba-4532-90c4-710231eab5f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:19.118664 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1f7b5-2cba-4532-90c4-710231eab5f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:19.120286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-77f1f7b5-2cba-4532-90c4-710231eab5f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:19.137998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:19.210272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1f7b5-2cba-4532-90c4-710231eab5f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:10:19.211878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1f7b5-2cba-4532-90c4-710231eab5f5 service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:10:19.226060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 694/1401] 10.222.0.17 () {58 vars in 1039 bytes} [Tue Jul 12 13:10:19 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:10:19.230908 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 708/1402] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:10:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:10:19.235459 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856d5a4-cc1e-49a0-be5b-92da2b141e66 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:10:19.245897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856d5a4-cc1e-49a0-be5b-92da2b141e66 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:10:19.362518 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea033ed-2953-4e48-9bab-b74893b7f09b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe10f0f42b8247c99ed5f88eff5065e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:10:19.363080 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea033ed-2953-4e48-9bab-b74893b7f09b service swift] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:19.363364 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea033ed-2953-4e48-9bab-b74893b7f09b service swift] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:19.363641 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea033ed-2953-4e48-9bab-b74893b7f09b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:19.365407 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-7ea033ed-2953-4e48-9bab-b74893b7f09b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:19.368485 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:19.461217 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea033ed-2953-4e48-9bab-b74893b7f09b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:10:19.462912 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea033ed-2953-4e48-9bab-b74893b7f09b service swift] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:10:19.472185 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 695/1403] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Jul 12 13:10:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:10:21.310167 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac87162-af1a-4ceb-8f31-e2ff2b431b8a None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:21.310729 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac87162-af1a-4ceb-8f31-e2ff2b431b8a None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:21.310729 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac87162-af1a-4ceb-8f31-e2ff2b431b8a None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:21.314480 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 709/1404] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:10:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:10:21.317894 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f440102-1ff5-4e66-b564-ce75832f3991 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:21.318351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f440102-1ff5-4e66-b564-ce75832f3991 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:21.318518 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f440102-1ff5-4e66-b564-ce75832f3991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:21.390210 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-3f440102-1ff5-4e66-b564-ce75832f3991 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:10:21.391998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-3f440102-1ff5-4e66-b564-ce75832f3991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:21.542020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:21.551458 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 696/1405] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:10:21.599596 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac87162-af1a-4ceb-8f31-e2ff2b431b8a None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:10:21.601114 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-5ac87162-af1a-4ceb-8f31-e2ff2b431b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:21.787797 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:21.791324 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac87162-af1a-4ceb-8f31-e2ff2b431b8a None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:10:21.917730 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea04bd-b7d3-4f15-9b04-c9e7098dfe3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:10:21.918721 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea04bd-b7d3-4f15-9b04-c9e7098dfe3d service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:21.919010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea04bd-b7d3-4f15-9b04-c9e7098dfe3d service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:21.919285 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea04bd-b7d3-4f15-9b04-c9e7098dfe3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:21.921013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-3fea04bd-b7d3-4f15-9b04-c9e7098dfe3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:22.021026 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea04bd-b7d3-4f15-9b04-c9e7098dfe3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:10:22.022692 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea04bd-b7d3-4f15-9b04-c9e7098dfe3d service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:10:22.044785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 710/1406] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:10:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:10:24.107924 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08670d-d5f5-4673-b7a5-fc675500ac7a None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:24.108490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08670d-d5f5-4673-b7a5-fc675500ac7a None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:24.108490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08670d-d5f5-4673-b7a5-fc675500ac7a None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:24.109890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 697/1407] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:10:24.115003 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf1df8-9e03-4a3b-941a-6ab46b07e37c None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:24.115491 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf1df8-9e03-4a3b-941a-6ab46b07e37c None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:24.115600 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf1df8-9e03-4a3b-941a-6ab46b07e37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:24.119174 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:24.186591 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-09cf1df8-9e03-4a3b-941a-6ab46b07e37c None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:10:24.188432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-09cf1df8-9e03-4a3b-941a-6ab46b07e37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:24.302643 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 711/1408] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:10:24.338896 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08670d-d5f5-4673-b7a5-fc675500ac7a None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:10:24.340699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-bb08670d-d5f5-4673-b7a5-fc675500ac7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:24.509870 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08670d-d5f5-4673-b7a5-fc675500ac7a None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:10:24.588774 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:24.644358 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a3822-8736-4d57-9e19-11b912a51195 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:10:24.645370 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a3822-8736-4d57-9e19-11b912a51195 service nova] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:24.645666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a3822-8736-4d57-9e19-11b912a51195 service nova] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:24.645950 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a3822-8736-4d57-9e19-11b912a51195 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:24.647661 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-c74a3822-8736-4d57-9e19-11b912a51195 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:24.754524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a3822-8736-4d57-9e19-11b912a51195 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:10:24.756139 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a3822-8736-4d57-9e19-11b912a51195 service nova] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:10:24.775779 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 698/1409] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:10:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:10:34.292464 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=64 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:34.776067 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=64 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:41.746895 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe453ce7-ba88-482b-8031-75b163d9b2aa None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:41.747472 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe453ce7-ba88-482b-8031-75b163d9b2aa None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:41.747472 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe453ce7-ba88-482b-8031-75b163d9b2aa None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:41.748846 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 712/1410] 10.222.0.17 () {54 vars in 918 bytes} [Tue Jul 12 13:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:10:41.754716 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63c266-26d2-46c2-b541-facc5e30ff8d None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:41.755118 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63c266-26d2-46c2-b541-facc5e30ff8d None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:41.755287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63c266-26d2-46c2-b541-facc5e30ff8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:41.829396 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-6b63c266-26d2-46c2-b541-facc5e30ff8d None None] MFA Rules not processed for user `698828dd940f46e2b493ba55cd894eac`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:10:41.830642 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-6b63c266-26d2-46c2-b541-facc5e30ff8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:41.936616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 699/1411] 10.222.0.17 () {58 vars in 1015 bytes} [Tue Jul 12 13:10:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:10:41.951298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291d917-df93-4757-ad9f-585473b6230a None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:41.951615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291d917-df93-4757-ad9f-585473b6230a None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:41.951894 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291d917-df93-4757-ad9f-585473b6230a None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:41.953290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 713/1412] 10.222.0.17 () {54 vars in 918 bytes} [Tue Jul 12 13:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:10:41.957917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5120c-9a95-4e31-af04-ee0b05b8aa1e None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:41.958245 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5120c-9a95-4e31-af04-ee0b05b8aa1e None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:41.958537 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5120c-9a95-4e31-af04-ee0b05b8aa1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:42.028933 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:42.032220 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-79d5120c-9a95-4e31-af04-ee0b05b8aa1e None None] MFA Rules not processed for user `e52dfce1b06346bfbde6ee33e7f6f249`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:10:42.033972 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-79d5120c-9a95-4e31-af04-ee0b05b8aa1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:42.156926 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 700/1413] 10.222.0.17 () {58 vars in 1015 bytes} [Tue Jul 12 13:10:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:10:44.661933 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f226bd1-3711-4239-8165-ba59f4231d2b None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:44.662531 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f226bd1-3711-4239-8165-ba59f4231d2b None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:44.662531 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f226bd1-3711-4239-8165-ba59f4231d2b None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:44.663886 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:10:44.669069 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbe80c-dfae-40e4-a6d7-aab451f5475d None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:44.669485 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbe80c-dfae-40e4-a6d7-aab451f5475d None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:44.669621 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbe80c-dfae-40e4-a6d7-aab451f5475d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:44.738310 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-10fbe80c-dfae-40e4-a6d7-aab451f5475d None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:10:44.739583 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-10fbe80c-dfae-40e4-a6d7-aab451f5475d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:44.797947 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:44.840904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:10:44.882816 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f226bd1-3711-4239-8165-ba59f4231d2b None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:10:44.884342 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-8f226bd1-3711-4239-8165-ba59f4231d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:45.035069 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f226bd1-3711-4239-8165-ba59f4231d2b None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:10:45.108687 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:45.148576 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577d115-b3de-4784-95bc-f1f0d4eaeb0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:10:45.149223 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577d115-b3de-4784-95bc-f1f0d4eaeb0b service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:45.149509 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577d115-b3de-4784-95bc-f1f0d4eaeb0b service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:45.149779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577d115-b3de-4784-95bc-f1f0d4eaeb0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:45.151440 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-9577d115-b3de-4784-95bc-f1f0d4eaeb0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:45.236911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577d115-b3de-4784-95bc-f1f0d4eaeb0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:10:45.238535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577d115-b3de-4784-95bc-f1f0d4eaeb0b service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:10:45.256426 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 715/1416] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:10:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:10:46.154455 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc333994-a326-4a13-b8be-493646e2a172 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:46.155042 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc333994-a326-4a13-b8be-493646e2a172 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:46.155042 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc333994-a326-4a13-b8be-493646e2a172 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:46.157021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 13:10:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:10:46.161854 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b03a2c-f9ef-4339-a4a9-a7055d2bfff1 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:46.162339 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b03a2c-f9ef-4339-a4a9-a7055d2bfff1 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:46.162447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b03a2c-f9ef-4339-a4a9-a7055d2bfff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:46.236312 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-13b03a2c-f9ef-4339-a4a9-a7055d2bfff1 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:10:46.237509 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-13b03a2c-f9ef-4339-a4a9-a7055d2bfff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:46.263592 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:46.336029 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 13:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:10:46.488529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc333994-a326-4a13-b8be-493646e2a172 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:10:46.490048 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-bc333994-a326-4a13-b8be-493646e2a172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:46.635891 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc333994-a326-4a13-b8be-493646e2a172 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:10:46.677120 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:46.753679 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699cb944-6754-4698-b640-d5059f2c758b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:10:46.754295 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cb944-6754-4698-b640-d5059f2c758b service nova] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:46.754587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cb944-6754-4698-b640-d5059f2c758b service nova] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:46.754870 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cb944-6754-4698-b640-d5059f2c758b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:46.756514 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-699cb944-6754-4698-b640-d5059f2c758b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:46.847472 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699cb944-6754-4698-b640-d5059f2c758b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:10:46.849063 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699cb944-6754-4698-b640-d5059f2c758b service nova] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:10:46.866553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 703/1419] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:10:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:10:47.774500 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c2a6e-2c0a-45dd-8fb8-33cb58332bf3 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:47.775068 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c2a6e-2c0a-45dd-8fb8-33cb58332bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:47.775068 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c2a6e-2c0a-45dd-8fb8-33cb58332bf3 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:47.776460 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 13:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:10:47.781874 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb356b4a-c35b-43cb-8c82-4c47977a72f9 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:47.782331 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb356b4a-c35b-43cb-8c82-4c47977a72f9 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:47.782505 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb356b4a-c35b-43cb-8c82-4c47977a72f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:47.834417 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:47.856138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-bb356b4a-c35b-43cb-8c82-4c47977a72f9 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:10:47.857343 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-bb356b4a-c35b-43cb-8c82-4c47977a72f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:47.950999 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 13:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:10:48.100973 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c2a6e-2c0a-45dd-8fb8-33cb58332bf3 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:10:48.102605 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-9d3c2a6e-2c0a-45dd-8fb8-33cb58332bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:48.244325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c2a6e-2c0a-45dd-8fb8-33cb58332bf3 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:10:48.256635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:48.357777 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92889a75-b872-409f-b1b7-3d46c07ad540 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:10:48.358464 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92889a75-b872-409f-b1b7-3d46c07ad540 service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:48.358753 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92889a75-b872-409f-b1b7-3d46c07ad540 service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:48.359034 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92889a75-b872-409f-b1b7-3d46c07ad540 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:48.360675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-92889a75-b872-409f-b1b7-3d46c07ad540 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:48.448864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92889a75-b872-409f-b1b7-3d46c07ad540 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:10:48.450562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92889a75-b872-409f-b1b7-3d46c07ad540 service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:10:48.468049 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 718/1422] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:10:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:10:49.318405 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186da7f8-bba7-40d2-8669-b5340717fd80 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:49.319012 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186da7f8-bba7-40d2-8669-b5340717fd80 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:49.319012 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186da7f8-bba7-40d2-8669-b5340717fd80 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:49.320318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 13:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:10:49.325260 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50061c7-0b6f-46a5-aaa1-b636db640d39 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:49.325665 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50061c7-0b6f-46a5-aaa1-b636db640d39 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:49.325849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50061c7-0b6f-46a5-aaa1-b636db640d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:49.345658 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:49.400731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-b50061c7-0b6f-46a5-aaa1-b636db640d39 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:10:49.401945 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-b50061c7-0b6f-46a5-aaa1-b636db640d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:49.505136 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 13:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:10:49.653516 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186da7f8-bba7-40d2-8669-b5340717fd80 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:10:49.655073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-186da7f8-bba7-40d2-8669-b5340717fd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:49.766317 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:49.801774 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186da7f8-bba7-40d2-8669-b5340717fd80 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:10:49.917966 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab50e06-e4ca-4bb7-ab97-f85ee7a37266 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:10:49.918582 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab50e06-e4ca-4bb7-ab97-f85ee7a37266 service nova] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:49.918875 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab50e06-e4ca-4bb7-ab97-f85ee7a37266 service nova] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:49.919156 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab50e06-e4ca-4bb7-ab97-f85ee7a37266 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:49.920802 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-6ab50e06-e4ca-4bb7-ab97-f85ee7a37266 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:49.998418 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:50.012711 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab50e06-e4ca-4bb7-ab97-f85ee7a37266 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:10:50.014332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab50e06-e4ca-4bb7-ab97-f85ee7a37266 service nova] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:10:50.031737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 706/1425] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:10:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:10:50.888620 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83f0ef-057e-481d-a47e-04ef706a8392 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:50.889185 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83f0ef-057e-481d-a47e-04ef706a8392 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:50.889185 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83f0ef-057e-481d-a47e-04ef706a8392 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:50.891095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 13:10:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:10:50.896035 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86863ae9-e991-4f0a-b35a-6ee68fb21a80 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:50.896635 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86863ae9-e991-4f0a-b35a-6ee68fb21a80 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:50.896635 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86863ae9-e991-4f0a-b35a-6ee68fb21a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:51.086961 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-86863ae9-e991-4f0a-b35a-6ee68fb21a80 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:10:51.088165 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-86863ae9-e991-4f0a-b35a-6ee68fb21a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:51.183387 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 13:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:10:51.332711 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83f0ef-057e-481d-a47e-04ef706a8392 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:10:51.334307 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-1c83f0ef-057e-481d-a47e-04ef706a8392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:51.418380 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:51.481027 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83f0ef-057e-481d-a47e-04ef706a8392 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:10:51.593982 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbac5ba-eea5-4b68-bbf9-bd0b3bed0273 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:10:51.594663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbac5ba-eea5-4b68-bbf9-bd0b3bed0273 service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:51.594950 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbac5ba-eea5-4b68-bbf9-bd0b3bed0273 service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:51.595228 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbac5ba-eea5-4b68-bbf9-bd0b3bed0273 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:51.596884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-8bbac5ba-eea5-4b68-bbf9-bd0b3bed0273 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:51.647699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:51.694906 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbac5ba-eea5-4b68-bbf9-bd0b3bed0273 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:10:51.696520 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbac5ba-eea5-4b68-bbf9-bd0b3bed0273 service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:10:51.715033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 721/1428] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:10:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:10:52.513543 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591224d-5952-41c4-8c6e-69eb65cb433f None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:52.514127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591224d-5952-41c4-8c6e-69eb65cb433f None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:52.514127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591224d-5952-41c4-8c6e-69eb65cb433f None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:52.516048 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 13:10:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:10:52.521868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7945f3-88f7-4bda-88ca-7e0abbfc8e13 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:52.522648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7945f3-88f7-4bda-88ca-7e0abbfc8e13 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:52.522648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7945f3-88f7-4bda-88ca-7e0abbfc8e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:52.595407 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-5d7945f3-88f7-4bda-88ca-7e0abbfc8e13 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:10:52.596533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-5d7945f3-88f7-4bda-88ca-7e0abbfc8e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:52.691822 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 13:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:10:52.840836 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591224d-5952-41c4-8c6e-69eb65cb433f None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:10:52.842402 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-c591224d-5952-41c4-8c6e-69eb65cb433f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:52.891551 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:52.988186 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591224d-5952-41c4-8c6e-69eb65cb433f None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:10:53.103785 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7561d45-c7d8-4ef6-9154-46654b8a7c1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:10:53.104442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7561d45-c7d8-4ef6-9154-46654b8a7c1b service nova] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:53.104724 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7561d45-c7d8-4ef6-9154-46654b8a7c1b service nova] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:53.105026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7561d45-c7d8-4ef6-9154-46654b8a7c1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:53.106708 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-f7561d45-c7d8-4ef6-9154-46654b8a7c1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:53.114123 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:53.195560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7561d45-c7d8-4ef6-9154-46654b8a7c1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:10:53.197133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7561d45-c7d8-4ef6-9154-46654b8a7c1b service nova] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:10:53.214464 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 709/1431] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:10:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:10:54.019421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c699a9-a383-48e3-af1d-543c833c4d11 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:54.020001 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c699a9-a383-48e3-af1d-543c833c4d11 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:54.020001 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c699a9-a383-48e3-af1d-543c833c4d11 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:54.021351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 13:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:10:54.026368 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d1f5d-97d8-4c80-b7ed-a415ef6ff63d None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:54.026829 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d1f5d-97d8-4c80-b7ed-a415ef6ff63d None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:54.026977 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d1f5d-97d8-4c80-b7ed-a415ef6ff63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:54.103665 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-e51d1f5d-97d8-4c80-b7ed-a415ef6ff63d None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:10:54.104941 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-e51d1f5d-97d8-4c80-b7ed-a415ef6ff63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:54.174414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:54.211389 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 13:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:10:54.361321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c699a9-a383-48e3-af1d-543c833c4d11 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:10:54.362889 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-48c699a9-a383-48e3-af1d-543c833c4d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:54.381283 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:54.550739 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c699a9-a383-48e3-af1d-543c833c4d11 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:10:54.637830 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:54.664340 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518af57-cd61-4e9c-8cae-c2e366369cda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:10:54.665002 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518af57-cd61-4e9c-8cae-c2e366369cda service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:54.665291 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518af57-cd61-4e9c-8cae-c2e366369cda service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:54.665579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518af57-cd61-4e9c-8cae-c2e366369cda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:54.667609 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-4518af57-cd61-4e9c-8cae-c2e366369cda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:54.757514 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518af57-cd61-4e9c-8cae-c2e366369cda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:10:54.759164 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518af57-cd61-4e9c-8cae-c2e366369cda service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:10:54.777133 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 724/1434] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:10:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:10:55.577212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6c551-d3d4-45fc-8aa3-7f018d7be525 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:55.578393 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6c551-d3d4-45fc-8aa3-7f018d7be525 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:55.578393 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6c551-d3d4-45fc-8aa3-7f018d7be525 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:55.579632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 13:10:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:10:55.584656 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbe3cb-378f-42db-85d4-2d68c593b5d8 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:55.585060 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbe3cb-378f-42db-85d4-2d68c593b5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:55.585230 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbe3cb-378f-42db-85d4-2d68c593b5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:55.660238 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-18bbe3cb-378f-42db-85d4-2d68c593b5d8 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:10:55.661440 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-18bbe3cb-378f-42db-85d4-2d68c593b5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:55.703836 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:55.759073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 13:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:10:55.909878 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6c551-d3d4-45fc-8aa3-7f018d7be525 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:10:55.911321 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-32b6c551-d3d4-45fc-8aa3-7f018d7be525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:56.055551 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6c551-d3d4-45fc-8aa3-7f018d7be525 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:10:56.113737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:56.179055 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683cb2f-ff07-46dc-bbae-b56ee260faa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:10:56.179615 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683cb2f-ff07-46dc-bbae-b56ee260faa5 service nova] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:56.179924 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683cb2f-ff07-46dc-bbae-b56ee260faa5 service nova] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:56.180199 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683cb2f-ff07-46dc-bbae-b56ee260faa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:56.181829 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-2683cb2f-ff07-46dc-bbae-b56ee260faa5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:56.271038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683cb2f-ff07-46dc-bbae-b56ee260faa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:10:56.272624 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683cb2f-ff07-46dc-bbae-b56ee260faa5 service nova] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:10:56.290990 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 712/1437] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:10:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:10:57.090607 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e4e07-60ee-407b-8cd3-b950a9201991 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:57.091170 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e4e07-60ee-407b-8cd3-b950a9201991 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:57.091170 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e4e07-60ee-407b-8cd3-b950a9201991 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:57.092585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 13:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:10:57.098019 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ee3a9-ef7d-4875-a0c0-d972bf1552f8 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:57.098490 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ee3a9-ef7d-4875-a0c0-d972bf1552f8 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:57.098607 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ee3a9-ef7d-4875-a0c0-d972bf1552f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:57.176712 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-057ee3a9-ef7d-4875-a0c0-d972bf1552f8 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:10:57.177927 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-057ee3a9-ef7d-4875-a0c0-d972bf1552f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:57.180042 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:57.274903 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 13:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:10:57.425041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e4e07-60ee-407b-8cd3-b950a9201991 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:10:57.426611 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-f93e4e07-60ee-407b-8cd3-b950a9201991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:57.575048 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e4e07-60ee-407b-8cd3-b950a9201991 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:10:57.604044 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:57.690612 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a191773-a148-4bb5-b56a-b86b8cbe7cb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:10:57.691262 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a191773-a148-4bb5-b56a-b86b8cbe7cb7 service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:57.691546 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a191773-a148-4bb5-b56a-b86b8cbe7cb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:57.691823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a191773-a148-4bb5-b56a-b86b8cbe7cb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:57.693471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-3a191773-a148-4bb5-b56a-b86b8cbe7cb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:57.788191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a191773-a148-4bb5-b56a-b86b8cbe7cb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:10:57.789800 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a191773-a148-4bb5-b56a-b86b8cbe7cb7 service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:10:57.807753 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 727/1440] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:10:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:10:59.730656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f0255-3dfc-40c7-817f-93a88480e3cc None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:59.731271 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f0255-3dfc-40c7-817f-93a88480e3cc None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:59.731271 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f0255-3dfc-40c7-817f-93a88480e3cc None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:59.732604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:10:59.738607 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5b56e-8d80-4770-81ab-e4c9c09b31d8 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:10:59.739078 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5b56e-8d80-4770-81ab-e4c9c09b31d8 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:10:59.739342 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5b56e-8d80-4770-81ab-e4c9c09b31d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:10:59.779638 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:10:59.805181 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-7cd5b56e-8d80-4770-81ab-e4c9c09b31d8 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:10:59.806424 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-7cd5b56e-8d80-4770-81ab-e4c9c09b31d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:10:59.902144 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:10:59.942008 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f0255-3dfc-40c7-817f-93a88480e3cc None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:10:59.943583 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-d25f0255-3dfc-40c7-817f-93a88480e3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:00.049367 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f0255-3dfc-40c7-817f-93a88480e3cc None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:11:00.096388 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:00.147692 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6fc0f-3340-42ab-b01f-8492d7af328b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:11:00.148351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6fc0f-3340-42ab-b01f-8492d7af328b service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:00.148643 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6fc0f-3340-42ab-b01f-8492d7af328b service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:00.148925 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6fc0f-3340-42ab-b01f-8492d7af328b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:00.150626 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-fad6fc0f-3340-42ab-b01f-8492d7af328b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:00.262811 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6fc0f-3340-42ab-b01f-8492d7af328b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:11:00.264244 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6fc0f-3340-42ab-b01f-8492d7af328b service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:11:00.282949 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 715/1443] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:10:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:11:02.555641 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361089b-1509-4333-b292-dd3ea9feca94 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:02.556209 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361089b-1509-4333-b292-dd3ea9feca94 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:02.556209 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361089b-1509-4333-b292-dd3ea9feca94 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:02.557641 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:11:02.563320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82798ca-93e9-4831-9efe-726c1fbbc2e6 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:02.564171 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82798ca-93e9-4831-9efe-726c1fbbc2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:02.564346 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82798ca-93e9-4831-9efe-726c1fbbc2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:02.628292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-a82798ca-93e9-4831-9efe-726c1fbbc2e6 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:11:02.629413 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-a82798ca-93e9-4831-9efe-726c1fbbc2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:02.643475 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:02.731317 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:11:02.769964 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361089b-1509-4333-b292-dd3ea9feca94 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:11:02.771564 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-5361089b-1509-4333-b292-dd3ea9feca94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:02.878485 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361089b-1509-4333-b292-dd3ea9feca94 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:11:02.891239 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:02.951955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031dc14-c236-45b0-9ede-1d1d6acb9536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:11:02.953127 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031dc14-c236-45b0-9ede-1d1d6acb9536 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:02.953411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031dc14-c236-45b0-9ede-1d1d6acb9536 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:02.953687 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031dc14-c236-45b0-9ede-1d1d6acb9536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:02.955354 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-4031dc14-c236-45b0-9ede-1d1d6acb9536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:03.185156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4031dc14-c236-45b0-9ede-1d1d6acb9536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:11:03.187090 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4031dc14-c236-45b0-9ede-1d1d6acb9536 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:11:03.205911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 730/1446] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:11:05.534907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e83807-1558-44cb-9567-ca29b2d87322 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:05.535544 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e83807-1558-44cb-9567-ca29b2d87322 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:05.535544 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e83807-1558-44cb-9567-ca29b2d87322 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:05.536824 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:11:05.542069 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea741845-6d60-4b99-aac2-a2fcde360ced None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:05.542539 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea741845-6d60-4b99-aac2-a2fcde360ced None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:05.542699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea741845-6d60-4b99-aac2-a2fcde360ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:05.588604 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:05.608829 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-ea741845-6d60-4b99-aac2-a2fcde360ced None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:11:05.610063 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-ea741845-6d60-4b99-aac2-a2fcde360ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:05.709804 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:11:05.748122 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e83807-1558-44cb-9567-ca29b2d87322 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:11:05.749689 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-b8e83807-1558-44cb-9567-ca29b2d87322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:05.856855 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e83807-1558-44cb-9567-ca29b2d87322 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:11:05.898798 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:05.933792 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71390a01-2048-4c9e-aef7-c2178e5abf67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:11:05.934480 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71390a01-2048-4c9e-aef7-c2178e5abf67 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:05.934768 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71390a01-2048-4c9e-aef7-c2178e5abf67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:05.935046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71390a01-2048-4c9e-aef7-c2178e5abf67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:05.936730 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-71390a01-2048-4c9e-aef7-c2178e5abf67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:06.047138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71390a01-2048-4c9e-aef7-c2178e5abf67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:11:06.048584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71390a01-2048-4c9e-aef7-c2178e5abf67 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:11:06.068353 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 718/1449] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:11:08.183495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86790aa4-e997-42fb-8a9b-3174c2344b3f None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:08.184094 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86790aa4-e997-42fb-8a9b-3174c2344b3f None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:08.184094 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86790aa4-e997-42fb-8a9b-3174c2344b3f None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:08.185417 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:11:08.191350 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff1593-8490-4e6f-ba57-5742fbac8a68 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:08.191830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff1593-8490-4e6f-ba57-5742fbac8a68 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:08.191964 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff1593-8490-4e6f-ba57-5742fbac8a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:08.256876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-daff1593-8490-4e6f-ba57-5742fbac8a68 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:11:08.258105 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-daff1593-8490-4e6f-ba57-5742fbac8a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:08.278858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:08.356162 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:11:08.394498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86790aa4-e997-42fb-8a9b-3174c2344b3f None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:11:08.396164 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-86790aa4-e997-42fb-8a9b-3174c2344b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:08.501734 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86790aa4-e997-42fb-8a9b-3174c2344b3f None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:11:08.522173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:08.575392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8296d-6ea1-4cf9-8a77-fcf9a9c130b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:11:08.576045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8296d-6ea1-4cf9-8a77-fcf9a9c130b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:08.576334 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8296d-6ea1-4cf9-8a77-fcf9a9c130b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:08.576601 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8296d-6ea1-4cf9-8a77-fcf9a9c130b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:08.578321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-dcb8296d-6ea1-4cf9-8a77-fcf9a9c130b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:08.688034 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8296d-6ea1-4cf9-8a77-fcf9a9c130b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:11:08.689641 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8296d-6ea1-4cf9-8a77-fcf9a9c130b4 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:11:08.708744 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 733/1452] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:11:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:11:10.882862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca068d8-f1da-47cb-b28f-f7b03914936c None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:10.883699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca068d8-f1da-47cb-b28f-f7b03914936c None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:10.883861 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca068d8-f1da-47cb-b28f-f7b03914936c None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:10.885318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:11:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:11:10.891649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5129c-c487-4ac3-8b8e-756a270fd74a None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:10.892108 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5129c-c487-4ac3-8b8e-756a270fd74a None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:10.892245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5129c-c487-4ac3-8b8e-756a270fd74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:10.953890 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:10.956733 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-2be5129c-c487-4ac3-8b8e-756a270fd74a None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:11:10.958739 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-2be5129c-c487-4ac3-8b8e-756a270fd74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:11.055033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:11:11.093359 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca068d8-f1da-47cb-b28f-f7b03914936c None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:11:11.094943 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-dca068d8-f1da-47cb-b28f-f7b03914936c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:11.198515 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca068d8-f1da-47cb-b28f-f7b03914936c None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:11:11.249678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:11.274384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174da013-1917-4b3b-a292-6258c31b4380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:11:11.275076 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174da013-1917-4b3b-a292-6258c31b4380 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:11.275370 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174da013-1917-4b3b-a292-6258c31b4380 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:11.275647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174da013-1917-4b3b-a292-6258c31b4380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:11.277385 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-174da013-1917-4b3b-a292-6258c31b4380 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:11.388004 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174da013-1917-4b3b-a292-6258c31b4380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:11:11.389481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174da013-1917-4b3b-a292-6258c31b4380 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:11:11.408487 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 721/1455] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:11:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:11:13.539565 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a72ed-1a47-4eb8-bdc0-f46d974b4022 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:13.540210 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a72ed-1a47-4eb8-bdc0-f46d974b4022 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:13.540210 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a72ed-1a47-4eb8-bdc0-f46d974b4022 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:13.541518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:11:13.547456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9dead-59d4-4e09-9589-79a7ea6e07f9 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:13.548055 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9dead-59d4-4e09-9589-79a7ea6e07f9 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:13.548055 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9dead-59d4-4e09-9589-79a7ea6e07f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:13.615648 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-88d9dead-59d4-4e09-9589-79a7ea6e07f9 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:11:13.616873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-88d9dead-59d4-4e09-9589-79a7ea6e07f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:13.647378 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:13.718760 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:11:13.756865 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a72ed-1a47-4eb8-bdc0-f46d974b4022 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:11:13.758749 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a72a72ed-1a47-4eb8-bdc0-f46d974b4022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:13.864430 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a72ed-1a47-4eb8-bdc0-f46d974b4022 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:11:13.904901 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:13.970884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916e2de-f31e-420d-a1dd-e04e3fe49a8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:11:13.971863 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916e2de-f31e-420d-a1dd-e04e3fe49a8c service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:13.972294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916e2de-f31e-420d-a1dd-e04e3fe49a8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:13.972706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916e2de-f31e-420d-a1dd-e04e3fe49a8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:13.975328 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-9916e2de-f31e-420d-a1dd-e04e3fe49a8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:14.095482 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916e2de-f31e-420d-a1dd-e04e3fe49a8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:11:14.096926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916e2de-f31e-420d-a1dd-e04e3fe49a8c service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:11:14.116693 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 736/1458] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:11:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:11:16.288841 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bcd89-c693-4541-b7e1-30504066489f None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:16.289449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bcd89-c693-4541-b7e1-30504066489f None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:16.289449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bcd89-c693-4541-b7e1-30504066489f None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:16.290816 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:11:16.296793 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63723987-50f2-45e3-979b-c40ef11991ea None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:16.297275 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63723987-50f2-45e3-979b-c40ef11991ea None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:16.297375 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63723987-50f2-45e3-979b-c40ef11991ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:16.364118 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-63723987-50f2-45e3-979b-c40ef11991ea None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:11:16.365363 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-63723987-50f2-45e3-979b-c40ef11991ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:16.374604 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:16.465689 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:11:16.503733 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bcd89-c693-4541-b7e1-30504066489f None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:11:16.505313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-115bcd89-c693-4541-b7e1-30504066489f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:16.611167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bcd89-c693-4541-b7e1-30504066489f None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:11:16.667989 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:16.687972 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e0a3c-813a-4ccf-85c7-3c0b3e6a2fe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:11:16.688638 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e0a3c-813a-4ccf-85c7-3c0b3e6a2fe7 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:16.688927 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e0a3c-813a-4ccf-85c7-3c0b3e6a2fe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:16.689213 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e0a3c-813a-4ccf-85c7-3c0b3e6a2fe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:16.690906 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-3d3e0a3c-813a-4ccf-85c7-3c0b3e6a2fe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:16.801857 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e0a3c-813a-4ccf-85c7-3c0b3e6a2fe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:11:16.803414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e0a3c-813a-4ccf-85c7-3c0b3e6a2fe7 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:11:16.821794 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 724/1461] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:11:18.919217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8752d-3169-4b6a-bccb-4d0780bcd367 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:18.919778 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8752d-3169-4b6a-bccb-4d0780bcd367 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:18.919778 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8752d-3169-4b6a-bccb-4d0780bcd367 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:18.921199 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:11:18.926592 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0cac8-40c0-42bf-98ad-754bad5baef0 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:18.927311 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0cac8-40c0-42bf-98ad-754bad5baef0 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:18.927597 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0cac8-40c0-42bf-98ad-754bad5baef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:18.993841 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-f8f0cac8-40c0-42bf-98ad-754bad5baef0 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:11:18.995106 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-f8f0cac8-40c0-42bf-98ad-754bad5baef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:19.034941 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:19.093499 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:11:19.130260 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8752d-3169-4b6a-bccb-4d0780bcd367 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:11:19.131820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-42c8752d-3169-4b6a-bccb-4d0780bcd367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:19.235495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8752d-3169-4b6a-bccb-4d0780bcd367 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:11:19.273351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:19.311438 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e796b7-b4e0-4bd8-a8f6-04ac60d1311e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:11:19.312098 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e796b7-b4e0-4bd8-a8f6-04ac60d1311e service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:19.312379 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e796b7-b4e0-4bd8-a8f6-04ac60d1311e service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:19.312661 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e796b7-b4e0-4bd8-a8f6-04ac60d1311e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:19.314341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-12e796b7-b4e0-4bd8-a8f6-04ac60d1311e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:19.424754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e796b7-b4e0-4bd8-a8f6-04ac60d1311e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:11:19.426367 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e796b7-b4e0-4bd8-a8f6-04ac60d1311e service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:11:19.449760 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 739/1464] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:11:21.529992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98761650-7cab-48a3-a8e9-30d6ad41b3f7 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:21.530623 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98761650-7cab-48a3-a8e9-30d6ad41b3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:21.530623 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98761650-7cab-48a3-a8e9-30d6ad41b3f7 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:21.531979 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:11:21.538387 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75018d43-66d0-47bf-a0ed-190f0028ac5e None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:21.538953 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75018d43-66d0-47bf-a0ed-190f0028ac5e None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:21.538953 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75018d43-66d0-47bf-a0ed-190f0028ac5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:21.604187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-75018d43-66d0-47bf-a0ed-190f0028ac5e None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:11:21.605430 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-75018d43-66d0-47bf-a0ed-190f0028ac5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:21.623935 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:21.715713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:11:21.753662 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98761650-7cab-48a3-a8e9-30d6ad41b3f7 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:11:21.755254 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-98761650-7cab-48a3-a8e9-30d6ad41b3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:21.860874 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98761650-7cab-48a3-a8e9-30d6ad41b3f7 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:11:21.928058 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:21.935175 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15493f88-8e1a-45d1-9200-46d7289b8d8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:11:21.936353 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15493f88-8e1a-45d1-9200-46d7289b8d8c service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:21.936637 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15493f88-8e1a-45d1-9200-46d7289b8d8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:21.936914 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15493f88-8e1a-45d1-9200-46d7289b8d8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:21.938607 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-15493f88-8e1a-45d1-9200-46d7289b8d8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:22.049722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15493f88-8e1a-45d1-9200-46d7289b8d8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:11:22.051213 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15493f88-8e1a-45d1-9200-46d7289b8d8c service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:11:22.070380 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 727/1467] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:11:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:11:24.119756 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e058f-8fe2-4339-837c-2a109073687d None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:24.120362 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e058f-8fe2-4339-837c-2a109073687d None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:24.120362 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e058f-8fe2-4339-837c-2a109073687d None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:24.121714 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:11:24.127270 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079fb80-2125-4a7a-bc72-88a9059643a5 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:24.127745 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079fb80-2125-4a7a-bc72-88a9059643a5 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:24.127885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079fb80-2125-4a7a-bc72-88a9059643a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:24.193050 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-4079fb80-2125-4a7a-bc72-88a9059643a5 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:11:24.194371 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-4079fb80-2125-4a7a-bc72-88a9059643a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:24.244559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:24.293608 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:11:24.330236 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e058f-8fe2-4339-837c-2a109073687d None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:11:24.331839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a19e058f-8fe2-4339-837c-2a109073687d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:24.437120 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e058f-8fe2-4339-837c-2a109073687d None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:11:24.484728 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:24.511851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79bb13-b58f-4c26-a6b4-3bffe5e7ac64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:11:24.512534 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79bb13-b58f-4c26-a6b4-3bffe5e7ac64 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:24.512820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79bb13-b58f-4c26-a6b4-3bffe5e7ac64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:24.513098 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79bb13-b58f-4c26-a6b4-3bffe5e7ac64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:24.515416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-9b79bb13-b58f-4c26-a6b4-3bffe5e7ac64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:24.631059 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79bb13-b58f-4c26-a6b4-3bffe5e7ac64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:11:24.632537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79bb13-b58f-4c26-a6b4-3bffe5e7ac64 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:11:24.652706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 742/1470] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:11:34.291735 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=22 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:34.650542 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=66 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:44.524864 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf587d38-0c5b-453e-a28a-a533cd53a5a4 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:44.525397 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf587d38-0c5b-453e-a28a-a533cd53a5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:44.525534 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf587d38-0c5b-453e-a28a-a533cd53a5a4 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:44.526860 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 729/1471] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:11:44.532062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ab037-58b3-4ae5-9dfd-8ed31b9b1d57 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:44.532469 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ab037-58b3-4ae5-9dfd-8ed31b9b1d57 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:44.532624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ab037-58b3-4ae5-9dfd-8ed31b9b1d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:44.598197 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-395ab037-58b3-4ae5-9dfd-8ed31b9b1d57 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:11:44.599322 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-395ab037-58b3-4ae5-9dfd-8ed31b9b1d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:44.695141 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 743/1472] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:11:44.778411 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382208f-b4cb-4c38-805b-8f96a29ad12f None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:44.778699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382208f-b4cb-4c38-805b-8f96a29ad12f None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:44.778976 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382208f-b4cb-4c38-805b-8f96a29ad12f None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:44.780739 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 730/1473] 10.222.0.17 () {54 vars in 962 bytes} [Tue Jul 12 13:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:11:44.785612 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b77b1b-6e5a-4820-a643-696f8d22327d None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:44.785942 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b77b1b-6e5a-4820-a643-696f8d22327d None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:44.786263 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b77b1b-6e5a-4820-a643-696f8d22327d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:44.867060 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-a6b77b1b-6e5a-4820-a643-696f8d22327d None None] MFA Rules not processed for user `f7af0259f7f24dfdafbdfc1f613ebb42`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:11:44.868188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a6b77b1b-6e5a-4820-a643-696f8d22327d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:44.889068 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:44.943830 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 744/1474] 10.222.0.17 () {58 vars in 1059 bytes} [Tue Jul 12 13:11:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:11:44.951280 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382208f-b4cb-4c38-805b-8f96a29ad12f None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:11:44.952785 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-b382208f-b4cb-4c38-805b-8f96a29ad12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:45.055739 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382208f-b4cb-4c38-805b-8f96a29ad12f None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:11:45.127262 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71280a26-b483-4b3e-844a-eaed69317c28 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7af0259f7f24dfdafbdfc1f613ebb42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:11:45.127831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71280a26-b483-4b3e-844a-eaed69317c28 service glance] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:45.128116 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71280a26-b483-4b3e-844a-eaed69317c28 service glance] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:45.128396 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71280a26-b483-4b3e-844a-eaed69317c28 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:45.130049 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-71280a26-b483-4b3e-844a-eaed69317c28 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:45.185741 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:45.240136 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71280a26-b483-4b3e-844a-eaed69317c28 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:11:45.241577 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71280a26-b483-4b3e-844a-eaed69317c28 service glance] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:11:45.259601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 731/1475] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:11:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:11:47.380080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b844dcf-bce3-4403-85f1-c01b64d6e936 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:47.380600 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b844dcf-bce3-4403-85f1-c01b64d6e936 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:47.380600 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b844dcf-bce3-4403-85f1-c01b64d6e936 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:47.382085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 745/1476] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:11:47.387700 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31f87f-d992-47e0-88c4-e4e764b92d98 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:47.388194 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31f87f-d992-47e0-88c4-e4e764b92d98 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:47.388289 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31f87f-d992-47e0-88c4-e4e764b92d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:47.458186 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-1c31f87f-d992-47e0-88c4-e4e764b92d98 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:11:47.459381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-1c31f87f-d992-47e0-88c4-e4e764b92d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:47.557289 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 732/1477] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:11:47.580326 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b844dcf-bce3-4403-85f1-c01b64d6e936 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:11:47.581860 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-1b844dcf-bce3-4403-85f1-c01b64d6e936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:47.708199 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b844dcf-bce3-4403-85f1-c01b64d6e936 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:11:47.757668 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:47.803293 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e8eba-2b17-4b47-98e0-21fe55daaef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:11:47.803957 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e8eba-2b17-4b47-98e0-21fe55daaef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:47.804244 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e8eba-2b17-4b47-98e0-21fe55daaef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:47.804523 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e8eba-2b17-4b47-98e0-21fe55daaef3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:47.805257 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e8eba-2b17-4b47-98e0-21fe55daaef3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:11:47.807026 dv-cinder-797608-55-smb devstack@keystone.service[80628]: WARNING py.warnings [None req-de2e8eba-2b17-4b47-98e0-21fe55daaef3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:11:47.807026 dv-cinder-797608-55-smb devstack@keystone.service[80628]: warnings.warn(msg) Jul 12 13:11:47.807026 dv-cinder-797608-55-smb devstack@keystone.service[80628]: Jul 12 13:11:47.808178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e8eba-2b17-4b47-98e0-21fe55daaef3 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:11:47.839094 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 746/1478] 10.222.0.17 () {56 vars in 1108 bytes} [Tue Jul 12 13:11:47 2022] GET /identity/v3/projects => generated 2553 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:11:49.876024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60dc36a-f735-47b7-945e-70f0652fc362 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:49.876627 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60dc36a-f735-47b7-945e-70f0652fc362 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:49.876627 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60dc36a-f735-47b7-945e-70f0652fc362 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:49.877965 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 733/1479] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:11:49.883088 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74aa8ce-3b7d-4818-bacb-8862e8b0e9cf None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:49.883487 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74aa8ce-3b7d-4818-bacb-8862e8b0e9cf None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:49.883651 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74aa8ce-3b7d-4818-bacb-8862e8b0e9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:49.946375 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-e74aa8ce-3b7d-4818-bacb-8862e8b0e9cf None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:11:49.947583 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-e74aa8ce-3b7d-4818-bacb-8862e8b0e9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:50.042081 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 747/1480] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:11:50.084322 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60dc36a-f735-47b7-945e-70f0652fc362 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:11:50.085846 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-a60dc36a-f735-47b7-945e-70f0652fc362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:50.096098 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:50.229950 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60dc36a-f735-47b7-945e-70f0652fc362 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:11:50.307967 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:50.340956 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa0088-11ce-4b81-b55a-da9e7f6306bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:11:50.341626 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa0088-11ce-4b81-b55a-da9e7f6306bf service nova] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:50.341910 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa0088-11ce-4b81-b55a-da9e7f6306bf service nova] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:50.342217 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa0088-11ce-4b81-b55a-da9e7f6306bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:50.343831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-5eaa0088-11ce-4b81-b55a-da9e7f6306bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:50.430733 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa0088-11ce-4b81-b55a-da9e7f6306bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:11:50.432322 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa0088-11ce-4b81-b55a-da9e7f6306bf service nova] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:11:50.450838 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 734/1481] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:11:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:11:52.663340 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b4104-5ce1-4936-97eb-6de371ba9996 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:52.663900 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b4104-5ce1-4936-97eb-6de371ba9996 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:52.663900 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b4104-5ce1-4936-97eb-6de371ba9996 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:52.665191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 748/1482] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:11:52.670435 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb631c-50bd-4a98-b976-cb7b4d123346 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:52.670881 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb631c-50bd-4a98-b976-cb7b4d123346 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:52.671026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb631c-50bd-4a98-b976-cb7b4d123346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:52.735464 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-6bbb631c-50bd-4a98-b976-cb7b4d123346 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:11:52.736669 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-6bbb631c-50bd-4a98-b976-cb7b4d123346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:52.783187 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:52.834283 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 735/1483] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:11:52.870140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b4104-5ce1-4936-97eb-6de371ba9996 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:11:52.872182 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-562b4104-5ce1-4936-97eb-6de371ba9996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:52.896367 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:52.974273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b4104-5ce1-4936-97eb-6de371ba9996 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:11:53.048985 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb670e8c-3ebd-4130-b5b0-43cbcfdab860 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:11:53.049671 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb670e8c-3ebd-4130-b5b0-43cbcfdab860 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:53.049987 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb670e8c-3ebd-4130-b5b0-43cbcfdab860 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:53.050285 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb670e8c-3ebd-4130-b5b0-43cbcfdab860 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:53.051939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-cb670e8c-3ebd-4130-b5b0-43cbcfdab860 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:53.124865 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:53.158607 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb670e8c-3ebd-4130-b5b0-43cbcfdab860 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:11:53.160032 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb670e8c-3ebd-4130-b5b0-43cbcfdab860 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:11:53.178318 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 749/1484] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:11:55.267404 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b6853-d563-432d-80d9-07495202a3fb None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:55.267978 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b6853-d563-432d-80d9-07495202a3fb None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:55.267978 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b6853-d563-432d-80d9-07495202a3fb None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:55.269355 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 736/1485] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:11:55.274724 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005625c-7ee5-42b3-8ac6-c92564e4b1d2 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:55.275162 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005625c-7ee5-42b3-8ac6-c92564e4b1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:55.275264 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005625c-7ee5-42b3-8ac6-c92564e4b1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:55.339140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-7005625c-7ee5-42b3-8ac6-c92564e4b1d2 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:11:55.340957 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-7005625c-7ee5-42b3-8ac6-c92564e4b1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:55.436775 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 750/1486] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:11:55.474714 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b6853-d563-432d-80d9-07495202a3fb None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:11:55.476257 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-484b6853-d563-432d-80d9-07495202a3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:55.582870 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b6853-d563-432d-80d9-07495202a3fb None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:11:55.656566 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:55.658519 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6674567-e21d-4f54-9ff9-b7d400b11d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:11:55.659214 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6674567-e21d-4f54-9ff9-b7d400b11d0a service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:55.659685 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6674567-e21d-4f54-9ff9-b7d400b11d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:55.660168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6674567-e21d-4f54-9ff9-b7d400b11d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:55.662033 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-b6674567-e21d-4f54-9ff9-b7d400b11d0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:55.771075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6674567-e21d-4f54-9ff9-b7d400b11d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:11:55.772482 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6674567-e21d-4f54-9ff9-b7d400b11d0a service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:11:55.791231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 737/1487] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:11:57.985143 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963f9bd-7181-4c63-a979-5d0147f47311 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:57.985699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963f9bd-7181-4c63-a979-5d0147f47311 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:57.985699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963f9bd-7181-4c63-a979-5d0147f47311 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:57.987104 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 751/1488] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:11:57.992232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcab7c-b8cc-45f5-bcda-68649c043338 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:57.992674 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcab7c-b8cc-45f5-bcda-68649c043338 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:57.992778 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcab7c-b8cc-45f5-bcda-68649c043338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:58.056850 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-15dcab7c-b8cc-45f5-bcda-68649c043338 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:11:58.058047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-15dcab7c-b8cc-45f5-bcda-68649c043338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:58.109631 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:58.154232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 738/1489] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:11:58.193472 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963f9bd-7181-4c63-a979-5d0147f47311 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:11:58.195077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-4963f9bd-7181-4c63-a979-5d0147f47311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:58.232167 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:58.299272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963f9bd-7181-4c63-a979-5d0147f47311 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:11:58.370427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a776a4-83a2-4edf-a629-bd85e2988b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:11:58.371083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a776a4-83a2-4edf-a629-bd85e2988b35 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:11:58.371367 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a776a4-83a2-4edf-a629-bd85e2988b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:11:58.371642 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a776a4-83a2-4edf-a629-bd85e2988b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:11:58.373282 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-15a776a4-83a2-4edf-a629-bd85e2988b35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:11:58.455250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:11:58.484354 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a776a4-83a2-4edf-a629-bd85e2988b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:11:58.485799 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a776a4-83a2-4edf-a629-bd85e2988b35 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:11:58.505913 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 752/1490] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:11:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:12:00.729569 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e963d-6535-4271-93a9-d56a07356bde None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:12:00.730101 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e963d-6535-4271-93a9-d56a07356bde None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:12:00.730101 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e963d-6535-4271-93a9-d56a07356bde None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:12:00.732439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 739/1491] 10.222.0.17 () {54 vars in 926 bytes} [Tue Jul 12 13:12:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:12:00.737556 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6dbb0-cc3a-45e6-ac19-2a0a3970bdac None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:12:00.738007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6dbb0-cc3a-45e6-ac19-2a0a3970bdac None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:12:00.738158 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6dbb0-cc3a-45e6-ac19-2a0a3970bdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:12:00.802637 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-c7e6dbb0-cc3a-45e6-ac19-2a0a3970bdac None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:12:00.803840 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-c7e6dbb0-cc3a-45e6-ac19-2a0a3970bdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:12:00.898541 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 753/1492] 10.222.0.17 () {58 vars in 1023 bytes} [Tue Jul 12 13:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:12:00.937162 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e963d-6535-4271-93a9-d56a07356bde None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:12:00.938794 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-366e963d-6535-4271-93a9-d56a07356bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:12:01.041308 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e963d-6535-4271-93a9-d56a07356bde None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:12:01.112687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95dcf2-976a-4385-9c1a-9c26ede9ec9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:12:01.113333 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95dcf2-976a-4385-9c1a-9c26ede9ec9c service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:12:01.113616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95dcf2-976a-4385-9c1a-9c26ede9ec9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:12:01.113893 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95dcf2-976a-4385-9c1a-9c26ede9ec9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:12:01.115547 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-cb95dcf2-976a-4385-9c1a-9c26ede9ec9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:12:01.124522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:12:01.225743 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95dcf2-976a-4385-9c1a-9c26ede9ec9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:12:01.227190 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95dcf2-976a-4385-9c1a-9c26ede9ec9c service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:12:01.244582 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 740/1493] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:12:10.896730 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=82 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:12:11.242362 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=50 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:13:27.670457 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578f347-1cbf-4791-8cf0-15155e90ec68 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:13:27.671050 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578f347-1cbf-4791-8cf0-15155e90ec68 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:13:27.671050 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578f347-1cbf-4791-8cf0-15155e90ec68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:13:27.744846 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-9578f347-1cbf-4791-8cf0-15155e90ec68 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:13:27.746070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-9578f347-1cbf-4791-8cf0-15155e90ec68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:13:27.841048 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 754/1494] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:13:27.848963 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d342ad-82f4-4ac7-9f98-8c20c5da1c5a None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:13:27.849453 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d342ad-82f4-4ac7-9f98-8c20c5da1c5a None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:13:27.849559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d342ad-82f4-4ac7-9f98-8c20c5da1c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:13:27.924117 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-85d342ad-82f4-4ac7-9f98-8c20c5da1c5a None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:13:27.925309 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-85d342ad-82f4-4ac7-9f98-8c20c5da1c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:13:28.019188 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 741/1495] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:13:28.023897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578f347-1cbf-4791-8cf0-15155e90ec68 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:13:28.025691 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-9578f347-1cbf-4791-8cf0-15155e90ec68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:13:28.036950 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578f347-1cbf-4791-8cf0-15155e90ec68 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:13:28.097351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:13:28.130690 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709bb881-622a-4334-a6d0-9e7b93ca7d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:13:28.131348 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bb881-622a-4334-a6d0-9e7b93ca7d1b admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:13:28.131630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bb881-622a-4334-a6d0-9e7b93ca7d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:13:28.131905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bb881-622a-4334-a6d0-9e7b93ca7d1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:13:28.132623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709bb881-622a-4334-a6d0-9e7b93ca7d1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:13:28.132930 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709bb881-622a-4334-a6d0-9e7b93ca7d1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:13:28.134764 dv-cinder-797608-55-smb devstack@keystone.service[80628]: WARNING py.warnings [None req-709bb881-622a-4334-a6d0-9e7b93ca7d1b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:13:28.134764 dv-cinder-797608-55-smb devstack@keystone.service[80628]: warnings.warn(msg) Jul 12 13:13:28.134764 dv-cinder-797608-55-smb devstack@keystone.service[80628]: Jul 12 13:13:28.135686 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709bb881-622a-4334-a6d0-9e7b93ca7d1b admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:13:28.146690 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 755/1496] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:13:28.155550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d342ad-82f4-4ac7-9f98-8c20c5da1c5a None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:13:28.164777 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d342ad-82f4-4ac7-9f98-8c20c5da1c5a None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:13:28.224453 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:13:28.256877 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2719b-f2de-4ba2-9260-00e63840b5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:13:28.257536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2719b-f2de-4ba2-9260-00e63840b5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:13:28.257822 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2719b-f2de-4ba2-9260-00e63840b5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:13:28.258100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2719b-f2de-4ba2-9260-00e63840b5f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:13:28.259647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2719b-f2de-4ba2-9260-00e63840b5f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:13:28.261361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: WARNING py.warnings [None req-c4a2719b-f2de-4ba2-9260-00e63840b5f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:13:28.261361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: warnings.warn(msg) Jul 12 13:13:28.261361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: Jul 12 13:13:28.262591 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2719b-f2de-4ba2-9260-00e63840b5f4 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:13:28.317517 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 742/1497] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:13:28 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:13:28.322369 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709bb881-622a-4334-a6d0-9e7b93ca7d1b admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:13:28.323925 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-709bb881-622a-4334-a6d0-9e7b93ca7d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:13:28.357837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709bb881-622a-4334-a6d0-9e7b93ca7d1b admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:13:28.452199 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60221693-3d5f-44cb-96f8-b66c6c88bafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:13:28.452875 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60221693-3d5f-44cb-96f8-b66c6c88bafb admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:13:28.453160 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60221693-3d5f-44cb-96f8-b66c6c88bafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:13:28.453437 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60221693-3d5f-44cb-96f8-b66c6c88bafb admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:13:28.454143 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60221693-3d5f-44cb-96f8-b66c6c88bafb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:13:28.455164 dv-cinder-797608-55-smb devstack@keystone.service[80628]: WARNING py.warnings [None req-60221693-3d5f-44cb-96f8-b66c6c88bafb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:13:28.455164 dv-cinder-797608-55-smb devstack@keystone.service[80628]: warnings.warn(msg) Jul 12 13:13:28.455164 dv-cinder-797608-55-smb devstack@keystone.service[80628]: Jul 12 13:13:28.456363 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60221693-3d5f-44cb-96f8-b66c6c88bafb admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:13:28.496370 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 756/1498] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:13:28 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:13:28.500491 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2719b-f2de-4ba2-9260-00e63840b5f4 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:13:28.502024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-c4a2719b-f2de-4ba2-9260-00e63840b5f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:13:28.565069 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2719b-f2de-4ba2-9260-00e63840b5f4 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:13:28.660483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:13:28.672633 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02dc86-bdb2-4beb-8215-6e4b2d01af4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:13:28.673319 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02dc86-bdb2-4beb-8215-6e4b2d01af4e admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:13:28.673603 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02dc86-bdb2-4beb-8215-6e4b2d01af4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:13:28.673878 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02dc86-bdb2-4beb-8215-6e4b2d01af4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:13:28.674643 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02dc86-bdb2-4beb-8215-6e4b2d01af4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:13:28.675667 dv-cinder-797608-55-smb devstack@keystone.service[80627]: WARNING py.warnings [None req-be02dc86-bdb2-4beb-8215-6e4b2d01af4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:13:28.675667 dv-cinder-797608-55-smb devstack@keystone.service[80627]: warnings.warn(msg) Jul 12 13:13:28.675667 dv-cinder-797608-55-smb devstack@keystone.service[80627]: Jul 12 13:13:28.676567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02dc86-bdb2-4beb-8215-6e4b2d01af4e admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:13:28.690300 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 743/1499] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:13:28.694292 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60221693-3d5f-44cb-96f8-b66c6c88bafb admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:13:28.696205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-60221693-3d5f-44cb-96f8-b66c6c88bafb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:13:28.708377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60221693-3d5f-44cb-96f8-b66c6c88bafb admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:13:28.733152 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:13:28.802214 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938bace6-a2d1-4840-97f0-97b6e08f4d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:13:28.802891 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bace6-a2d1-4840-97f0-97b6e08f4d17 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:13:28.803182 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bace6-a2d1-4840-97f0-97b6e08f4d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:13:28.803460 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bace6-a2d1-4840-97f0-97b6e08f4d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:13:28.804212 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938bace6-a2d1-4840-97f0-97b6e08f4d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:13:28.805229 dv-cinder-797608-55-smb devstack@keystone.service[80628]: WARNING py.warnings [None req-938bace6-a2d1-4840-97f0-97b6e08f4d17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:13:28.805229 dv-cinder-797608-55-smb devstack@keystone.service[80628]: warnings.warn(msg) Jul 12 13:13:28.805229 dv-cinder-797608-55-smb devstack@keystone.service[80628]: Jul 12 13:13:28.806629 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938bace6-a2d1-4840-97f0-97b6e08f4d17 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:13:28.818651 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 757/1500] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:13:28.823410 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02dc86-bdb2-4beb-8215-6e4b2d01af4e admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:13:28.824941 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-be02dc86-bdb2-4beb-8215-6e4b2d01af4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:13:28.858969 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02dc86-bdb2-4beb-8215-6e4b2d01af4e admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:13:28.954585 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd91928-237a-492a-a5a7-43dcf0afcada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:13:28.955471 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd91928-237a-492a-a5a7-43dcf0afcada admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:13:28.955758 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd91928-237a-492a-a5a7-43dcf0afcada admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:13:28.956034 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd91928-237a-492a-a5a7-43dcf0afcada admin admin] PATH_INFO: `/v3/projects/b51342570ff44422973078274a1cbc30/users/3e8ea399e26949cfa4403cc01deb28c0/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:13:28.978631 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd91928-237a-492a-a5a7-43dcf0afcada admin admin] RBAC: Authorizing `identity:create_grant(project_id=b51342570ff44422973078274a1cbc30, user_id=3e8ea399e26949cfa4403cc01deb28c0, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:13:28.979664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: WARNING py.warnings [None req-edd91928-237a-492a-a5a7-43dcf0afcada admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:13:28.979664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: warnings.warn(msg) Jul 12 13:13:28.979664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: Jul 12 13:13:28.981608 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd91928-237a-492a-a5a7-43dcf0afcada admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:13:29.005915 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 744/1501] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:13:28 2022] PUT /identity/v3/projects/b51342570ff44422973078274a1cbc30/users/3e8ea399e26949cfa4403cc01deb28c0/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:13:29.018213 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf42762-ce4e-46c1-8ae1-0b740ea0886b None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:13:29.018510 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf42762-ce4e-46c1-8ae1-0b740ea0886b None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:13:29.018793 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf42762-ce4e-46c1-8ae1-0b740ea0886b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:13:29.073572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-6bf42762-ce4e-46c1-8ae1-0b740ea0886b None None] MFA Rules not processed for user `3e8ea399e26949cfa4403cc01deb28c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:13:29.074806 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-6bf42762-ce4e-46c1-8ae1-0b740ea0886b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:13:29.150258 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 758/1502] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:13:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:13:29.163397 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18445032-8407-40ec-814b-5d45800ba05b None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:13:29.163692 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18445032-8407-40ec-814b-5d45800ba05b None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:13:29.163973 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18445032-8407-40ec-814b-5d45800ba05b None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:13:29.165841 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 745/1503] 10.222.0.17 () {54 vars in 963 bytes} [Tue Jul 12 13:13:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:13:29.170632 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c9147-32f1-4a4e-87f0-d8ebb62b77ea None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:13:29.170925 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c9147-32f1-4a4e-87f0-d8ebb62b77ea None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:13:29.171208 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c9147-32f1-4a4e-87f0-d8ebb62b77ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:13:29.200877 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:13:29.245477 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-4b2c9147-32f1-4a4e-87f0-d8ebb62b77ea None None] MFA Rules not processed for user `e8b89afc60864451ba7b5a0a6d190628`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:13:29.246647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-4b2c9147-32f1-4a4e-87f0-d8ebb62b77ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:13:29.319939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 759/1504] 10.222.0.17 () {58 vars in 1060 bytes} [Tue Jul 12 13:13:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:13:29.327640 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18445032-8407-40ec-814b-5d45800ba05b None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:13:29.329145 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-18445032-8407-40ec-814b-5d45800ba05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:13:29.378934 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:13:29.432631 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18445032-8407-40ec-814b-5d45800ba05b None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:13:29.505834 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6fee6-b204-4f1a-a7a0-9b900c17fea0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:13:29.506670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6fee6-b204-4f1a-a7a0-9b900c17fea0 service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:13:29.506819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6fee6-b204-4f1a-a7a0-9b900c17fea0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:13:29.507016 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6fee6-b204-4f1a-a7a0-9b900c17fea0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:13:29.508649 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-51f6fee6-b204-4f1a-a7a0-9b900c17fea0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:13:29.607242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6fee6-b204-4f1a-a7a0-9b900c17fea0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:13:29.608671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6fee6-b204-4f1a-a7a0-9b900c17fea0 service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:13:29.612175 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:13:29.626690 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 746/1505] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:13:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:13:29.669144 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515a636-be05-473e-a71d-bbe7544fc747 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:13:29.669444 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515a636-be05-473e-a71d-bbe7544fc747 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:13:29.669731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515a636-be05-473e-a71d-bbe7544fc747 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:13:29.671052 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 760/1506] 10.222.0.17 () {52 vars in 829 bytes} [Tue Jul 12 13:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:13:29.675928 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6fee6-b204-4f1a-a7a0-9b900c17fea0 service cinder] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:13:29.677179 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-51f6fee6-b204-4f1a-a7a0-9b900c17fea0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:13:29.776588 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6fee6-b204-4f1a-a7a0-9b900c17fea0 service cinder] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:13:29.867886 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6daad6-6209-48e4-b521-5ee389540279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:13:29.868760 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6daad6-6209-48e4-b521-5ee389540279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:13:29.869043 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6daad6-6209-48e4-b521-5ee389540279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:13:29.869343 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6daad6-6209-48e4-b521-5ee389540279 admin admin] PATH_INFO: `/v3/users/3e8ea399e26949cfa4403cc01deb28c0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:13:29.881628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6daad6-6209-48e4-b521-5ee389540279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e8ea399e26949cfa4403cc01deb28c0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:13:29.882678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: WARNING py.warnings [None req-5c6daad6-6209-48e4-b521-5ee389540279 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:13:29.882678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: warnings.warn(msg) Jul 12 13:13:29.882678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: Jul 12 13:13:29.884138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6daad6-6209-48e4-b521-5ee389540279 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:13:29.894231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:13:29.947294 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-5c6daad6-6209-48e4-b521-5ee389540279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e8ea399e26949cfa4403cc01deb28c0'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:13:29.948308 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-5c6daad6-6209-48e4-b521-5ee389540279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e8ea399e26949cfa4403cc01deb28c0'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:13:29.957801 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-5c6daad6-6209-48e4-b521-5ee389540279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e8ea399e26949cfa4403cc01deb28c0'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:13:29.969469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-5c6daad6-6209-48e4-b521-5ee389540279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e8ea399e26949cfa4403cc01deb28c0'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:13:29.987549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-5c6daad6-6209-48e4-b521-5ee389540279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e8ea399e26949cfa4403cc01deb28c0'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:13:29.993111 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 747/1507] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:13:29 2022] DELETE /identity/v3/users/3e8ea399e26949cfa4403cc01deb28c0 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:13:29.997993 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d53e8-4280-4389-91d9-0fe38c56d0b6 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:13:29.998521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d53e8-4280-4389-91d9-0fe38c56d0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:13:29.998630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d53e8-4280-4389-91d9-0fe38c56d0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:13:30.053303 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-288d53e8-4280-4389-91d9-0fe38c56d0b6 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:13:30.054453 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-288d53e8-4280-4389-91d9-0fe38c56d0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:13:30.129671 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:13:30.143398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 761/1508] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:13:30.152770 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6daad6-6209-48e4-b521-5ee389540279 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:13:30.154041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-5c6daad6-6209-48e4-b521-5ee389540279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:13:30.254817 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6daad6-6209-48e4-b521-5ee389540279 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:13:30.309137 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:13:30.330572 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c022f-21da-48d1-862e-6b9a95d362e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:13:30.331227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c022f-21da-48d1-862e-6b9a95d362e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:13:30.331513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c022f-21da-48d1-862e-6b9a95d362e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:13:30.331788 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c022f-21da-48d1-862e-6b9a95d362e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:13:30.333414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-030c022f-21da-48d1-862e-6b9a95d362e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:13:30.440385 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c022f-21da-48d1-862e-6b9a95d362e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:13:30.441826 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c022f-21da-48d1-862e-6b9a95d362e5 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:13:30.460195 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 748/1509] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:13:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:13:30.786842 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d53e8-4280-4389-91d9-0fe38c56d0b6 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:13:30.788089 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-288d53e8-4280-4389-91d9-0fe38c56d0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:13:30.800288 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d53e8-4280-4389-91d9-0fe38c56d0b6 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:13:30.897119 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45f969-2096-4d43-a2cc-9e6279ecdce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:13:30.897905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45f969-2096-4d43-a2cc-9e6279ecdce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:13:30.898226 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45f969-2096-4d43-a2cc-9e6279ecdce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:13:30.898512 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45f969-2096-4d43-a2cc-9e6279ecdce3 admin admin] PATH_INFO: `/v3/projects/b51342570ff44422973078274a1cbc30` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:13:30.908826 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45f969-2096-4d43-a2cc-9e6279ecdce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b51342570ff44422973078274a1cbc30)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:13:30.909862 dv-cinder-797608-55-smb devstack@keystone.service[80628]: WARNING py.warnings [None req-cc45f969-2096-4d43-a2cc-9e6279ecdce3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:13:30.909862 dv-cinder-797608-55-smb devstack@keystone.service[80628]: warnings.warn(msg) Jul 12 13:13:30.909862 dv-cinder-797608-55-smb devstack@keystone.service[80628]: Jul 12 13:13:30.911101 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45f969-2096-4d43-a2cc-9e6279ecdce3 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:13:30.967665 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-cc45f969-2096-4d43-a2cc-9e6279ecdce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b51342570ff44422973078274a1cbc30', 'request_id': 'req-cc45f969-2096-4d43-a2cc-9e6279ecdce3'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:13:30.981551 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-cc45f969-2096-4d43-a2cc-9e6279ecdce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b51342570ff44422973078274a1cbc30', 'request_id': 'req-cc45f969-2096-4d43-a2cc-9e6279ecdce3'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:13:30.990582 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-cc45f969-2096-4d43-a2cc-9e6279ecdce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b51342570ff44422973078274a1cbc30', 'request_id': 'req-cc45f969-2096-4d43-a2cc-9e6279ecdce3'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:13:31.014209 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-cc45f969-2096-4d43-a2cc-9e6279ecdce3 admin admin] The token cache is being invalidate because project b51342570ff44422973078274a1cbc30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:13:31.014815 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-cc45f969-2096-4d43-a2cc-9e6279ecdce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:13:31.015035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-cc45f969-2096-4d43-a2cc-9e6279ecdce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:13:31.016359 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 762/1510] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:13:30 2022] DELETE /identity/v3/projects/b51342570ff44422973078274a1cbc30 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:13:40.457862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=62 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:13:41.012257 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:15:15.223563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98cbc6-6c31-400d-936d-9c9e0dacf9d4 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:15.224200 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98cbc6-6c31-400d-936d-9c9e0dacf9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:15.224200 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98cbc6-6c31-400d-936d-9c9e0dacf9d4 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:15.225508 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 13:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:15:15.230428 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c3444-872f-4f9b-bc30-11ae464f6a7b None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:15.230883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c3444-872f-4f9b-bc30-11ae464f6a7b None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:15.230991 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c3444-872f-4f9b-bc30-11ae464f6a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:15.311529 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-e98c3444-872f-4f9b-bc30-11ae464f6a7b None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:15:15.312796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-e98c3444-872f-4f9b-bc30-11ae464f6a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:15:15.417202 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 13:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:15:15.571617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98cbc6-6c31-400d-936d-9c9e0dacf9d4 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:15:15.573775 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-2b98cbc6-6c31-400d-936d-9c9e0dacf9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:15:15.694706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98cbc6-6c31-400d-936d-9c9e0dacf9d4 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:15:15.700215 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc406a-97d6-44f8-93a4-d37f676ed0bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:15:15.700879 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc406a-97d6-44f8-93a4-d37f676ed0bd service nova] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:15.701169 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc406a-97d6-44f8-93a4-d37f676ed0bd service nova] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:15.701454 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc406a-97d6-44f8-93a4-d37f676ed0bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:15.710276 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc406a-97d6-44f8-93a4-d37f676ed0bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:15:15.711868 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc406a-97d6-44f8-93a4-d37f676ed0bd service nova] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:15:15.721984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 750/1513] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:15:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:15:16.560325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf74fa-d19b-42b5-be61-207d3b16f515 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:16.560860 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf74fa-d19b-42b5-be61-207d3b16f515 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:16.560969 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf74fa-d19b-42b5-be61-207d3b16f515 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:16.562639 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 764/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 13:15:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:15:16.569459 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea38e25-1df0-4b84-9617-e669037484b2 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:16.569968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea38e25-1df0-4b84-9617-e669037484b2 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:16.570160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea38e25-1df0-4b84-9617-e669037484b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:16.588889 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-aea38e25-1df0-4b84-9617-e669037484b2 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:15:16.590104 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-aea38e25-1df0-4b84-9617-e669037484b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:15:16.602145 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 751/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 13:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:15:16.623558 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e94f42-c6a9-42ba-905e-cca250717a9e None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:16.623857 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e94f42-c6a9-42ba-905e-cca250717a9e None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:16.624139 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e94f42-c6a9-42ba-905e-cca250717a9e None None] PATH_INFO: `/v3` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:16.625522 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 765/1516] 10.222.0.44 () {54 vars in 925 bytes} [Tue Jul 12 13:15:16 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:15:16.633115 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afab6b-d19b-46b7-8ef5-585777856e1d None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:16.633410 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afab6b-d19b-46b7-8ef5-585777856e1d None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:16.633693 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afab6b-d19b-46b7-8ef5-585777856e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:16.699699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-f5afab6b-d19b-46b7-8ef5-585777856e1d None None] MFA Rules not processed for user `698828dd940f46e2b493ba55cd894eac`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:15:16.700905 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-f5afab6b-d19b-46b7-8ef5-585777856e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:15:16.752343 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e94f42-c6a9-42ba-905e-cca250717a9e None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:15:16.754002 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:15:16.768103 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e94f42-c6a9-42ba-905e-cca250717a9e None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:15:16.773612 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 752/1517] 10.222.0.44 () {58 vars in 1015 bytes} [Tue Jul 12 13:15:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:15:16.774149 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fa548-3bfc-4957-9df2-147ae5a92a39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:15:16.774794 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fa548-3bfc-4957-9df2-147ae5a92a39 service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:16.775085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fa548-3bfc-4957-9df2-147ae5a92a39 service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:16.775369 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fa548-3bfc-4957-9df2-147ae5a92a39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:16.784426 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fa548-3bfc-4957-9df2-147ae5a92a39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:15:16.786041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fa548-3bfc-4957-9df2-147ae5a92a39 service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:15:16.795705 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 766/1518] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:15:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:15:25.421242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8617967-1e26-4513-86e7-26bd24323d76 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:25.422294 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8617967-1e26-4513-86e7-26bd24323d76 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:25.422294 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8617967-1e26-4513-86e7-26bd24323d76 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:25.423765 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 753/1519] 10.222.0.17 () {54 vars in 960 bytes} [Tue Jul 12 13:15:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:15:25.428866 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f5e73-08a8-4773-a5f0-1abcb17d11f6 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:25.429342 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f5e73-08a8-4773-a5f0-1abcb17d11f6 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:25.429455 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f5e73-08a8-4773-a5f0-1abcb17d11f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:25.448153 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-661f5e73-08a8-4773-a5f0-1abcb17d11f6 None None] MFA Rules not processed for user `698828dd940f46e2b493ba55cd894eac`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:15:25.449376 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-661f5e73-08a8-4773-a5f0-1abcb17d11f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:15:25.458689 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 767/1520] 10.222.0.17 () {58 vars in 1057 bytes} [Tue Jul 12 13:15:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:15:25.466141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8617967-1e26-4513-86e7-26bd24323d76 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:15:25.480247 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8617967-1e26-4513-86e7-26bd24323d76 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:15:25.485209 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f81fb-99e4-47fe-b598-c6e99ecb216e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '698828dd940f46e2b493ba55cd894eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:15:25.485854 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f81fb-99e4-47fe-b598-c6e99ecb216e service placement] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:25.486161 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f81fb-99e4-47fe-b598-c6e99ecb216e service placement] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:25.486443 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f81fb-99e4-47fe-b598-c6e99ecb216e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:25.494947 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f81fb-99e4-47fe-b598-c6e99ecb216e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:15:25.496514 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f81fb-99e4-47fe-b598-c6e99ecb216e service placement] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:15:25.506447 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 754/1521] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:15:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:15:28.044398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a7f29-4fd6-40db-9532-33a3132b1308 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:28.044982 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a7f29-4fd6-40db-9532-33a3132b1308 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:28.044982 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a7f29-4fd6-40db-9532-33a3132b1308 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:28.046405 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 13:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:15:28.051328 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04630fcb-daa8-42b9-a91d-ef885151e0df None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:28.051766 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04630fcb-daa8-42b9-a91d-ef885151e0df None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:28.051937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04630fcb-daa8-42b9-a91d-ef885151e0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:28.070350 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-04630fcb-daa8-42b9-a91d-ef885151e0df None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:15:28.071566 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-04630fcb-daa8-42b9-a91d-ef885151e0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:15:28.080087 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 13:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:15:28.237684 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a7f29-4fd6-40db-9532-33a3132b1308 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:15:28.252396 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a7f29-4fd6-40db-9532-33a3132b1308 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:15:28.257953 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324d432-e35e-49ac-80b9-c74743ef94e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:15:28.258617 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324d432-e35e-49ac-80b9-c74743ef94e3 service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:28.258900 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324d432-e35e-49ac-80b9-c74743ef94e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:28.259172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324d432-e35e-49ac-80b9-c74743ef94e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:28.267163 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324d432-e35e-49ac-80b9-c74743ef94e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:15:28.268736 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324d432-e35e-49ac-80b9-c74743ef94e3 service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:15:28.278032 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 769/1524] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:15:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:15:29.100123 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c2093-77de-4c2a-8a2a-4ab43af6723c None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:29.100773 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c2093-77de-4c2a-8a2a-4ab43af6723c None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:29.100773 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c2093-77de-4c2a-8a2a-4ab43af6723c None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:29.102095 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 13:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:15:29.106853 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8050d-0a3d-4b85-ad7f-ee7e4d9176d9 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:29.107263 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8050d-0a3d-4b85-ad7f-ee7e4d9176d9 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:29.107425 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8050d-0a3d-4b85-ad7f-ee7e4d9176d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:29.126264 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-cde8050d-0a3d-4b85-ad7f-ee7e4d9176d9 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:15:29.127486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-cde8050d-0a3d-4b85-ad7f-ee7e4d9176d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:15:29.135669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 13:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:15:29.285043 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c2093-77de-4c2a-8a2a-4ab43af6723c None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:15:29.300002 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c2093-77de-4c2a-8a2a-4ab43af6723c None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:15:29.305432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e317ba-8099-4c25-a971-ec6f75caa40e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:15:29.306076 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e317ba-8099-4c25-a971-ec6f75caa40e service nova] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:29.306387 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e317ba-8099-4c25-a971-ec6f75caa40e service nova] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:29.306695 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e317ba-8099-4c25-a971-ec6f75caa40e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:29.315658 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e317ba-8099-4c25-a971-ec6f75caa40e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:15:29.317265 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e317ba-8099-4c25-a971-ec6f75caa40e service nova] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:15:29.326882 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 757/1527] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:15:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:15:33.188350 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339637f9-2057-44d6-842c-d1eb2da344c9 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:33.188921 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339637f9-2057-44d6-842c-d1eb2da344c9 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:33.188921 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339637f9-2057-44d6-842c-d1eb2da344c9 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:33.190345 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:15:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:15:33.195591 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130f0c9-2a28-4973-8cb5-6af64d6fd907 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:33.195998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130f0c9-2a28-4973-8cb5-6af64d6fd907 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:33.196163 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130f0c9-2a28-4973-8cb5-6af64d6fd907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:33.214297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-c130f0c9-2a28-4973-8cb5-6af64d6fd907 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:15:33.215571 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-c130f0c9-2a28-4973-8cb5-6af64d6fd907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:15:33.224009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:15:33.301547 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339637f9-2057-44d6-842c-d1eb2da344c9 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:15:33.303285 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-339637f9-2057-44d6-842c-d1eb2da344c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:15:33.336773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:15:33.384696 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339637f9-2057-44d6-842c-d1eb2da344c9 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:15:33.388312 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca7a8a-1c9f-45eb-86f7-b11458bd2ab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:15:33.388968 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca7a8a-1c9f-45eb-86f7-b11458bd2ab6 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:33.389285 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca7a8a-1c9f-45eb-86f7-b11458bd2ab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:33.389567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca7a8a-1c9f-45eb-86f7-b11458bd2ab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:33.398717 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca7a8a-1c9f-45eb-86f7-b11458bd2ab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:15:33.400171 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca7a8a-1c9f-45eb-86f7-b11458bd2ab6 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:15:33.410582 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 772/1530] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:15:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:15:35.448617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b6bf2-b462-4c73-b652-eeb03cff84e4 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:35.449326 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b6bf2-b462-4c73-b652-eeb03cff84e4 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:35.449326 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b6bf2-b462-4c73-b652-eeb03cff84e4 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:35.450648 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:15:35.455910 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31a638-06dc-4129-935b-f0fc72ce6b0a None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:35.456367 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31a638-06dc-4129-935b-f0fc72ce6b0a None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:35.456474 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31a638-06dc-4129-935b-f0fc72ce6b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:35.474782 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-ff31a638-06dc-4129-935b-f0fc72ce6b0a None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:15:35.476000 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-ff31a638-06dc-4129-935b-f0fc72ce6b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:15:35.484537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:15:35.519621 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b6bf2-b462-4c73-b652-eeb03cff84e4 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:15:35.530568 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b6bf2-b462-4c73-b652-eeb03cff84e4 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:15:35.534627 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5d372-3e7f-4bf4-a190-42005016f76a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:15:35.535277 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5d372-3e7f-4bf4-a190-42005016f76a service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:35.535561 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5d372-3e7f-4bf4-a190-42005016f76a service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:35.535844 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5d372-3e7f-4bf4-a190-42005016f76a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:35.545359 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5d372-3e7f-4bf4-a190-42005016f76a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:15:35.547417 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5d372-3e7f-4bf4-a190-42005016f76a service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:15:35.557258 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 760/1533] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:15:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:15:39.152995 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83915549-1456-493d-b383-2ca5567fe681 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:39.153516 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83915549-1456-493d-b383-2ca5567fe681 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:39.153516 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83915549-1456-493d-b383-2ca5567fe681 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:39.154914 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:15:39.160781 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10de4d6-22f2-4584-87ed-af57245f1573 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:39.161229 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10de4d6-22f2-4584-87ed-af57245f1573 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:39.161341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10de4d6-22f2-4584-87ed-af57245f1573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:39.179265 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-f10de4d6-22f2-4584-87ed-af57245f1573 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:15:39.180517 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-f10de4d6-22f2-4584-87ed-af57245f1573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:15:39.188413 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:15:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:15:39.500794 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83915549-1456-493d-b383-2ca5567fe681 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:15:39.502512 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-83915549-1456-493d-b383-2ca5567fe681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:15:39.582435 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83915549-1456-493d-b383-2ca5567fe681 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:15:39.587495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ceb973-4461-4e2f-a52c-945d3a603291 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:15:39.588618 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ceb973-4461-4e2f-a52c-945d3a603291 service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:39.589136 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ceb973-4461-4e2f-a52c-945d3a603291 service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:39.589643 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ceb973-4461-4e2f-a52c-945d3a603291 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:39.602773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ceb973-4461-4e2f-a52c-945d3a603291 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:15:39.604210 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ceb973-4461-4e2f-a52c-945d3a603291 service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:15:39.614270 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 775/1536] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:15:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:15:41.679099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860f30d-9f39-48ae-9e81-b0f811892422 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:41.679099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860f30d-9f39-48ae-9e81-b0f811892422 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:41.679099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860f30d-9f39-48ae-9e81-b0f811892422 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:41.680497 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:15:41.686010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877848c0-ef23-45f9-9d26-eeac769db078 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:41.686532 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877848c0-ef23-45f9-9d26-eeac769db078 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:41.686640 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877848c0-ef23-45f9-9d26-eeac769db078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:41.704488 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-877848c0-ef23-45f9-9d26-eeac769db078 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:15:41.705704 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-877848c0-ef23-45f9-9d26-eeac769db078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:15:41.713914 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:15:42.016613 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860f30d-9f39-48ae-9e81-b0f811892422 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:15:42.018408 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-5860f30d-9f39-48ae-9e81-b0f811892422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:15:42.031363 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860f30d-9f39-48ae-9e81-b0f811892422 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:15:42.034882 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece64935-b27b-4ecf-8a41-eef2bc90e6f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:15:42.035532 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece64935-b27b-4ecf-8a41-eef2bc90e6f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:15:42.035821 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece64935-b27b-4ecf-8a41-eef2bc90e6f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:15:42.036100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece64935-b27b-4ecf-8a41-eef2bc90e6f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:15:42.044992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece64935-b27b-4ecf-8a41-eef2bc90e6f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:15:42.046953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece64935-b27b-4ecf-8a41-eef2bc90e6f6 service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:15:42.056355 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 763/1539] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:15:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:15:51.699497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=63 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:15:52.052197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=37 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:13.324377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1e6b4-86d2-4719-a6c7-993816090f0c None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:13.325575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1e6b4-86d2-4719-a6c7-993816090f0c None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:13.326728 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1e6b4-86d2-4719-a6c7-993816090f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:13.347254 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-7fd1e6b4-86d2-4719-a6c7-993816090f0c None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:13.348497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-7fd1e6b4-86d2-4719-a6c7-993816090f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:13.361040 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 777/1540] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:13.370951 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861939e0-a0b8-4aa9-b289-1060a57370bf None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:13.371593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861939e0-a0b8-4aa9-b289-1060a57370bf None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:13.371726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861939e0-a0b8-4aa9-b289-1060a57370bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:13.403375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-861939e0-a0b8-4aa9-b289-1060a57370bf None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:13.404674 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-861939e0-a0b8-4aa9-b289-1060a57370bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:13.415666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 764/1541] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:13.421586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1e6b4-86d2-4719-a6c7-993816090f0c None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:13.435086 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1e6b4-86d2-4719-a6c7-993816090f0c None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:13.442242 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebd5b6-fbc5-474c-89c3-a7e4f18174b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:13.442951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebd5b6-fbc5-474c-89c3-a7e4f18174b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:13.443253 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebd5b6-fbc5-474c-89c3-a7e4f18174b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:13.443523 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebd5b6-fbc5-474c-89c3-a7e4f18174b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:13.444293 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebd5b6-fbc5-474c-89c3-a7e4f18174b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:17:13.444607 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebd5b6-fbc5-474c-89c3-a7e4f18174b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:13.449424 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebd5b6-fbc5-474c-89c3-a7e4f18174b3 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:13.464657 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 778/1542] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:17:13.474682 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861939e0-a0b8-4aa9-b289-1060a57370bf None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:13.485913 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861939e0-a0b8-4aa9-b289-1060a57370bf None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:13.495230 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcec36-6e57-4461-94bd-1d6661d0f956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:13.495932 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcec36-6e57-4461-94bd-1d6661d0f956 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:13.496221 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcec36-6e57-4461-94bd-1d6661d0f956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:13.496509 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcec36-6e57-4461-94bd-1d6661d0f956 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:13.497222 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbcec36-6e57-4461-94bd-1d6661d0f956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:13.499802 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbcec36-6e57-4461-94bd-1d6661d0f956 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:13.561729 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 765/1543] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:17:13 2022] POST /identity/v3/projects => generated 365 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:13.566269 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebd5b6-fbc5-474c-89c3-a7e4f18174b3 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:13.580692 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebd5b6-fbc5-474c-89c3-a7e4f18174b3 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:13.599402 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdd757-1a5e-4753-8bed-fd63082df55e None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:13.599753 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdd757-1a5e-4753-8bed-fd63082df55e None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:13.599984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdd757-1a5e-4753-8bed-fd63082df55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:13.633544 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-4abdd757-1a5e-4753-8bed-fd63082df55e None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:13.635607 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-4abdd757-1a5e-4753-8bed-fd63082df55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:13.674142 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a175a1-c970-46a4-9038-e7544fbb429d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:13.675076 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a175a1-c970-46a4-9038-e7544fbb429d admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:13.675205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a175a1-c970-46a4-9038-e7544fbb429d admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:13.675490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a175a1-c970-46a4-9038-e7544fbb429d admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:13.676202 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a175a1-c970-46a4-9038-e7544fbb429d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:13.678207 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a175a1-c970-46a4-9038-e7544fbb429d admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:13.717676 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 779/1544] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:17:13 2022] POST /identity/v3/users => generated 283 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:13.719066 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05253c-cc66-473d-8aff-35e826012f8b None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:13.719363 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05253c-cc66-473d-8aff-35e826012f8b None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:13.719647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05253c-cc66-473d-8aff-35e826012f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:13.753864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-0c05253c-cc66-473d-8aff-35e826012f8b None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:13.754641 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 766/1545] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:17:13.756004 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-0c05253c-cc66-473d-8aff-35e826012f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:13.756848 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72984e-8304-4ca9-9234-ea7a334c9081 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:13.757608 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72984e-8304-4ca9-9234-ea7a334c9081 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:13.758103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72984e-8304-4ca9-9234-ea7a334c9081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:13.771020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 780/1546] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:13.773069 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6bb13-64f1-4d86-a008-480581da733b None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:13.773366 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6bb13-64f1-4d86-a008-480581da733b None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:13.773647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6bb13-64f1-4d86-a008-480581da733b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:13.781577 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-4c72984e-8304-4ca9-9234-ea7a334c9081 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:13.783189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-4c72984e-8304-4ca9-9234-ea7a334c9081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:13.792270 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 767/1547] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:13.798304 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-ada6bb13-64f1-4d86-a008-480581da733b None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:13.798304 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-ada6bb13-64f1-4d86-a008-480581da733b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:13.800399 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3e672-3b90-4a45-a368-9ef8f33eb9ba None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:13.800944 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3e672-3b90-4a45-a368-9ef8f33eb9ba None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:13.801445 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3e672-3b90-4a45-a368-9ef8f33eb9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:13.804771 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 781/1548] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:13.805393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6bb13-64f1-4d86-a008-480581da733b None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:13.816162 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6bb13-64f1-4d86-a008-480581da733b None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:13.820937 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db2088-c86b-43bb-9a0c-acf66dd8d473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:13.821754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db2088-c86b-43bb-9a0c-acf66dd8d473 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:13.822043 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db2088-c86b-43bb-9a0c-acf66dd8d473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:13.822353 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db2088-c86b-43bb-9a0c-acf66dd8d473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:13.823593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db2088-c86b-43bb-9a0c-acf66dd8d473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:13.825528 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db2088-c86b-43bb-9a0c-acf66dd8d473 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:13.832149 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-f7e3e672-3b90-4a45-a368-9ef8f33eb9ba None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:13.833371 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-f7e3e672-3b90-4a45-a368-9ef8f33eb9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:13.840561 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 782/1549] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:13.842418 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 768/1550] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:13.842585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c767a-64bc-450c-96a8-643cc8c4859f None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:13.842771 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c767a-64bc-450c-96a8-643cc8c4859f None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:13.843052 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c767a-64bc-450c-96a8-643cc8c4859f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:13.844565 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ec796-6d1a-425f-9ff2-134fb4fe5027 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:13.845057 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ec796-6d1a-425f-9ff2-134fb4fe5027 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:13.845524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ec796-6d1a-425f-9ff2-134fb4fe5027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:13.865836 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-ea2ec796-6d1a-425f-9ff2-134fb4fe5027 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:13.866043 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-638c767a-64bc-450c-96a8-643cc8c4859f None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:13.867075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-ea2ec796-6d1a-425f-9ff2-134fb4fe5027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:13.867201 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-638c767a-64bc-450c-96a8-643cc8c4859f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:13.875794 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 783/1551] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:13.875943 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 769/1552] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:13.877943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab9b6a-2970-4372-b853-171970d9fa53 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:13.878077 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7be35-9b6f-492f-b310-4e168d08abd3 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:13.878219 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab9b6a-2970-4372-b853-171970d9fa53 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:13.878322 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7be35-9b6f-492f-b310-4e168d08abd3 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:13.878813 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab9b6a-2970-4372-b853-171970d9fa53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:13.878932 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7be35-9b6f-492f-b310-4e168d08abd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:13.894985 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-27ab9b6a-2970-4372-b853-171970d9fa53 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:13.895366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-8bb7be35-9b6f-492f-b310-4e168d08abd3 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:13.896197 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-27ab9b6a-2970-4372-b853-171970d9fa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:13.896526 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-8bb7be35-9b6f-492f-b310-4e168d08abd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:13.908208 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 770/1554] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:13.908378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 784/1554] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:13.908378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab9b6a-2970-4372-b853-171970d9fa53 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:13.908591 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde13a4-5c21-4c0a-9f64-05787134524c None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:13.908591 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde13a4-5c21-4c0a-9f64-05787134524c None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:13.908591 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde13a4-5c21-4c0a-9f64-05787134524c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:13.917485 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab9b6a-2970-4372-b853-171970d9fa53 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:13.922962 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da060a-eea4-40eb-a01d-036cea7811d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:13.923625 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da060a-eea4-40eb-a01d-036cea7811d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:13.924058 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da060a-eea4-40eb-a01d-036cea7811d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:13.924353 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da060a-eea4-40eb-a01d-036cea7811d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:13.925081 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da060a-eea4-40eb-a01d-036cea7811d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:13.925266 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-2cde13a4-5c21-4c0a-9f64-05787134524c None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:13.926489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-2cde13a4-5c21-4c0a-9f64-05787134524c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:13.926759 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da060a-eea4-40eb-a01d-036cea7811d5 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:13.935430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 771/1555] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:13.936507 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74e824-e714-4603-af7e-7a3721e5d90b None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:13.936803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74e824-e714-4603-af7e-7a3721e5d90b None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:13.937083 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74e824-e714-4603-af7e-7a3721e5d90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:13.937283 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 785/1556] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:13.938539 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a75f7e-a83d-4982-9a1a-153b7caf6656 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:13.938829 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a75f7e-a83d-4982-9a1a-153b7caf6656 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:13.939108 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a75f7e-a83d-4982-9a1a-153b7caf6656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:13.956496 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-87a75f7e-a83d-4982-9a1a-153b7caf6656 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:13.957720 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-87a75f7e-a83d-4982-9a1a-153b7caf6656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:13.959000 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-0f74e824-e714-4603-af7e-7a3721e5d90b None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:13.960207 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-0f74e824-e714-4603-af7e-7a3721e5d90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:13.965808 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 786/1557] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:13.967156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a75f7e-a83d-4982-9a1a-153b7caf6656 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:13.973378 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 772/1558] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:13.978407 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74e824-e714-4603-af7e-7a3721e5d90b None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:13.978524 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a75f7e-a83d-4982-9a1a-153b7caf6656 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:13.982976 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1802b59-133f-46f8-84a5-19a41af6b4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:13.983650 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1802b59-133f-46f8-84a5-19a41af6b4ee admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:13.983939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1802b59-133f-46f8-84a5-19a41af6b4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:13.984219 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1802b59-133f-46f8-84a5-19a41af6b4ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:13.984909 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74e824-e714-4603-af7e-7a3721e5d90b None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:13.985030 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1802b59-133f-46f8-84a5-19a41af6b4ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:17:13.985250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1802b59-133f-46f8-84a5-19a41af6b4ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:13.986882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1802b59-133f-46f8-84a5-19a41af6b4ee admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:13.989416 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604197ab-d104-4543-93cf-e81972755fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:13.990076 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604197ab-d104-4543-93cf-e81972755fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:13.990393 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604197ab-d104-4543-93cf-e81972755fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:13.990667 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604197ab-d104-4543-93cf-e81972755fd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:13.991383 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604197ab-d104-4543-93cf-e81972755fd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:17:13.991698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604197ab-d104-4543-93cf-e81972755fd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:13.992706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: WARNING py.warnings [None req-604197ab-d104-4543-93cf-e81972755fd8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:17:13.992706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: warnings.warn(msg) Jul 12 13:17:13.992706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: Jul 12 13:17:13.993578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604197ab-d104-4543-93cf-e81972755fd8 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:14.005654 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 787/1559] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:17:14.005654 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1802b59-133f-46f8-84a5-19a41af6b4ee admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:14.009573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1802b59-133f-46f8-84a5-19a41af6b4ee admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:14.011772 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 773/1560] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:17:14.012520 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604197ab-d104-4543-93cf-e81972755fd8 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:14.014283 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d786dd4-594d-473d-9871-865913a836e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:14.014941 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d786dd4-594d-473d-9871-865913a836e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:14.015229 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d786dd4-594d-473d-9871-865913a836e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:14.015508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d786dd4-594d-473d-9871-865913a836e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:14.016227 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d786dd4-594d-473d-9871-865913a836e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:17:14.016538 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d786dd4-594d-473d-9871-865913a836e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:14.018157 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d786dd4-594d-473d-9871-865913a836e0 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:14.023943 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604197ab-d104-4543-93cf-e81972755fd8 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:14.029613 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09da9e-8b15-4b46-9b53-b57dc073e751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:14.030371 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09da9e-8b15-4b46-9b53-b57dc073e751 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:14.030656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09da9e-8b15-4b46-9b53-b57dc073e751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:14.030977 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09da9e-8b15-4b46-9b53-b57dc073e751 admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:14.031824 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09da9e-8b15-4b46-9b53-b57dc073e751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:17:14.032209 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09da9e-8b15-4b46-9b53-b57dc073e751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:14.039783 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 788/1561] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:17:14.039783 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d786dd4-594d-473d-9871-865913a836e0 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:14.040047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09da9e-8b15-4b46-9b53-b57dc073e751 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:14.050523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 774/1562] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:17:14.050982 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d786dd4-594d-473d-9871-865913a836e0 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:14.052662 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b442d85-2fcb-4d13-803f-12f5c219da85 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:14.053136 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b442d85-2fcb-4d13-803f-12f5c219da85 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:14.053512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b442d85-2fcb-4d13-803f-12f5c219da85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:14.055934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d6fd5-377a-40f7-a633-16ee6dc857cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:14.056836 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d6fd5-377a-40f7-a633-16ee6dc857cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:14.057146 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d6fd5-377a-40f7-a633-16ee6dc857cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:14.057395 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d6fd5-377a-40f7-a633-16ee6dc857cf admin admin] PATH_INFO: `/v3/projects/4fd1219cf7924a4d81a56e05f2011bfa/users/7bde195b29d5412d932928a13f8f701d/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:14.072614 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-8b442d85-2fcb-4d13-803f-12f5c219da85 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:14.073535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d6fd5-377a-40f7-a633-16ee6dc857cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd1219cf7924a4d81a56e05f2011bfa, user_id=7bde195b29d5412d932928a13f8f701d, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:14.073883 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-8b442d85-2fcb-4d13-803f-12f5c219da85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:14.074623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: WARNING py.warnings [None req-d26d6fd5-377a-40f7-a633-16ee6dc857cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:17:14.074623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: warnings.warn(msg) Jul 12 13:17:14.074623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: Jul 12 13:17:14.077209 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d6fd5-377a-40f7-a633-16ee6dc857cf admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:14.083923 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 775/1563] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:14.085266 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b442d85-2fcb-4d13-803f-12f5c219da85 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:14.092599 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 789/1564] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:14 2022] PUT /identity/v3/projects/4fd1219cf7924a4d81a56e05f2011bfa/users/7bde195b29d5412d932928a13f8f701d/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:14.093991 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca456ac-0377-4b3a-a8ad-6d74a64062d4 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:14.094314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca456ac-0377-4b3a-a8ad-6d74a64062d4 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:14.094754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca456ac-0377-4b3a-a8ad-6d74a64062d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:14.096585 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b442d85-2fcb-4d13-803f-12f5c219da85 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:14.117205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-8ca456ac-0377-4b3a-a8ad-6d74a64062d4 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:14.118462 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-8ca456ac-0377-4b3a-a8ad-6d74a64062d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:14.138774 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:14.147834 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:14.159486 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c876aa-ab9e-4db3-9295-8d7f6ed79c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:14.160168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c876aa-ab9e-4db3-9295-8d7f6ed79c2b admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:14.160455 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c876aa-ab9e-4db3-9295-8d7f6ed79c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:14.160754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c876aa-ab9e-4db3-9295-8d7f6ed79c2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:14.161468 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c876aa-ab9e-4db3-9295-8d7f6ed79c2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:17:14.161777 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c876aa-ab9e-4db3-9295-8d7f6ed79c2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:14.163470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c876aa-ab9e-4db3-9295-8d7f6ed79c2b admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:14.184726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 776/1565] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:17:14.184726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c876aa-ab9e-4db3-9295-8d7f6ed79c2b admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:14.193041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 790/1566] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:14.193889 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca456ac-0377-4b3a-a8ad-6d74a64062d4 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:14.195791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c876aa-ab9e-4db3-9295-8d7f6ed79c2b admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:14.201241 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3337a-680f-4707-87dc-188c43cf9dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:14.202332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3337a-680f-4707-87dc-188c43cf9dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:14.202622 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3337a-680f-4707-87dc-188c43cf9dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:14.202902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3337a-680f-4707-87dc-188c43cf9dd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:14.203636 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c3337a-680f-4707-87dc-188c43cf9dd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:14.203751 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca456ac-0377-4b3a-a8ad-6d74a64062d4 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:14.205669 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c3337a-680f-4707-87dc-188c43cf9dd1 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:14.208344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5068a-cfa4-4caa-b535-7ba4993bd704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:14.209011 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5068a-cfa4-4caa-b535-7ba4993bd704 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:14.209296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5068a-cfa4-4caa-b535-7ba4993bd704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:14.209596 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5068a-cfa4-4caa-b535-7ba4993bd704 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:14.210328 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5068a-cfa4-4caa-b535-7ba4993bd704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:14.211372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: WARNING py.warnings [None req-4ba5068a-cfa4-4caa-b535-7ba4993bd704 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:17:14.211372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: warnings.warn(msg) Jul 12 13:17:14.211372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: Jul 12 13:17:14.212712 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5068a-cfa4-4caa-b535-7ba4993bd704 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:14.239294 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 777/1567] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:17:14 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:14.239294 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3337a-680f-4707-87dc-188c43cf9dd1 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:14.241224 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 791/1568] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:17:14 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:14.244805 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5068a-cfa4-4caa-b535-7ba4993bd704 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:14.308308 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3337a-680f-4707-87dc-188c43cf9dd1 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:14.313266 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5068a-cfa4-4caa-b535-7ba4993bd704 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:14.314097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91badc1-f1a6-46c9-9dbb-12f91edee29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:14.314835 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91badc1-f1a6-46c9-9dbb-12f91edee29a admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:14.315116 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91badc1-f1a6-46c9-9dbb-12f91edee29a admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:14.315403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91badc1-f1a6-46c9-9dbb-12f91edee29a admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:14.316099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91badc1-f1a6-46c9-9dbb-12f91edee29a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:14.318051 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91badc1-f1a6-46c9-9dbb-12f91edee29a admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:14.318318 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c3c14-348c-4336-be02-28fa45e3f331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:14.319024 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c3c14-348c-4336-be02-28fa45e3f331 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:14.319317 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c3c14-348c-4336-be02-28fa45e3f331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:14.319597 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c3c14-348c-4336-be02-28fa45e3f331 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:14.320284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c3c14-348c-4336-be02-28fa45e3f331 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:14.322243 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c3c14-348c-4336-be02-28fa45e3f331 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:14.345316 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 778/1569] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:17:14 2022] POST /identity/v3/projects => generated 391 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:14.346216 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91badc1-f1a6-46c9-9dbb-12f91edee29a admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:14.352259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 792/1570] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:17:14 2022] POST /identity/v3/projects => generated 403 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:14.353563 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce508d-2238-4368-9068-7776f3968ceb None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:14.353861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce508d-2238-4368-9068-7776f3968ceb None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:14.354168 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce508d-2238-4368-9068-7776f3968ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:14.385330 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-f4ce508d-2238-4368-9068-7776f3968ceb None None] MFA Rules not processed for user `7bde195b29d5412d932928a13f8f701d`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:14.386610 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-f4ce508d-2238-4368-9068-7776f3968ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:14.415254 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91badc1-f1a6-46c9-9dbb-12f91edee29a admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:14.452441 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 793/1571] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:14.453346 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce508d-2238-4368-9068-7776f3968ceb None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:14.469921 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:14.474057 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:14.480628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13df1e3-6905-4891-8c5f-3d6e4528162e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:14.481553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13df1e3-6905-4891-8c5f-3d6e4528162e admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:14.481846 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13df1e3-6905-4891-8c5f-3d6e4528162e admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:14.482195 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13df1e3-6905-4891-8c5f-3d6e4528162e admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:14.483759 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13df1e3-6905-4891-8c5f-3d6e4528162e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:17:14.483759 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13df1e3-6905-4891-8c5f-3d6e4528162e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:14.485500 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13df1e3-6905-4891-8c5f-3d6e4528162e admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:14.497532 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 779/1572] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:17:14.498426 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13df1e3-6905-4891-8c5f-3d6e4528162e admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:14.508551 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13df1e3-6905-4891-8c5f-3d6e4528162e admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:14.513378 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe4b0c-bc42-4487-91b6-9b38d09cf2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:14.514023 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe4b0c-bc42-4487-91b6-9b38d09cf2ba admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:14.514405 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe4b0c-bc42-4487-91b6-9b38d09cf2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:14.514717 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe4b0c-bc42-4487-91b6-9b38d09cf2ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:14.515520 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe4b0c-bc42-4487-91b6-9b38d09cf2ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:17:14.515839 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe4b0c-bc42-4487-91b6-9b38d09cf2ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:14.517558 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe4b0c-bc42-4487-91b6-9b38d09cf2ba admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:14.525421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce508d-2238-4368-9068-7776f3968ceb None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:14.530867 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e206962-cfa0-4754-8ce7-8d7b765aec3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:14.531541 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e206962-cfa0-4754-8ce7-8d7b765aec3d admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:14.531680 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 780/1573] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:17:14.531840 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e206962-cfa0-4754-8ce7-8d7b765aec3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:14.532103 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e206962-cfa0-4754-8ce7-8d7b765aec3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:14.532534 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe4b0c-bc42-4487-91b6-9b38d09cf2ba admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:14.532804 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e206962-cfa0-4754-8ce7-8d7b765aec3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:14.534771 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e206962-cfa0-4754-8ce7-8d7b765aec3d admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:14.550015 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe4b0c-bc42-4487-91b6-9b38d09cf2ba admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:14.555702 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2fd77-4bc9-47e3-b62f-e2e1b9389125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:14.556422 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2fd77-4bc9-47e3-b62f-e2e1b9389125 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:14.556650 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2fd77-4bc9-47e3-b62f-e2e1b9389125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:14.556931 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2fd77-4bc9-47e3-b62f-e2e1b9389125 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:14.557672 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2fd77-4bc9-47e3-b62f-e2e1b9389125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:14.558727 dv-cinder-797608-55-smb devstack@keystone.service[80627]: WARNING py.warnings [None req-edb2fd77-4bc9-47e3-b62f-e2e1b9389125 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:17:14.558727 dv-cinder-797608-55-smb devstack@keystone.service[80627]: warnings.warn(msg) Jul 12 13:17:14.558727 dv-cinder-797608-55-smb devstack@keystone.service[80627]: Jul 12 13:17:14.559978 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2fd77-4bc9-47e3-b62f-e2e1b9389125 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:14.568020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 794/1574] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:17:14 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:14.568020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e206962-cfa0-4754-8ce7-8d7b765aec3d admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:14.584072 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 781/1575] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:17:14 2022] POST /identity/v3/users => generated 293 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:14.585128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2fd77-4bc9-47e3-b62f-e2e1b9389125 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:14.597832 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2fd77-4bc9-47e3-b62f-e2e1b9389125 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:14.649930 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e206962-cfa0-4754-8ce7-8d7b765aec3d admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:14.656177 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f70299-7ab3-47e7-a973-d69f31b60d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:14.656871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f70299-7ab3-47e7-a973-d69f31b60d74 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:14.657157 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f70299-7ab3-47e7-a973-d69f31b60d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:14.657443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f70299-7ab3-47e7-a973-d69f31b60d74 admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:14.658246 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f70299-7ab3-47e7-a973-d69f31b60d74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:14.660204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f70299-7ab3-47e7-a973-d69f31b60d74 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:14.660397 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f3332-2f96-4c41-9766-a268cee6286e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:14.661030 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f3332-2f96-4c41-9766-a268cee6286e admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:14.661446 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f3332-2f96-4c41-9766-a268cee6286e admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:14.661733 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f3332-2f96-4c41-9766-a268cee6286e admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:14.662454 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f3332-2f96-4c41-9766-a268cee6286e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:14.664397 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f3332-2f96-4c41-9766-a268cee6286e admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:14.689568 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 782/1576] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:17:14 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:14.689568 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f3332-2f96-4c41-9766-a268cee6286e admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:14.692443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 795/1577] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:17:14 2022] POST /identity/v3/users => generated 282 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:14.693462 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f70299-7ab3-47e7-a973-d69f31b60d74 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:14.697956 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f3332-2f96-4c41-9766-a268cee6286e admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:14.702641 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311228d1-29ea-4927-99a5-ededca767ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:14.703307 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311228d1-29ea-4927-99a5-ededca767ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:14.703590 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311228d1-29ea-4927-99a5-ededca767ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:14.703867 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311228d1-29ea-4927-99a5-ededca767ac2 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:14.704551 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311228d1-29ea-4927-99a5-ededca767ac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:14.706481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311228d1-29ea-4927-99a5-ededca767ac2 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:14.728326 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 783/1578] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:17:14 2022] POST /identity/v3/users => generated 302 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:14.729382 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311228d1-29ea-4927-99a5-ededca767ac2 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:14.742384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311228d1-29ea-4927-99a5-ededca767ac2 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:14.747221 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264ad88-42eb-45ad-8e5f-fc3a24851c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:14.748015 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264ad88-42eb-45ad-8e5f-fc3a24851c11 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:14.748304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264ad88-42eb-45ad-8e5f-fc3a24851c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:14.748581 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264ad88-42eb-45ad-8e5f-fc3a24851c11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:14.749300 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264ad88-42eb-45ad-8e5f-fc3a24851c11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:14.751432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264ad88-42eb-45ad-8e5f-fc3a24851c11 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:14.752730 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f70299-7ab3-47e7-a973-d69f31b60d74 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:14.756376 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727ac33-3450-4ace-b5cf-dc0843c95e19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:14.757292 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727ac33-3450-4ace-b5cf-dc0843c95e19 service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:14.757572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727ac33-3450-4ace-b5cf-dc0843c95e19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:14.757853 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727ac33-3450-4ace-b5cf-dc0843c95e19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:14.783062 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 784/1579] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:17:14 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:14.783062 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264ad88-42eb-45ad-8e5f-fc3a24851c11 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:14.813084 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:14.827609 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727ac33-3450-4ace-b5cf-dc0843c95e19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:14.829064 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727ac33-3450-4ace-b5cf-dc0843c95e19 service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:14.838874 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 796/1580] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:14.839665 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727ac33-3450-4ace-b5cf-dc0843c95e19 service cinder] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:14.851334 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264ad88-42eb-45ad-8e5f-fc3a24851c11 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:14.853051 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727ac33-3450-4ace-b5cf-dc0843c95e19 service cinder] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:14.857310 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9f50d-2e43-4ee0-8af8-e16900536d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:14.858274 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9f50d-2e43-4ee0-8af8-e16900536d53 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:14.858807 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9f50d-2e43-4ee0-8af8-e16900536d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:14.859094 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b7603-6a68-4109-a0af-b2204b2a33b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:14.859440 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9f50d-2e43-4ee0-8af8-e16900536d53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:14.859779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b7603-6a68-4109-a0af-b2204b2a33b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:14.860066 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b7603-6a68-4109-a0af-b2204b2a33b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:14.860378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b7603-6a68-4109-a0af-b2204b2a33b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:14.860810 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff9f50d-2e43-4ee0-8af8-e16900536d53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:14.861073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86b7603-6a68-4109-a0af-b2204b2a33b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:14.863048 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86b7603-6a68-4109-a0af-b2204b2a33b4 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:14.863512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff9f50d-2e43-4ee0-8af8-e16900536d53 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:14.881106 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:14.885737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 797/1581] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:17:14 2022] POST /identity/v3/users => generated 288 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:14.886604 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b7603-6a68-4109-a0af-b2204b2a33b4 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:14.898225 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b7603-6a68-4109-a0af-b2204b2a33b4 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:14.901578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 785/1582] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:17:14 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:14.902786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9f50d-2e43-4ee0-8af8-e16900536d53 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:14.907974 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f10e3-5325-48a6-874d-d4a799f6b386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:14.911233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f10e3-5325-48a6-874d-d4a799f6b386 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:14.911233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f10e3-5325-48a6-874d-d4a799f6b386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:14.911233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f10e3-5325-48a6-874d-d4a799f6b386 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:14.911233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f10e3-5325-48a6-874d-d4a799f6b386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:14.912000 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f10e3-5325-48a6-874d-d4a799f6b386 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:14.923971 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 798/1583] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:14.924648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f10e3-5325-48a6-874d-d4a799f6b386 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:14.935288 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f10e3-5325-48a6-874d-d4a799f6b386 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:14.982889 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9f50d-2e43-4ee0-8af8-e16900536d53 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:14.989702 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7c3dd-8566-43c8-af0d-3461ec9587fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:14.990619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7c3dd-8566-43c8-af0d-3461ec9587fc admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:14.991292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7c3dd-8566-43c8-af0d-3461ec9587fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:14.991599 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7c3dd-8566-43c8-af0d-3461ec9587fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:14.992352 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7c3dd-8566-43c8-af0d-3461ec9587fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:14.994634 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7c3dd-8566-43c8-af0d-3461ec9587fc admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:15.008494 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867b39d-b190-4275-988f-869fdfc356da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:15.009081 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 786/1584] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:15.012382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867b39d-b190-4275-988f-869fdfc356da admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.012382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867b39d-b190-4275-988f-869fdfc356da admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.012382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867b39d-b190-4275-988f-869fdfc356da admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.012382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867b39d-b190-4275-988f-869fdfc356da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:15.012795 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7c3dd-8566-43c8-af0d-3461ec9587fc admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:15.012889 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867b39d-b190-4275-988f-869fdfc356da admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:15.025705 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7c3dd-8566-43c8-af0d-3461ec9587fc admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:15.025934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 799/1585] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:15.025934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867b39d-b190-4275-988f-869fdfc356da admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:15.035045 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24237d16-3896-41b6-8ad3-2bd1871495b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:15.035740 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24237d16-3896-41b6-8ad3-2bd1871495b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.036055 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24237d16-3896-41b6-8ad3-2bd1871495b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.036337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24237d16-3896-41b6-8ad3-2bd1871495b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.036635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867b39d-b190-4275-988f-869fdfc356da admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:15.037067 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24237d16-3896-41b6-8ad3-2bd1871495b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:15.038714 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24237d16-3896-41b6-8ad3-2bd1871495b5 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:15.041589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b5caf-171a-4c35-9651-6f48fc16ab0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:15.042323 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b5caf-171a-4c35-9651-6f48fc16ab0c admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.042648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b5caf-171a-4c35-9651-6f48fc16ab0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.042934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b5caf-171a-4c35-9651-6f48fc16ab0c admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.043638 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b5caf-171a-4c35-9651-6f48fc16ab0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:15.045661 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b5caf-171a-4c35-9651-6f48fc16ab0c admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:15.051329 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 787/1586] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:15.052306 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24237d16-3896-41b6-8ad3-2bd1871495b5 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:15.063242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24237d16-3896-41b6-8ad3-2bd1871495b5 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:15.069085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 800/1587] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:17:15 2022] POST /identity/v3/users => generated 287 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:15.069085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b5caf-171a-4c35-9651-6f48fc16ab0c admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:15.071298 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb87ec-c074-43a9-89f6-03c8be345c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:15.072080 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb87ec-c074-43a9-89f6-03c8be345c9b admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.072431 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb87ec-c074-43a9-89f6-03c8be345c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.072788 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb87ec-c074-43a9-89f6-03c8be345c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.073585 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb87ec-c074-43a9-89f6-03c8be345c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:15.075303 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb87ec-c074-43a9-89f6-03c8be345c9b admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:15.081019 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b5caf-171a-4c35-9651-6f48fc16ab0c admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:15.086784 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b15958-4662-4d93-8f4f-ed39487e5bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:15.087466 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b15958-4662-4d93-8f4f-ed39487e5bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.087757 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b15958-4662-4d93-8f4f-ed39487e5bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.088040 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b15958-4662-4d93-8f4f-ed39487e5bb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.088742 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b15958-4662-4d93-8f4f-ed39487e5bb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:15.094501 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 788/1588] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:15.094753 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b15958-4662-4d93-8f4f-ed39487e5bb6 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:15.094869 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb87ec-c074-43a9-89f6-03c8be345c9b admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:15.104951 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb87ec-c074-43a9-89f6-03c8be345c9b admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:15.110909 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f8e07-12fa-4362-a695-db495203feab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:15.111951 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f8e07-12fa-4362-a695-db495203feab admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.112426 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f8e07-12fa-4362-a695-db495203feab admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.112902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f8e07-12fa-4362-a695-db495203feab admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.113794 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f8e07-12fa-4362-a695-db495203feab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:15.116149 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f8e07-12fa-4362-a695-db495203feab admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:15.118179 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 801/1589] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:17:15 2022] POST /identity/v3/users => generated 290 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:15.119232 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b15958-4662-4d93-8f4f-ed39487e5bb6 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:15.129178 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 789/1590] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:15.129988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f8e07-12fa-4362-a695-db495203feab admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:15.137940 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b15958-4662-4d93-8f4f-ed39487e5bb6 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:15.140939 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f8e07-12fa-4362-a695-db495203feab admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:15.143427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1244f45-e7e1-4771-ba3c-5e154f01b102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:15.144116 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1244f45-e7e1-4771-ba3c-5e154f01b102 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.144413 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1244f45-e7e1-4771-ba3c-5e154f01b102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.144713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1244f45-e7e1-4771-ba3c-5e154f01b102 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.145552 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1244f45-e7e1-4771-ba3c-5e154f01b102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:15.146432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea93d7f-e1a3-4fe6-be58-21f91418df9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:15.147170 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea93d7f-e1a3-4fe6-be58-21f91418df9e admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.147510 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1244f45-e7e1-4771-ba3c-5e154f01b102 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:15.147636 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea93d7f-e1a3-4fe6-be58-21f91418df9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.147902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea93d7f-e1a3-4fe6-be58-21f91418df9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.148718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea93d7f-e1a3-4fe6-be58-21f91418df9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:15.150657 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea93d7f-e1a3-4fe6-be58-21f91418df9e admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:15.161217 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 790/1591] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:15.166800 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 802/1592] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:15.167032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea93d7f-e1a3-4fe6-be58-21f91418df9e admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:15.167296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1244f45-e7e1-4771-ba3c-5e154f01b102 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:15.174936 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea93d7f-e1a3-4fe6-be58-21f91418df9e admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:15.176240 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1244f45-e7e1-4771-ba3c-5e154f01b102 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:15.180281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d1f62-ede1-4697-afdd-cd3770732910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:15.181362 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d1f62-ede1-4697-afdd-cd3770732910 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.181851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d1f62-ede1-4697-afdd-cd3770732910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.182290 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d1f62-ede1-4697-afdd-cd3770732910 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.182453 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24011c3-ed93-4997-8560-d3c5bcddb334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:15.183380 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d1f62-ede1-4697-afdd-cd3770732910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:15.183542 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24011c3-ed93-4997-8560-d3c5bcddb334 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.183801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24011c3-ed93-4997-8560-d3c5bcddb334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.184139 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24011c3-ed93-4997-8560-d3c5bcddb334 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.184914 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24011c3-ed93-4997-8560-d3c5bcddb334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:15.187578 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24011c3-ed93-4997-8560-d3c5bcddb334 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:15.188864 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d1f62-ede1-4697-afdd-cd3770732910 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:15.202148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 803/1593] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:15.203153 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 791/1594] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:15.203979 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d1f62-ede1-4697-afdd-cd3770732910 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:15.206444 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24011c3-ed93-4997-8560-d3c5bcddb334 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:15.215018 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d1f62-ede1-4697-afdd-cd3770732910 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:15.217211 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24011c3-ed93-4997-8560-d3c5bcddb334 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:15.221040 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36939288-3a15-4a15-bf4c-0b673190afd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:15.221786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36939288-3a15-4a15-bf4c-0b673190afd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.222197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36939288-3a15-4a15-bf4c-0b673190afd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.222401 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138d728-50fe-4673-9f6a-f8a159916b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:15.222612 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36939288-3a15-4a15-bf4c-0b673190afd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.222960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138d728-50fe-4673-9f6a-f8a159916b31 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.223248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138d728-50fe-4673-9f6a-f8a159916b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.223497 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36939288-3a15-4a15-bf4c-0b673190afd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:15.223649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138d728-50fe-4673-9f6a-f8a159916b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.224248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138d728-50fe-4673-9f6a-f8a159916b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:15.225309 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36939288-3a15-4a15-bf4c-0b673190afd9 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:15.225849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138d728-50fe-4673-9f6a-f8a159916b31 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:15.239011 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 804/1595] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:15.240521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 792/1596] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:15.241615 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36939288-3a15-4a15-bf4c-0b673190afd9 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:15.243187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138d728-50fe-4673-9f6a-f8a159916b31 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:15.253299 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36939288-3a15-4a15-bf4c-0b673190afd9 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:15.254323 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138d728-50fe-4673-9f6a-f8a159916b31 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:15.258697 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49964ba-6870-4575-b815-ef35cdc6dc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:15.259632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49964ba-6870-4575-b815-ef35cdc6dc66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.259769 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea3c33-7898-4525-9366-570fdae7aebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:15.259915 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49964ba-6870-4575-b815-ef35cdc6dc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.260194 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49964ba-6870-4575-b815-ef35cdc6dc66 admin admin] PATH_INFO: `/v3/projects/da911a39efda4362bdd6ea8160801116/users/432336b6eaef49c6bd3918c8f8b9a6da/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.261037 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea3c33-7898-4525-9366-570fdae7aebb admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.261331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea3c33-7898-4525-9366-570fdae7aebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.261613 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea3c33-7898-4525-9366-570fdae7aebb admin admin] PATH_INFO: `/v3/projects/f5db7c603326441e86a4187570bc5be6/users/f558b5ee5b5e43f4894d350fc73df0f8/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.277198 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49964ba-6870-4575-b815-ef35cdc6dc66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da911a39efda4362bdd6ea8160801116, user_id=432336b6eaef49c6bd3918c8f8b9a6da, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:15.280617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49964ba-6870-4575-b815-ef35cdc6dc66 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:15.283015 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea3c33-7898-4525-9366-570fdae7aebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5db7c603326441e86a4187570bc5be6, user_id=f558b5ee5b5e43f4894d350fc73df0f8, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:15.285849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea3c33-7898-4525-9366-570fdae7aebb admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:15.297188 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 793/1597] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:15 2022] PUT /identity/v3/projects/da911a39efda4362bdd6ea8160801116/users/432336b6eaef49c6bd3918c8f8b9a6da/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:15.297960 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49964ba-6870-4575-b815-ef35cdc6dc66 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:15.310583 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 805/1598] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:15 2022] PUT /identity/v3/projects/f5db7c603326441e86a4187570bc5be6/users/f558b5ee5b5e43f4894d350fc73df0f8/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:15.315582 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea3c33-7898-4525-9366-570fdae7aebb admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:15.347530 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:15.387313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49964ba-6870-4575-b815-ef35cdc6dc66 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:15.394361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6acdf-ae95-437b-9c5d-f928f8a6ed8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:15.394818 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea3c33-7898-4525-9366-570fdae7aebb admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:15.395425 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6acdf-ae95-437b-9c5d-f928f8a6ed8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.395744 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6acdf-ae95-437b-9c5d-f928f8a6ed8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.396043 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6acdf-ae95-437b-9c5d-f928f8a6ed8b admin admin] PATH_INFO: `/v3/projects/36bba9bc3fb049bfa8a42fca5e8a74c6/users/155dfbdcace94d9d93d8d4758fbcb372/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.398720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:15.402518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f3ff0-1d9b-4f30-bbc2-a2b2c3cdcf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:15.403255 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f3ff0-1d9b-4f30-bbc2-a2b2c3cdcf85 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.403573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f3ff0-1d9b-4f30-bbc2-a2b2c3cdcf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.403882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f3ff0-1d9b-4f30-bbc2-a2b2c3cdcf85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.405395 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f3ff0-1d9b-4f30-bbc2-a2b2c3cdcf85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:15.407198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f3ff0-1d9b-4f30-bbc2-a2b2c3cdcf85 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:15.416691 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6acdf-ae95-437b-9c5d-f928f8a6ed8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=36bba9bc3fb049bfa8a42fca5e8a74c6, user_id=155dfbdcace94d9d93d8d4758fbcb372, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:15.420550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6acdf-ae95-437b-9c5d-f928f8a6ed8b admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:15.429762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 806/1599] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:15.430662 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f3ff0-1d9b-4f30-bbc2-a2b2c3cdcf85 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:15.442001 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 794/1600] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:15 2022] PUT /identity/v3/projects/36bba9bc3fb049bfa8a42fca5e8a74c6/users/155dfbdcace94d9d93d8d4758fbcb372/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:15.443864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f3ff0-1d9b-4f30-bbc2-a2b2c3cdcf85 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:15.446879 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6acdf-ae95-437b-9c5d-f928f8a6ed8b admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:15.520299 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df354e74-5ca3-40ac-8924-37611066d96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:15.521374 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df354e74-5ca3-40ac-8924-37611066d96c admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.521799 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df354e74-5ca3-40ac-8924-37611066d96c admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.522147 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df354e74-5ca3-40ac-8924-37611066d96c admin admin] PATH_INFO: `/v3/projects/ba1ac451b19a4daaaa87204e5f76ecb9/users/2e87fb049d2a4265b2687bb195ce34b8/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.540335 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6acdf-ae95-437b-9c5d-f928f8a6ed8b admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:15.545653 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df354e74-5ca3-40ac-8924-37611066d96c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba1ac451b19a4daaaa87204e5f76ecb9, user_id=2e87fb049d2a4265b2687bb195ce34b8, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:15.546238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5742f-e5b1-4a2d-bb65-99e68c4e4bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:15.547266 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5742f-e5b1-4a2d-bb65-99e68c4e4bde admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.547647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5742f-e5b1-4a2d-bb65-99e68c4e4bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.548022 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5742f-e5b1-4a2d-bb65-99e68c4e4bde admin admin] PATH_INFO: `/v3/projects/914e22799f7b4b8095acdf066cc38e1f/users/48f4be3ee79e42aeb67d87c06803c031/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.548425 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df354e74-5ca3-40ac-8924-37611066d96c admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:15.562660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 807/1601] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:15 2022] PUT /identity/v3/projects/ba1ac451b19a4daaaa87204e5f76ecb9/users/2e87fb049d2a4265b2687bb195ce34b8/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:15.563524 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df354e74-5ca3-40ac-8924-37611066d96c admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:15.566664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5742f-e5b1-4a2d-bb65-99e68c4e4bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=914e22799f7b4b8095acdf066cc38e1f, user_id=48f4be3ee79e42aeb67d87c06803c031, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:15.569513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5742f-e5b1-4a2d-bb65-99e68c4e4bde admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:15.588366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 795/1602] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:15 2022] PUT /identity/v3/projects/914e22799f7b4b8095acdf066cc38e1f/users/48f4be3ee79e42aeb67d87c06803c031/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:15.590182 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68604a-77d3-4726-aba2-0e9383fd074b None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.590734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68604a-77d3-4726-aba2-0e9383fd074b None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.591173 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68604a-77d3-4726-aba2-0e9383fd074b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.624841 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-6a68604a-77d3-4726-aba2-0e9383fd074b None None] MFA Rules not processed for user `432336b6eaef49c6bd3918c8f8b9a6da`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:15.626184 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-6a68604a-77d3-4726-aba2-0e9383fd074b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:15.634167 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df354e74-5ca3-40ac-8924-37611066d96c admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:15.680096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:15.695145 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e510eb0-7251-4ccc-b707-ddf5149e088c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:15.695883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e510eb0-7251-4ccc-b707-ddf5149e088c admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.696199 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e510eb0-7251-4ccc-b707-ddf5149e088c admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.696508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e510eb0-7251-4ccc-b707-ddf5149e088c admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.697390 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e510eb0-7251-4ccc-b707-ddf5149e088c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:15.699168 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e510eb0-7251-4ccc-b707-ddf5149e088c admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:15.704548 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 796/1603] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:15 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:15.705903 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7ae35-1507-46cd-809e-dd41e830e6c8 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.706319 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7ae35-1507-46cd-809e-dd41e830e6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.706773 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7ae35-1507-46cd-809e-dd41e830e6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.711048 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 808/1604] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:15.711749 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e510eb0-7251-4ccc-b707-ddf5149e088c admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:15.723600 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e510eb0-7251-4ccc-b707-ddf5149e088c admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:15.724650 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-27a7ae35-1507-46cd-809e-dd41e830e6c8 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:15.725867 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-27a7ae35-1507-46cd-809e-dd41e830e6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:15.728462 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127a8a0-40fb-4a2e-b971-a96ba03f8ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:15.729352 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127a8a0-40fb-4a2e-b971-a96ba03f8ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.729643 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127a8a0-40fb-4a2e-b971-a96ba03f8ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.729924 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127a8a0-40fb-4a2e-b971-a96ba03f8ac7 admin admin] PATH_INFO: `/v3/projects/0475ab8b934f4204afeb99bb22d0e007/users/d33b730b432a4cdd8ac9c709d3a5feb2/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.734865 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 797/1605] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:15.736238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bebb3-2fc3-4000-b2d3-fcb1479145c3 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.736648 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bebb3-2fc3-4000-b2d3-fcb1479145c3 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.736998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bebb3-2fc3-4000-b2d3-fcb1479145c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.746440 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127a8a0-40fb-4a2e-b971-a96ba03f8ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0475ab8b934f4204afeb99bb22d0e007, user_id=d33b730b432a4cdd8ac9c709d3a5feb2, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:15.749467 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127a8a0-40fb-4a2e-b971-a96ba03f8ac7 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:15.756264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-c94bebb3-2fc3-4000-b2d3-fcb1479145c3 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:15.757794 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-c94bebb3-2fc3-4000-b2d3-fcb1479145c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:15.762897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 809/1606] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:15 2022] PUT /identity/v3/projects/0475ab8b934f4204afeb99bb22d0e007/users/d33b730b432a4cdd8ac9c709d3a5feb2/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:15.773944 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd98fdd-ae01-44b5-83cc-e4f692428c8b None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.773944 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd98fdd-ae01-44b5-83cc-e4f692428c8b None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.773944 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd98fdd-ae01-44b5-83cc-e4f692428c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.781838 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-cfd98fdd-ae01-44b5-83cc-e4f692428c8b None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:15.783110 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-cfd98fdd-ae01-44b5-83cc-e4f692428c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:15.815194 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:15.831971 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 798/1607] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:15.833510 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537acbcd-1a8f-409a-a098-86bba3276c93 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.833905 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537acbcd-1a8f-409a-a098-86bba3276c93 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.834319 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537acbcd-1a8f-409a-a098-86bba3276c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.843989 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 810/1608] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:15.844947 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd98fdd-ae01-44b5-83cc-e4f692428c8b None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:15.854317 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd98fdd-ae01-44b5-83cc-e4f692428c8b None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:15.855760 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-537acbcd-1a8f-409a-a098-86bba3276c93 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:15.856973 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-537acbcd-1a8f-409a-a098-86bba3276c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:15.859875 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f9971-47b6-4ad3-9a3a-48cd24e570ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:15.860596 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f9971-47b6-4ad3-9a3a-48cd24e570ec admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.860878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f9971-47b6-4ad3-9a3a-48cd24e570ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.861155 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f9971-47b6-4ad3-9a3a-48cd24e570ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.861839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f9971-47b6-4ad3-9a3a-48cd24e570ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:15.863774 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f9971-47b6-4ad3-9a3a-48cd24e570ec admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:15.865334 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 799/1609] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:15.866082 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537acbcd-1a8f-409a-a098-86bba3276c93 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:15.876158 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537acbcd-1a8f-409a-a098-86bba3276c93 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:15.880734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe9911-0a45-4cb0-bce7-037f7d903008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:15.881628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe9911-0a45-4cb0-bce7-037f7d903008 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.882294 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe9911-0a45-4cb0-bce7-037f7d903008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.882591 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe9911-0a45-4cb0-bce7-037f7d903008 admin admin] PATH_INFO: `/v3/projects/6fadf6e704294a3985a169f60772a1da/users/ca43e59f48fd49e18e1359e9d26c5bab/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.897720 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 811/1610] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:17:15 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:15.897720 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f9971-47b6-4ad3-9a3a-48cd24e570ec admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:15.898504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe9911-0a45-4cb0-bce7-037f7d903008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fadf6e704294a3985a169f60772a1da, user_id=ca43e59f48fd49e18e1359e9d26c5bab, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:15.901582 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe9911-0a45-4cb0-bce7-037f7d903008 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:15.915388 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 800/1611] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:15 2022] PUT /identity/v3/projects/6fadf6e704294a3985a169f60772a1da/users/ca43e59f48fd49e18e1359e9d26c5bab/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:15.916675 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd464c75-7acc-4592-9d31-c874b9995102 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:15.916974 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd464c75-7acc-4592-9d31-c874b9995102 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:15.917253 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd464c75-7acc-4592-9d31-c874b9995102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:15.947448 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-bd464c75-7acc-4592-9d31-c874b9995102 None None] MFA Rules not processed for user `d33b730b432a4cdd8ac9c709d3a5feb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:15.948694 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-bd464c75-7acc-4592-9d31-c874b9995102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:15.954477 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f9971-47b6-4ad3-9a3a-48cd24e570ec admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:16.004339 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e03b7-4dde-4e78-ae33-cc5b93081493 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:16.005013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e03b7-4dde-4e78-ae33-cc5b93081493 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:16.005298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e03b7-4dde-4e78-ae33-cc5b93081493 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:16.005579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e03b7-4dde-4e78-ae33-cc5b93081493 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:16.015923 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:16.022761 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 801/1612] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:16.027985 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd464c75-7acc-4592-9d31-c874b9995102 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:16.038309 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd464c75-7acc-4592-9d31-c874b9995102 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:16.042262 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca53986-51f5-4d64-b4e5-4b982da0c360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:16.042927 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca53986-51f5-4d64-b4e5-4b982da0c360 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:16.043215 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca53986-51f5-4d64-b4e5-4b982da0c360 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:16.043496 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca53986-51f5-4d64-b4e5-4b982da0c360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:16.076739 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e03b7-4dde-4e78-ae33-cc5b93081493 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:16.078246 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e03b7-4dde-4e78-ae33-cc5b93081493 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:16.089503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 812/1613] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:16.090441 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e03b7-4dde-4e78-ae33-cc5b93081493 service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:16.100255 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e03b7-4dde-4e78-ae33-cc5b93081493 service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:16.104770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a114c5e-7ef7-4e2f-aa29-0b9c8e712afc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:16.105827 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a114c5e-7ef7-4e2f-aa29-0b9c8e712afc service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:16.106330 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a114c5e-7ef7-4e2f-aa29-0b9c8e712afc service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:16.106621 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a114c5e-7ef7-4e2f-aa29-0b9c8e712afc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:16.119384 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a114c5e-7ef7-4e2f-aa29-0b9c8e712afc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:16.121287 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a114c5e-7ef7-4e2f-aa29-0b9c8e712afc service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:16.121399 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca53986-51f5-4d64-b4e5-4b982da0c360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:16.123069 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca53986-51f5-4d64-b4e5-4b982da0c360 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:16.132746 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 813/1614] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:16.133371 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a114c5e-7ef7-4e2f-aa29-0b9c8e712afc service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:16.133727 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 802/1615] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:16.134600 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca53986-51f5-4d64-b4e5-4b982da0c360 service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:16.134718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-4a114c5e-7ef7-4e2f-aa29-0b9c8e712afc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:16.145391 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca53986-51f5-4d64-b4e5-4b982da0c360 service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:16.149162 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a114c5e-7ef7-4e2f-aa29-0b9c8e712afc service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:16.151036 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc39aa3-97ca-454b-b726-9e5a6ad9cc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:16.151781 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc39aa3-97ca-454b-b726-9e5a6ad9cc72 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:16.152134 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc39aa3-97ca-454b-b726-9e5a6ad9cc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:16.152474 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc39aa3-97ca-454b-b726-9e5a6ad9cc72 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:16.153314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc39aa3-97ca-454b-b726-9e5a6ad9cc72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:16.155881 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc39aa3-97ca-454b-b726-9e5a6ad9cc72 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:16.157658 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d0f9c-e3b8-4389-a284-e10105b18ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:16.160336 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d0f9c-e3b8-4389-a284-e10105b18ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:16.160336 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d0f9c-e3b8-4389-a284-e10105b18ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:16.160336 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d0f9c-e3b8-4389-a284-e10105b18ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:16.183609 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d0f9c-e3b8-4389-a284-e10105b18ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:16.184681 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 803/1616] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:17:16 2022] POST /identity/v3/users => generated 288 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:16.186213 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d0f9c-e3b8-4389-a284-e10105b18ce4 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:16.186972 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557bccf-ba72-4fbb-95e7-19ebe7548931 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:16.187251 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557bccf-ba72-4fbb-95e7-19ebe7548931 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:16.187671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557bccf-ba72-4fbb-95e7-19ebe7548931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:16.207426 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 814/1617] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:16.210782 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb22065-0265-4a4a-a7cd-39d02b39375c None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:16.211137 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb22065-0265-4a4a-a7cd-39d02b39375c None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:16.211419 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb22065-0265-4a4a-a7cd-39d02b39375c None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:16.212975 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 815/1618] 10.222.0.17 () {54 vars in 961 bytes} [Tue Jul 12 13:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:17:16.215489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-e557bccf-ba72-4fbb-95e7-19ebe7548931 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:16.217898 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-e557bccf-ba72-4fbb-95e7-19ebe7548931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:16.222646 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb22065-0265-4a4a-a7cd-39d02b39375c None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:16.227057 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 804/1619] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:16.228220 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29d3d1-d3d2-4db5-ae86-71ce89289aee None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:16.228517 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29d3d1-d3d2-4db5-ae86-71ce89289aee None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:16.228803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29d3d1-d3d2-4db5-ae86-71ce89289aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:16.249398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb22065-0265-4a4a-a7cd-39d02b39375c None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:16.255739 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff1a79-c9d0-4e65-b4cb-6b19f8776d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:16.256387 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff1a79-c9d0-4e65-b4cb-6b19f8776d7f admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:16.256715 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff1a79-c9d0-4e65-b4cb-6b19f8776d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:16.257283 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff1a79-c9d0-4e65-b4cb-6b19f8776d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:16.258504 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff1a79-c9d0-4e65-b4cb-6b19f8776d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:16.260295 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff1a79-c9d0-4e65-b4cb-6b19f8776d7f admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:16.272815 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 816/1620] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:16.277079 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff1a79-c9d0-4e65-b4cb-6b19f8776d7f admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:16.285844 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:16.291201 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff1a79-c9d0-4e65-b4cb-6b19f8776d7f admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:16.296055 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60a2a1-2554-4bb6-8752-a705ea5b2e4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:16.296772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60a2a1-2554-4bb6-8752-a705ea5b2e4c service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:16.297065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60a2a1-2554-4bb6-8752-a705ea5b2e4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:16.297363 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60a2a1-2554-4bb6-8752-a705ea5b2e4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:16.308591 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60a2a1-2554-4bb6-8752-a705ea5b2e4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:16.310219 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60a2a1-2554-4bb6-8752-a705ea5b2e4c service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:16.312240 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-5f29d3d1-d3d2-4db5-ae86-71ce89289aee None None] MFA Rules not processed for user `e52dfce1b06346bfbde6ee33e7f6f249`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:16.314003 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-5f29d3d1-d3d2-4db5-ae86-71ce89289aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:16.324048 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 817/1621] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:16.325223 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60a2a1-2554-4bb6-8752-a705ea5b2e4c service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:16.338168 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60a2a1-2554-4bb6-8752-a705ea5b2e4c service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:16.348569 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27abe6-2b01-4dc3-9f49-f36e96f6e70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:16.350814 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27abe6-2b01-4dc3-9f49-f36e96f6e70b admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:16.351394 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27abe6-2b01-4dc3-9f49-f36e96f6e70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:16.351744 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27abe6-2b01-4dc3-9f49-f36e96f6e70b admin admin] PATH_INFO: `/v3/projects/5add0d116fde41709b9996e426d107a5/users/e44db98223b4461ca8cba06cd9279cb4/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:16.380869 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27abe6-2b01-4dc3-9f49-f36e96f6e70b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5add0d116fde41709b9996e426d107a5, user_id=e44db98223b4461ca8cba06cd9279cb4, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:16.384315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27abe6-2b01-4dc3-9f49-f36e96f6e70b admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:16.409918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 818/1622] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:16 2022] PUT /identity/v3/projects/5add0d116fde41709b9996e426d107a5/users/e44db98223b4461ca8cba06cd9279cb4/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:16.412133 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27abe6-2b01-4dc3-9f49-f36e96f6e70b admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:16.421558 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 805/1623] 10.222.0.17 () {58 vars in 1058 bytes} [Tue Jul 12 13:17:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:16.433018 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29d3d1-d3d2-4db5-ae86-71ce89289aee None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:16.444435 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29d3d1-d3d2-4db5-ae86-71ce89289aee None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:16.502561 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27abe6-2b01-4dc3-9f49-f36e96f6e70b admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:16.512318 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b47bfc-6b86-4723-823f-664760181de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:16.513218 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b47bfc-6b86-4723-823f-664760181de3 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:16.514151 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b47bfc-6b86-4723-823f-664760181de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:16.514556 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b47bfc-6b86-4723-823f-664760181de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:16.515499 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b47bfc-6b86-4723-823f-664760181de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:16.516308 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01528dc1-f18a-46cc-be32-05530a65ebce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:16.517167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01528dc1-f18a-46cc-be32-05530a65ebce service nova] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:16.517609 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01528dc1-f18a-46cc-be32-05530a65ebce service nova] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:16.517915 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b47bfc-6b86-4723-823f-664760181de3 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:16.518300 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01528dc1-f18a-46cc-be32-05530a65ebce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:16.535568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 819/1624] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:16.537057 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b47bfc-6b86-4723-823f-664760181de3 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:16.560166 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b47bfc-6b86-4723-823f-664760181de3 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:16.571216 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a588e7d-dd3c-4e04-8a6b-03df399f1715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:16.572443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a588e7d-dd3c-4e04-8a6b-03df399f1715 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:16.572818 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a588e7d-dd3c-4e04-8a6b-03df399f1715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:16.573095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a588e7d-dd3c-4e04-8a6b-03df399f1715 admin admin] PATH_INFO: `/v3/projects/5add0d116fde41709b9996e426d107a5/users/e44db98223b4461ca8cba06cd9279cb4/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:16.577594 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a588e7d-dd3c-4e04-8a6b-03df399f1715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5add0d116fde41709b9996e426d107a5, user_id=e44db98223b4461ca8cba06cd9279cb4, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:16.581103 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a588e7d-dd3c-4e04-8a6b-03df399f1715 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:16.600564 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 820/1625] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:16 2022] PUT /identity/v3/projects/5add0d116fde41709b9996e426d107a5/users/e44db98223b4461ca8cba06cd9279cb4/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:17:16.611183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702278d-5ab2-4d38-9f0b-b50bd9781f95 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:16.611595 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702278d-5ab2-4d38-9f0b-b50bd9781f95 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:16.611865 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702278d-5ab2-4d38-9f0b-b50bd9781f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:16.661690 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:16.672524 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-a702278d-5ab2-4d38-9f0b-b50bd9781f95 None None] MFA Rules not processed for user `e44db98223b4461ca8cba06cd9279cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:16.682476 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a702278d-5ab2-4d38-9f0b-b50bd9781f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:16.701359 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01528dc1-f18a-46cc-be32-05530a65ebce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:16.705179 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01528dc1-f18a-46cc-be32-05530a65ebce service nova] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:16.734244 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 806/1626] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:17:16.931210 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 821/1627] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:16 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:17:16.945352 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01528dc1-f18a-46cc-be32-05530a65ebce service nova] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:17.063935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:17.109550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01528dc1-f18a-46cc-be32-05530a65ebce service nova] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:17.191987 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d96c74-e3af-4e4a-894f-895165fb0728 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:17.192467 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d96c74-e3af-4e4a-894f-895165fb0728 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:17.192994 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d96c74-e3af-4e4a-894f-895165fb0728 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:17.194873 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 822/1628] 10.222.0.17 () {54 vars in 961 bytes} [Tue Jul 12 13:17:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:17:17.219309 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dc814-7432-4e77-a6fe-f799de710fff None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:17.220102 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dc814-7432-4e77-a6fe-f799de710fff None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:17.220247 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dc814-7432-4e77-a6fe-f799de710fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:17.231650 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84c0ad-08f1-4550-85af-52bacbf5c280 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:17.232863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84c0ad-08f1-4550-85af-52bacbf5c280 service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:17.233295 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84c0ad-08f1-4550-85af-52bacbf5c280 service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:17.233585 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84c0ad-08f1-4550-85af-52bacbf5c280 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:17.252402 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84c0ad-08f1-4550-85af-52bacbf5c280 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:17.253900 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84c0ad-08f1-4550-85af-52bacbf5c280 service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:17.268902 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-384dc814-7432-4e77-a6fe-f799de710fff None None] MFA Rules not processed for user `e52dfce1b06346bfbde6ee33e7f6f249`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:17.272624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-384dc814-7432-4e77-a6fe-f799de710fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:17.285932 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 807/1629] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:16 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:17.387604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d111c6e-12f0-47ea-a64a-4d9da17bcc4f None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:17.387970 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d111c6e-12f0-47ea-a64a-4d9da17bcc4f None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:17.388228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d111c6e-12f0-47ea-a64a-4d9da17bcc4f None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:17.389695 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 808/1630] 10.222.0.17 () {54 vars in 912 bytes} [Tue Jul 12 13:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:17:17.399431 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac9667-6939-4475-a22d-52991c0e414b None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:17.399727 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac9667-6939-4475-a22d-52991c0e414b None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:17.400016 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac9667-6939-4475-a22d-52991c0e414b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:17.437784 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-bdac9667-6939-4475-a22d-52991c0e414b None None] MFA Rules not processed for user `e52dfce1b06346bfbde6ee33e7f6f249`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:17.439071 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-bdac9667-6939-4475-a22d-52991c0e414b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:17.507918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 823/1631] 10.222.0.17 () {58 vars in 1058 bytes} [Tue Jul 12 13:17:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:17:17.515179 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fa626-b502-4a2a-8ebd-e3205612734a None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:17.515579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fa626-b502-4a2a-8ebd-e3205612734a None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:17.515758 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fa626-b502-4a2a-8ebd-e3205612734a None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:17.517368 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 824/1632] 10.222.0.17 () {54 vars in 912 bytes} [Tue Jul 12 13:17:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:17:17.522912 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6ba70-c652-41a5-9672-39f5d6b52005 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:17.523308 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6ba70-c652-41a5-9672-39f5d6b52005 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:17.523498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6ba70-c652-41a5-9672-39f5d6b52005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:17.569137 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-91e6ba70-c652-41a5-9672-39f5d6b52005 None None] MFA Rules not processed for user `e52dfce1b06346bfbde6ee33e7f6f249`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:17.570497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-91e6ba70-c652-41a5-9672-39f5d6b52005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:17.599960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 825/1633] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Jul 12 13:17:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:17:17.619125 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6ba70-c652-41a5-9672-39f5d6b52005 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:17.640324 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6ba70-c652-41a5-9672-39f5d6b52005 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:17.651078 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95610dc3-33b4-47bf-88d0-c1793d34c679 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:17.653040 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95610dc3-33b4-47bf-88d0-c1793d34c679 service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:17.653372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95610dc3-33b4-47bf-88d0-c1793d34c679 service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:17.653657 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95610dc3-33b4-47bf-88d0-c1793d34c679 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:17.679175 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 809/1634] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Jul 12 13:17:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:17.692723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95610dc3-33b4-47bf-88d0-c1793d34c679 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:17.695264 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95610dc3-33b4-47bf-88d0-c1793d34c679 service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:17.728139 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 826/1635] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:17.741788 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac9667-6939-4475-a22d-52991c0e414b None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:17.761260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac9667-6939-4475-a22d-52991c0e414b None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:17.765529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8e930-911a-4e81-adc6-8f91725ce3ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:17.766962 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8e930-911a-4e81-adc6-8f91725ce3ea service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:17.767233 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8e930-911a-4e81-adc6-8f91725ce3ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:17.767541 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8e930-911a-4e81-adc6-8f91725ce3ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:17.787224 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8e930-911a-4e81-adc6-8f91725ce3ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:17.789036 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8e930-911a-4e81-adc6-8f91725ce3ea service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:17.806613 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 810/1636] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:18.855001 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fbb32-0683-4bee-b85b-8b51957c7032 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:18.855892 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fbb32-0683-4bee-b85b-8b51957c7032 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:18.856359 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fbb32-0683-4bee-b85b-8b51957c7032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:18.941648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-0d4fbb32-0683-4bee-b85b-8b51957c7032 None None] MFA Rules not processed for user `2e87fb049d2a4265b2687bb195ce34b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:18.947082 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-0d4fbb32-0683-4bee-b85b-8b51957c7032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:19.137837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:19.146266 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 827/1637] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:19.150967 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8e930-911a-4e81-adc6-8f91725ce3ea service cinder] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:19.173833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fbb32-0683-4bee-b85b-8b51957c7032 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:19.320543 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fbb32-0683-4bee-b85b-8b51957c7032 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:19.334412 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa503b-1518-441f-a1a0-d99d07e7cd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:19.335507 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa503b-1518-441f-a1a0-d99d07e7cd69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:19.335797 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa503b-1518-441f-a1a0-d99d07e7cd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:19.336079 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa503b-1518-441f-a1a0-d99d07e7cd69 admin admin] PATH_INFO: `/v3/users/432336b6eaef49c6bd3918c8f8b9a6da` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:19.337747 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8e930-911a-4e81-adc6-8f91725ce3ea service cinder] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:19.339155 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa503b-1518-441f-a1a0-d99d07e7cd69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=432336b6eaef49c6bd3918c8f8b9a6da)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:19.340814 dv-cinder-797608-55-smb devstack@keystone.service[80628]: WARNING py.warnings [None req-a1fa503b-1518-441f-a1a0-d99d07e7cd69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:17:19.340814 dv-cinder-797608-55-smb devstack@keystone.service[80628]: warnings.warn(msg) Jul 12 13:17:19.340814 dv-cinder-797608-55-smb devstack@keystone.service[80628]: Jul 12 13:17:19.347934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa503b-1518-441f-a1a0-d99d07e7cd69 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:19.350804 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3864a-3a43-48b9-b479-eec0bd452f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:19.351986 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3864a-3a43-48b9-b479-eec0bd452f40 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:19.352286 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3864a-3a43-48b9-b479-eec0bd452f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:19.352564 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3864a-3a43-48b9-b479-eec0bd452f40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:19.359720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3864a-3a43-48b9-b479-eec0bd452f40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:19.366204 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3864a-3a43-48b9-b479-eec0bd452f40 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:19.396439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:19.417555 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 811/1638] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:17:19 2022] POST /identity/v3/projects => generated 403 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:19.422096 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3864a-3a43-48b9-b479-eec0bd452f40 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:19.525377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-a1fa503b-1518-441f-a1a0-d99d07e7cd69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '432336b6eaef49c6bd3918c8f8b9a6da'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:19.554362 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-a1fa503b-1518-441f-a1a0-d99d07e7cd69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '432336b6eaef49c6bd3918c8f8b9a6da'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:19.577588 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-a1fa503b-1518-441f-a1a0-d99d07e7cd69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '432336b6eaef49c6bd3918c8f8b9a6da'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:19.578968 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-a1fa503b-1518-441f-a1a0-d99d07e7cd69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '432336b6eaef49c6bd3918c8f8b9a6da'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:19.632944 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3864a-3a43-48b9-b479-eec0bd452f40 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:19.639496 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-a1fa503b-1518-441f-a1a0-d99d07e7cd69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '432336b6eaef49c6bd3918c8f8b9a6da'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:19.662295 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fada3-3bb7-43ef-8305-8b6377490894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:19.662813 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fada3-3bb7-43ef-8305-8b6377490894 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:19.663108 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fada3-3bb7-43ef-8305-8b6377490894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:19.663391 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fada3-3bb7-43ef-8305-8b6377490894 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:19.676932 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665fada3-3bb7-43ef-8305-8b6377490894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:19.680161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 828/1639] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:17:19 2022] DELETE /identity/v3/users/432336b6eaef49c6bd3918c8f8b9a6da => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:19.690126 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665fada3-3bb7-43ef-8305-8b6377490894 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:19.691092 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd60d7e-2ff8-41ea-bbb6-d08ceaf7ac1b None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:19.691459 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd60d7e-2ff8-41ea-bbb6-d08ceaf7ac1b None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:19.691808 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd60d7e-2ff8-41ea-bbb6-d08ceaf7ac1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:19.725982 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-2fd60d7e-2ff8-41ea-bbb6-d08ceaf7ac1b None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:19.727533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-2fd60d7e-2ff8-41ea-bbb6-d08ceaf7ac1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:19.740924 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 812/1640] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:17:19 2022] POST /identity/v3/users => generated 308 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:19.745848 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fada3-3bb7-43ef-8305-8b6377490894 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:19.751298 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-665fada3-3bb7-43ef-8305-8b6377490894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:19.770800 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fada3-3bb7-43ef-8305-8b6377490894 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:19.897668 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 829/1641] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:19.908058 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a03e25-af34-4f0d-820c-f9282e657d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:19.908548 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a03e25-af34-4f0d-820c-f9282e657d12 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:19.908843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a03e25-af34-4f0d-820c-f9282e657d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:19.909250 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a03e25-af34-4f0d-820c-f9282e657d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:19.910287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a03e25-af34-4f0d-820c-f9282e657d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:19.911999 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a03e25-af34-4f0d-820c-f9282e657d12 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:19.929798 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd60d7e-2ff8-41ea-bbb6-d08ceaf7ac1b None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:19.936045 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 813/1642] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:19.944516 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd60d7e-2ff8-41ea-bbb6-d08ceaf7ac1b None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:19.950433 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d053f-208a-43e0-920e-11ca5805a496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:19.951976 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d053f-208a-43e0-920e-11ca5805a496 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:19.952270 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d053f-208a-43e0-920e-11ca5805a496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:19.952553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d053f-208a-43e0-920e-11ca5805a496 admin admin] PATH_INFO: `/v3/projects/e68721d260f94d6c801570d383fb4fa2/users/df9fa85fad864a0ba09513da7d54ddd4/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:19.976038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a03e25-af34-4f0d-820c-f9282e657d12 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:19.977865 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-e3a03e25-af34-4f0d-820c-f9282e657d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:19.996333 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d053f-208a-43e0-920e-11ca5805a496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e68721d260f94d6c801570d383fb4fa2, user_id=df9fa85fad864a0ba09513da7d54ddd4, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:20.002372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d053f-208a-43e0-920e-11ca5805a496 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:20.015313 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:20.055477 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 830/1643] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:19 2022] PUT /identity/v3/projects/e68721d260f94d6c801570d383fb4fa2/users/df9fa85fad864a0ba09513da7d54ddd4/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:20.056026 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d053f-208a-43e0-920e-11ca5805a496 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:20.164317 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a03e25-af34-4f0d-820c-f9282e657d12 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:20.229605 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d053f-208a-43e0-920e-11ca5805a496 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:20.244767 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ea8c9-fcea-457d-a0f3-afa8066a7619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:20.246254 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ea8c9-fcea-457d-a0f3-afa8066a7619 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:20.246598 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ea8c9-fcea-457d-a0f3-afa8066a7619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:20.246935 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ea8c9-fcea-457d-a0f3-afa8066a7619 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:20.248770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ea8c9-fcea-457d-a0f3-afa8066a7619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:20.254505 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ea8c9-fcea-457d-a0f3-afa8066a7619 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:20.258737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:20.287669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 831/1644] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:20.290314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ea8c9-fcea-457d-a0f3-afa8066a7619 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:20.304600 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e7e9e-76e0-44ba-a1e9-4bfd8557107a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:20.306994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e7e9e-76e0-44ba-a1e9-4bfd8557107a service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:20.307285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e7e9e-76e0-44ba-a1e9-4bfd8557107a service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:20.308064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e7e9e-76e0-44ba-a1e9-4bfd8557107a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:20.315941 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ea8c9-fcea-457d-a0f3-afa8066a7619 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:20.336289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a403855-b769-4a3b-a3b0-901add383d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:20.337073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e7e9e-76e0-44ba-a1e9-4bfd8557107a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:20.338393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a403855-b769-4a3b-a3b0-901add383d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:20.339782 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a403855-b769-4a3b-a3b0-901add383d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:20.342063 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a403855-b769-4a3b-a3b0-901add383d70 admin admin] PATH_INFO: `/v3/projects/e68721d260f94d6c801570d383fb4fa2/users/df9fa85fad864a0ba09513da7d54ddd4/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:20.343627 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e7e9e-76e0-44ba-a1e9-4bfd8557107a service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:20.353910 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a403855-b769-4a3b-a3b0-901add383d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e68721d260f94d6c801570d383fb4fa2, user_id=df9fa85fad864a0ba09513da7d54ddd4, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:20.367254 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a403855-b769-4a3b-a3b0-901add383d70 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:20.374284 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 814/1645] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:17:20.402876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 832/1646] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:20 2022] PUT /identity/v3/projects/e68721d260f94d6c801570d383fb4fa2/users/df9fa85fad864a0ba09513da7d54ddd4/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:21.759485 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e7e9e-76e0-44ba-a1e9-4bfd8557107a service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:21.761915 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-068e7e9e-76e0-44ba-a1e9-4bfd8557107a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:21.786880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e7e9e-76e0-44ba-a1e9-4bfd8557107a service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:21.891141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997af47-4b4b-4db7-91c1-0a60264fea13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:21.892822 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997af47-4b4b-4db7-91c1-0a60264fea13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:21.893269 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997af47-4b4b-4db7-91c1-0a60264fea13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:21.893870 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997af47-4b4b-4db7-91c1-0a60264fea13 admin admin] PATH_INFO: `/v3/projects/da911a39efda4362bdd6ea8160801116` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:21.895868 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997af47-4b4b-4db7-91c1-0a60264fea13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da911a39efda4362bdd6ea8160801116)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:21.897237 dv-cinder-797608-55-smb devstack@keystone.service[80627]: WARNING py.warnings [None req-d997af47-4b4b-4db7-91c1-0a60264fea13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:17:21.897237 dv-cinder-797608-55-smb devstack@keystone.service[80627]: warnings.warn(msg) Jul 12 13:17:21.897237 dv-cinder-797608-55-smb devstack@keystone.service[80627]: Jul 12 13:17:21.905610 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997af47-4b4b-4db7-91c1-0a60264fea13 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:21.996602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a403855-b769-4a3b-a3b0-901add383d70 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:21.999124 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-4a403855-b769-4a3b-a3b0-901add383d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:22.038766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a403855-b769-4a3b-a3b0-901add383d70 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:22.080211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d997af47-4b4b-4db7-91c1-0a60264fea13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da911a39efda4362bdd6ea8160801116', 'request_id': 'req-d997af47-4b4b-4db7-91c1-0a60264fea13'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:22.105481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d997af47-4b4b-4db7-91c1-0a60264fea13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da911a39efda4362bdd6ea8160801116', 'request_id': 'req-d997af47-4b4b-4db7-91c1-0a60264fea13'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:22.126721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d997af47-4b4b-4db7-91c1-0a60264fea13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da911a39efda4362bdd6ea8160801116', 'request_id': 'req-d997af47-4b4b-4db7-91c1-0a60264fea13'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:22.168533 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d997af47-4b4b-4db7-91c1-0a60264fea13 admin admin] The token cache is being invalidate because project da911a39efda4362bdd6ea8160801116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:17:22.168880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d997af47-4b4b-4db7-91c1-0a60264fea13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:22.171638 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d997af47-4b4b-4db7-91c1-0a60264fea13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:22.174409 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 815/1647] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:17:21 2022] DELETE /identity/v3/projects/da911a39efda4362bdd6ea8160801116 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:22.179729 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997af47-4b4b-4db7-91c1-0a60264fea13 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:22.181916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-d997af47-4b4b-4db7-91c1-0a60264fea13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:22.202147 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fa672-c823-4b73-97d4-6d67a516b908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:22.203094 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fa672-c823-4b73-97d4-6d67a516b908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:22.203376 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fa672-c823-4b73-97d4-6d67a516b908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:22.203651 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fa672-c823-4b73-97d4-6d67a516b908 admin admin] PATH_INFO: `/v3/users/d33b730b432a4cdd8ac9c709d3a5feb2` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:22.205064 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84fa672-c823-4b73-97d4-6d67a516b908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d33b730b432a4cdd8ac9c709d3a5feb2)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:22.207097 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84fa672-c823-4b73-97d4-6d67a516b908 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:22.397473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-d84fa672-c823-4b73-97d4-6d67a516b908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd33b730b432a4cdd8ac9c709d3a5feb2'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:22.404863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997af47-4b4b-4db7-91c1-0a60264fea13 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:22.416955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-d84fa672-c823-4b73-97d4-6d67a516b908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd33b730b432a4cdd8ac9c709d3a5feb2'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:22.434369 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4fe82-4f5b-4781-889f-d572b827d703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:22.436955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4fe82-4f5b-4781-889f-d572b827d703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:22.437173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-d84fa672-c823-4b73-97d4-6d67a516b908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd33b730b432a4cdd8ac9c709d3a5feb2'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:22.437947 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4fe82-4f5b-4781-889f-d572b827d703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:22.438258 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4fe82-4f5b-4781-889f-d572b827d703 admin admin] PATH_INFO: `/v3/users/e44db98223b4461ca8cba06cd9279cb4` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:22.438909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-d84fa672-c823-4b73-97d4-6d67a516b908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd33b730b432a4cdd8ac9c709d3a5feb2'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:22.442776 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4fe82-4f5b-4781-889f-d572b827d703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e44db98223b4461ca8cba06cd9279cb4)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:22.446087 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4fe82-4f5b-4781-889f-d572b827d703 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:22.466764 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-d84fa672-c823-4b73-97d4-6d67a516b908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd33b730b432a4cdd8ac9c709d3a5feb2'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:22.469703 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:22.476311 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:22.485756 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 833/1648] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:17:21 2022] DELETE /identity/v3/users/d33b730b432a4cdd8ac9c709d3a5feb2 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:22.487830 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671dc24-48a6-4bd2-9478-83b72430dd3f None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:22.488128 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671dc24-48a6-4bd2-9478-83b72430dd3f None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:22.488411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671dc24-48a6-4bd2-9478-83b72430dd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:22.540176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-4671dc24-48a6-4bd2-9478-83b72430dd3f None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:22.576105 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-4671dc24-48a6-4bd2-9478-83b72430dd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:22.595418 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-6da4fe82-4f5b-4781-889f-d572b827d703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e44db98223b4461ca8cba06cd9279cb4'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:22.596851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-6da4fe82-4f5b-4781-889f-d572b827d703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e44db98223b4461ca8cba06cd9279cb4'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:22.624290 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-6da4fe82-4f5b-4781-889f-d572b827d703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e44db98223b4461ca8cba06cd9279cb4'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:22.650865 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-6da4fe82-4f5b-4781-889f-d572b827d703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e44db98223b4461ca8cba06cd9279cb4'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:22.710695 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-6da4fe82-4f5b-4781-889f-d572b827d703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e44db98223b4461ca8cba06cd9279cb4'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:22.757141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 816/1649] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:17:22 2022] DELETE /identity/v3/users/e44db98223b4461ca8cba06cd9279cb4 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:22.827117 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 834/1650] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:22.862585 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4fe82-4f5b-4781-889f-d572b827d703 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:22.864822 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-6da4fe82-4f5b-4781-889f-d572b827d703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:23.057690 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4fe82-4f5b-4781-889f-d572b827d703 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:23.069468 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec2c2c-33bd-4beb-9404-1a771c647ba0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:23.076677 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec2c2c-33bd-4beb-9404-1a771c647ba0 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:23.078993 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec2c2c-33bd-4beb-9404-1a771c647ba0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:23.079542 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec2c2c-33bd-4beb-9404-1a771c647ba0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:23.249956 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec2c2c-33bd-4beb-9404-1a771c647ba0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:23.254140 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec2c2c-33bd-4beb-9404-1a771c647ba0 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:23.278304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 817/1651] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:23.954519 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710d79c-7d33-419d-9994-1bba1ef039f1 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:23.955334 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710d79c-7d33-419d-9994-1bba1ef039f1 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:23.955759 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710d79c-7d33-419d-9994-1bba1ef039f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:24.064884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-d710d79c-7d33-419d-9994-1bba1ef039f1 None None] MFA Rules not processed for user `df9fa85fad864a0ba09513da7d54ddd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:24.070962 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-d710d79c-7d33-419d-9994-1bba1ef039f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:24.344016 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 835/1652] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:23 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:25.551035 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec2c2c-33bd-4beb-9404-1a771c647ba0 service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:25.556840 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-c4ec2c2c-33bd-4beb-9404-1a771c647ba0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:25.599406 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec2c2c-33bd-4beb-9404-1a771c647ba0 service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:25.614284 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb93b36-ee63-4e66-b6ae-e5422c4a4543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:25.615672 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb93b36-ee63-4e66-b6ae-e5422c4a4543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:25.616188 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb93b36-ee63-4e66-b6ae-e5422c4a4543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:25.616680 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb93b36-ee63-4e66-b6ae-e5422c4a4543 admin admin] PATH_INFO: `/v3/projects/5add0d116fde41709b9996e426d107a5` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:25.619542 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb93b36-ee63-4e66-b6ae-e5422c4a4543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5add0d116fde41709b9996e426d107a5)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:25.627964 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb93b36-ee63-4e66-b6ae-e5422c4a4543 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:25.726359 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:25.743783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-ffb93b36-ee63-4e66-b6ae-e5422c4a4543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5add0d116fde41709b9996e426d107a5', 'request_id': 'req-ffb93b36-ee63-4e66-b6ae-e5422c4a4543'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:25.767308 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-ffb93b36-ee63-4e66-b6ae-e5422c4a4543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5add0d116fde41709b9996e426d107a5', 'request_id': 'req-ffb93b36-ee63-4e66-b6ae-e5422c4a4543'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:25.791098 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-ffb93b36-ee63-4e66-b6ae-e5422c4a4543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5add0d116fde41709b9996e426d107a5', 'request_id': 'req-ffb93b36-ee63-4e66-b6ae-e5422c4a4543'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:25.810700 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-ffb93b36-ee63-4e66-b6ae-e5422c4a4543 admin admin] The token cache is being invalidate because project 5add0d116fde41709b9996e426d107a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:17:25.810918 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-ffb93b36-ee63-4e66-b6ae-e5422c4a4543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:25.813132 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-ffb93b36-ee63-4e66-b6ae-e5422c4a4543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:25.822311 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 818/1653] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:17:25 2022] DELETE /identity/v3/projects/5add0d116fde41709b9996e426d107a5 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:25.831491 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4482b1-574d-43a9-9ca9-666c993f747f None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:25.832028 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4482b1-574d-43a9-9ca9-666c993f747f None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:25.832418 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4482b1-574d-43a9-9ca9-666c993f747f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:25.897910 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-ae4482b1-574d-43a9-9ca9-666c993f747f None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:25.899496 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-ae4482b1-574d-43a9-9ca9-666c993f747f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:26.044430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9bf55-4da6-4f78-80de-a39520df0d46 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:26.044884 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9bf55-4da6-4f78-80de-a39520df0d46 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:26.045322 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9bf55-4da6-4f78-80de-a39520df0d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:26.048441 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 836/1654] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:26.085521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-7fb9bf55-4da6-4f78-80de-a39520df0d46 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:26.090338 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-7fb9bf55-4da6-4f78-80de-a39520df0d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:26.117835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4482b1-574d-43a9-9ca9-666c993f747f None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:26.125303 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 819/1655] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:26.129880 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4482b1-574d-43a9-9ca9-666c993f747f None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:26.137763 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386f93d-ba32-46a4-aaa4-71c6fc271264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:26.138581 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386f93d-ba32-46a4-aaa4-71c6fc271264 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:26.138870 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386f93d-ba32-46a4-aaa4-71c6fc271264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:26.139147 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386f93d-ba32-46a4-aaa4-71c6fc271264 admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:26.139975 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386f93d-ba32-46a4-aaa4-71c6fc271264 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:17:26.140292 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386f93d-ba32-46a4-aaa4-71c6fc271264 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:26.142011 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386f93d-ba32-46a4-aaa4-71c6fc271264 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:26.161837 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9bf55-4da6-4f78-80de-a39520df0d46 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:26.174672 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9bf55-4da6-4f78-80de-a39520df0d46 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:26.175662 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 837/1656] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:17:26.187336 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03086b3-b7ed-48ee-b7a8-05173d7f2fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:26.188369 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03086b3-b7ed-48ee-b7a8-05173d7f2fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:26.188836 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03086b3-b7ed-48ee-b7a8-05173d7f2fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:26.189256 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03086b3-b7ed-48ee-b7a8-05173d7f2fe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:26.190045 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03086b3-b7ed-48ee-b7a8-05173d7f2fe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:26.194422 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03086b3-b7ed-48ee-b7a8-05173d7f2fe2 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:26.248410 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386f93d-ba32-46a4-aaa4-71c6fc271264 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:26.270605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 820/1657] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:17:26 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:26.275322 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386f93d-ba32-46a4-aaa4-71c6fc271264 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:26.292994 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:26.387691 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab22cbb-fedb-4c19-9dd7-5ca9b8f1415b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:26.388459 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab22cbb-fedb-4c19-9dd7-5ca9b8f1415b admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:26.388753 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab22cbb-fedb-4c19-9dd7-5ca9b8f1415b admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:26.389036 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab22cbb-fedb-4c19-9dd7-5ca9b8f1415b admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:26.389748 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab22cbb-fedb-4c19-9dd7-5ca9b8f1415b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:26.391762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab22cbb-fedb-4c19-9dd7-5ca9b8f1415b admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:26.425606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 838/1658] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:17:26 2022] POST /identity/v3/users => generated 283 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:26.429794 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03086b3-b7ed-48ee-b7a8-05173d7f2fe2 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:26.449608 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03086b3-b7ed-48ee-b7a8-05173d7f2fe2 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:26.467051 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b85065-bc44-464b-b254-8afdf725587a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:26.469779 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b85065-bc44-464b-b254-8afdf725587a admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:26.470141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b85065-bc44-464b-b254-8afdf725587a admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:26.470477 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b85065-bc44-464b-b254-8afdf725587a admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:26.471257 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b85065-bc44-464b-b254-8afdf725587a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:26.477199 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b85065-bc44-464b-b254-8afdf725587a admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:26.513162 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 821/1659] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:17:26.514706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab22cbb-fedb-4c19-9dd7-5ca9b8f1415b admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:26.528463 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab22cbb-fedb-4c19-9dd7-5ca9b8f1415b admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:26.538268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39abfbf-ecb8-45b5-91f8-2eb093eb0c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:26.538925 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39abfbf-ecb8-45b5-91f8-2eb093eb0c37 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:26.539236 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39abfbf-ecb8-45b5-91f8-2eb093eb0c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:26.539690 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39abfbf-ecb8-45b5-91f8-2eb093eb0c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:26.540483 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39abfbf-ecb8-45b5-91f8-2eb093eb0c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:26.548298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39abfbf-ecb8-45b5-91f8-2eb093eb0c37 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:26.585124 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 839/1660] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:26.587700 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b85065-bc44-464b-b254-8afdf725587a admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:26.609537 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b85065-bc44-464b-b254-8afdf725587a admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:26.622990 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980966d0-34be-4460-916f-f0bf9a2de11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:26.623930 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980966d0-34be-4460-916f-f0bf9a2de11f admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:26.624218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980966d0-34be-4460-916f-f0bf9a2de11f admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:26.626925 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980966d0-34be-4460-916f-f0bf9a2de11f admin admin] PATH_INFO: `/v3/projects/51442b29253a484394162f95c7200941/users/14401b0867914d5993612d99c1b39b05/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:26.671076 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980966d0-34be-4460-916f-f0bf9a2de11f admin admin] RBAC: Authorizing `identity:create_grant(project_id=51442b29253a484394162f95c7200941, user_id=14401b0867914d5993612d99c1b39b05, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:26.682602 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980966d0-34be-4460-916f-f0bf9a2de11f admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:26.729331 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 822/1661] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:26 2022] PUT /identity/v3/projects/51442b29253a484394162f95c7200941/users/14401b0867914d5993612d99c1b39b05/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:26.745592 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b055439-f11f-4bdf-a1fb-fb4d338f85d6 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:26.748779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b055439-f11f-4bdf-a1fb-fb4d338f85d6 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:26.749387 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b055439-f11f-4bdf-a1fb-fb4d338f85d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:26.808969 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-7b055439-f11f-4bdf-a1fb-fb4d338f85d6 None None] MFA Rules not processed for user `14401b0867914d5993612d99c1b39b05`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:26.813008 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-7b055439-f11f-4bdf-a1fb-fb4d338f85d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:27.081912 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 840/1662] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:27.086503 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980966d0-34be-4460-916f-f0bf9a2de11f admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:27.255689 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980966d0-34be-4460-916f-f0bf9a2de11f admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:27.265193 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de817c-1844-4d93-a660-52010e9562d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:27.266038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de817c-1844-4d93-a660-52010e9562d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:27.266454 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de817c-1844-4d93-a660-52010e9562d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:27.266833 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de817c-1844-4d93-a660-52010e9562d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:27.267654 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de817c-1844-4d93-a660-52010e9562d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:27.269899 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de817c-1844-4d93-a660-52010e9562d8 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:27.324442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 823/1663] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:17:27 2022] POST /identity/v3/projects => generated 367 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:27.328101 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b055439-f11f-4bdf-a1fb-fb4d338f85d6 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:27.346861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b055439-f11f-4bdf-a1fb-fb4d338f85d6 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:27.480310 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024f603-a14a-40ba-9ea7-590f3a1ec32f None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:27.480499 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024f603-a14a-40ba-9ea7-590f3a1ec32f None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:27.480756 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024f603-a14a-40ba-9ea7-590f3a1ec32f None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:27.482772 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 824/1664] 10.222.0.17 () {54 vars in 921 bytes} [Tue Jul 12 13:17:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:17:27.498100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834f9d6-2d16-4301-afe5-4d76c9dccf31 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:27.499006 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834f9d6-2d16-4301-afe5-4d76c9dccf31 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:27.499006 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834f9d6-2d16-4301-afe5-4d76c9dccf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:27.502928 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf292b3-39e5-451e-902c-f6daf5e3c89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:27.504498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf292b3-39e5-451e-902c-f6daf5e3c89e admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:27.504808 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf292b3-39e5-451e-902c-f6daf5e3c89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:27.507194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf292b3-39e5-451e-902c-f6daf5e3c89e admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:27.507965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf292b3-39e5-451e-902c-f6daf5e3c89e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:27.513078 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf292b3-39e5-451e-902c-f6daf5e3c89e admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:27.550794 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-6834f9d6-2d16-4301-afe5-4d76c9dccf31 None None] MFA Rules not processed for user `698828dd940f46e2b493ba55cd894eac`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:27.555363 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-6834f9d6-2d16-4301-afe5-4d76c9dccf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:27.560578 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 841/1665] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:17:27 2022] POST /identity/v3/users => generated 290 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:27.561675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf292b3-39e5-451e-902c-f6daf5e3c89e admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:27.566212 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-4bf292b3-39e5-451e-902c-f6daf5e3c89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:27.589324 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf292b3-39e5-451e-902c-f6daf5e3c89e admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:27.598455 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b94d4-8f3e-4480-ba25-19a850930790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:27.599955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b94d4-8f3e-4480-ba25-19a850930790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:27.600275 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b94d4-8f3e-4480-ba25-19a850930790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:27.600562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b94d4-8f3e-4480-ba25-19a850930790 admin admin] PATH_INFO: `/v3/projects/0475ab8b934f4204afeb99bb22d0e007` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:27.601829 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b94d4-8f3e-4480-ba25-19a850930790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0475ab8b934f4204afeb99bb22d0e007)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:27.606250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b94d4-8f3e-4480-ba25-19a850930790 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:27.609115 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:27.743964 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:27.754726 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-db9b94d4-8f3e-4480-ba25-19a850930790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0475ab8b934f4204afeb99bb22d0e007', 'request_id': 'req-db9b94d4-8f3e-4480-ba25-19a850930790'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:27.785188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-db9b94d4-8f3e-4480-ba25-19a850930790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0475ab8b934f4204afeb99bb22d0e007', 'request_id': 'req-db9b94d4-8f3e-4480-ba25-19a850930790'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:27.804353 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-db9b94d4-8f3e-4480-ba25-19a850930790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0475ab8b934f4204afeb99bb22d0e007', 'request_id': 'req-db9b94d4-8f3e-4480-ba25-19a850930790'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:27.827794 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-db9b94d4-8f3e-4480-ba25-19a850930790 admin admin] The token cache is being invalidate because project 0475ab8b934f4204afeb99bb22d0e007 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:17:27.828118 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-db9b94d4-8f3e-4480-ba25-19a850930790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:27.828760 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-db9b94d4-8f3e-4480-ba25-19a850930790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:27.831504 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 842/1666] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:17:27 2022] DELETE /identity/v3/projects/0475ab8b934f4204afeb99bb22d0e007 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:27.836661 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 825/1667] 10.222.0.17 () {58 vars in 1018 bytes} [Tue Jul 12 13:17:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:17:27.837572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b94d4-8f3e-4480-ba25-19a850930790 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:27.837696 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834f9d6-2d16-4301-afe5-4d76c9dccf31 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:27.841435 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-db9b94d4-8f3e-4480-ba25-19a850930790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:27.845095 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-6834f9d6-2d16-4301-afe5-4d76c9dccf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:27.891495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834f9d6-2d16-4301-afe5-4d76c9dccf31 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:28.030132 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b94d4-8f3e-4480-ba25-19a850930790 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:28.043892 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bba641-95bb-4ece-a202-27a56ea638be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:28.044853 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e003eae-36fb-4f16-add4-d97c65966327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:28.045632 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bba641-95bb-4ece-a202-27a56ea638be admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:28.046185 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e003eae-36fb-4f16-add4-d97c65966327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:28.046185 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e003eae-36fb-4f16-add4-d97c65966327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:28.046364 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e003eae-36fb-4f16-add4-d97c65966327 admin admin] PATH_INFO: `/v3/users/7bde195b29d5412d932928a13f8f701d` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:28.050435 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bba641-95bb-4ece-a202-27a56ea638be admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:28.051106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bba641-95bb-4ece-a202-27a56ea638be admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:28.052099 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bba641-95bb-4ece-a202-27a56ea638be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:28.053835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bba641-95bb-4ece-a202-27a56ea638be admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:28.055023 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e003eae-36fb-4f16-add4-d97c65966327 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bde195b29d5412d932928a13f8f701d)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:28.057185 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e003eae-36fb-4f16-add4-d97c65966327 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:28.089513 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 843/1668] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:28.089513 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f405b0-51d7-4c53-ac72-7aec9d0dc920 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:28.089513 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f405b0-51d7-4c53-ac72-7aec9d0dc920 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:28.089513 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f405b0-51d7-4c53-ac72-7aec9d0dc920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:28.155920 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-6e003eae-36fb-4f16-add4-d97c65966327 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bde195b29d5412d932928a13f8f701d'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:28.156622 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-12f405b0-51d7-4c53-ac72-7aec9d0dc920 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:28.158001 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-12f405b0-51d7-4c53-ac72-7aec9d0dc920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:28.159064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-6e003eae-36fb-4f16-add4-d97c65966327 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bde195b29d5412d932928a13f8f701d'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:28.185831 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 844/1669] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:28.186020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-6e003eae-36fb-4f16-add4-d97c65966327 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bde195b29d5412d932928a13f8f701d'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:28.190903 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450e823-6fc2-4945-ad28-2616fb3c1e29 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:28.191219 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450e823-6fc2-4945-ad28-2616fb3c1e29 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:28.191472 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450e823-6fc2-4945-ad28-2616fb3c1e29 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:28.198391 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 845/1670] 10.222.0.17 () {54 vars in 960 bytes} [Tue Jul 12 13:17:28 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:17:28.199286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450e823-6fc2-4945-ad28-2616fb3c1e29 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:28.201943 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-6e003eae-36fb-4f16-add4-d97c65966327 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bde195b29d5412d932928a13f8f701d'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:28.204415 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-7450e823-6fc2-4945-ad28-2616fb3c1e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:28.237850 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-6e003eae-36fb-4f16-add4-d97c65966327 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bde195b29d5412d932928a13f8f701d'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:28.248385 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450e823-6fc2-4945-ad28-2616fb3c1e29 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:28.258059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 826/1671] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:17:27 2022] DELETE /identity/v3/users/7bde195b29d5412d932928a13f8f701d => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:28.261054 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f277f27-9017-4c35-abe7-dc41448b0bac None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:28.262881 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f277f27-9017-4c35-abe7-dc41448b0bac None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:28.265384 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1201f4-0184-49c1-976a-350c46d1929f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:28.265555 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f277f27-9017-4c35-abe7-dc41448b0bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:28.267649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1201f4-0184-49c1-976a-350c46d1929f admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:28.267944 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1201f4-0184-49c1-976a-350c46d1929f admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:28.269386 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1201f4-0184-49c1-976a-350c46d1929f admin admin] PATH_INFO: `/v3/projects/0171a2f7eea34627a9af459954ddad7f/users/344ed3d915d64f9b868e551bbaa042ab/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:28.317213 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-8f277f27-9017-4c35-abe7-dc41448b0bac None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:28.319638 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1201f4-0184-49c1-976a-350c46d1929f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0171a2f7eea34627a9af459954ddad7f, user_id=344ed3d915d64f9b868e551bbaa042ab, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:28.325248 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-8f277f27-9017-4c35-abe7-dc41448b0bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:28.326626 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1201f4-0184-49c1-976a-350c46d1929f admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:28.363155 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 846/1672] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:28 2022] PUT /identity/v3/projects/0171a2f7eea34627a9af459954ddad7f/users/344ed3d915d64f9b868e551bbaa042ab/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:28.363357 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a715e8-a4f0-4b7d-bb9b-c7ce2a9e7042 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:28.363850 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a715e8-a4f0-4b7d-bb9b-c7ce2a9e7042 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:28.364141 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a715e8-a4f0-4b7d-bb9b-c7ce2a9e7042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:28.418144 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-b3a715e8-a4f0-4b7d-bb9b-c7ce2a9e7042 None None] MFA Rules not processed for user `698828dd940f46e2b493ba55cd894eac`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:28.422177 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-b3a715e8-a4f0-4b7d-bb9b-c7ce2a9e7042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:28.491609 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:28.510643 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 827/1673] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:28.510643 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995dd1c-7e2b-4c8e-948d-5b4b3789121a None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:28.511041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995dd1c-7e2b-4c8e-948d-5b4b3789121a None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:28.511598 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995dd1c-7e2b-4c8e-948d-5b4b3789121a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:28.541395 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-d995dd1c-7e2b-4c8e-948d-5b4b3789121a None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:28.542837 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-d995dd1c-7e2b-4c8e-948d-5b4b3789121a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:28.588977 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:28.630212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 828/1674] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:28.632272 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995dd1c-7e2b-4c8e-948d-5b4b3789121a None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:28.634631 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 847/1675] 10.222.0.17 () {58 vars in 1057 bytes} [Tue Jul 12 13:17:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:28.635886 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a715e8-a4f0-4b7d-bb9b-c7ce2a9e7042 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:28.650888 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995dd1c-7e2b-4c8e-948d-5b4b3789121a None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:28.651976 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a715e8-a4f0-4b7d-bb9b-c7ce2a9e7042 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:28.658867 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d366c47-2b02-42b0-a61b-baa017cf00a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:28.659528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5e7e9-2f4e-4c3f-ac18-7975c1f2a04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:28.660365 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d366c47-2b02-42b0-a61b-baa017cf00a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:28.660884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d366c47-2b02-42b0-a61b-baa017cf00a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:28.661360 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d366c47-2b02-42b0-a61b-baa017cf00a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:28.661680 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5e7e9-2f4e-4c3f-ac18-7975c1f2a04a admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:28.662077 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5e7e9-2f4e-4c3f-ac18-7975c1f2a04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:28.662394 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5e7e9-2f4e-4c3f-ac18-7975c1f2a04a admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:28.663045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d366c47-2b02-42b0-a61b-baa017cf00a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:17:28.663598 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d366c47-2b02-42b0-a61b-baa017cf00a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:28.665344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5e7e9-2f4e-4c3f-ac18-7975c1f2a04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:28.666126 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d366c47-2b02-42b0-a61b-baa017cf00a2 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:28.667299 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5e7e9-2f4e-4c3f-ac18-7975c1f2a04a admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:28.700234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 829/1676] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:28.700234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5e7e9-2f4e-4c3f-ac18-7975c1f2a04a admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:28.710682 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 848/1677] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:17:28.712442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d366c47-2b02-42b0-a61b-baa017cf00a2 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:28.728634 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d366c47-2b02-42b0-a61b-baa017cf00a2 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:28.734193 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5e7e9-2f4e-4c3f-ac18-7975c1f2a04a admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:28.740937 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb956c52-8b2c-4e89-8a4b-0d15c800a01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:28.742952 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb956c52-8b2c-4e89-8a4b-0d15c800a01a admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:28.743743 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb956c52-8b2c-4e89-8a4b-0d15c800a01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:28.744465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb956c52-8b2c-4e89-8a4b-0d15c800a01a admin admin] PATH_INFO: `/v3/projects/0171a2f7eea34627a9af459954ddad7f/users/344ed3d915d64f9b868e551bbaa042ab/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:28.749428 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6681d1-582c-4353-9807-9e79fc9ba646 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '698828dd940f46e2b493ba55cd894eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:28.750294 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6681d1-582c-4353-9807-9e79fc9ba646 service placement] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:28.750535 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6681d1-582c-4353-9807-9e79fc9ba646 service placement] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:28.750966 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6681d1-582c-4353-9807-9e79fc9ba646 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:28.756056 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-be6681d1-582c-4353-9807-9e79fc9ba646 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:28.766643 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb956c52-8b2c-4e89-8a4b-0d15c800a01a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0171a2f7eea34627a9af459954ddad7f, user_id=344ed3d915d64f9b868e551bbaa042ab, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:28.771248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb956c52-8b2c-4e89-8a4b-0d15c800a01a admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:28.791058 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6681d1-582c-4353-9807-9e79fc9ba646 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:28.791647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 849/1678] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:28 2022] PUT /identity/v3/projects/0171a2f7eea34627a9af459954ddad7f/users/344ed3d915d64f9b868e551bbaa042ab/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:28.792662 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb956c52-8b2c-4e89-8a4b-0d15c800a01a admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:28.792792 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6681d1-582c-4353-9807-9e79fc9ba646 service placement] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:28.815744 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 830/1679] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:28.816846 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6681d1-582c-4353-9807-9e79fc9ba646 service placement] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:28.818749 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-be6681d1-582c-4353-9807-9e79fc9ba646 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:29.001342 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb956c52-8b2c-4e89-8a4b-0d15c800a01a admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:29.007520 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5772ae-86db-4f1c-a05c-f31fd76a1bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:29.008401 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5772ae-86db-4f1c-a05c-f31fd76a1bee admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:29.008693 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6681d1-582c-4353-9807-9e79fc9ba646 service placement] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:29.008812 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5772ae-86db-4f1c-a05c-f31fd76a1bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:29.009177 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5772ae-86db-4f1c-a05c-f31fd76a1bee admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:29.009963 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5772ae-86db-4f1c-a05c-f31fd76a1bee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:29.012066 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5772ae-86db-4f1c-a05c-f31fd76a1bee admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:29.056182 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 850/1680] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:17:28 2022] POST /identity/v3/projects => generated 371 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:29.064830 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c88ba-7f09-41c3-9829-e83f94789128 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:29.065149 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c88ba-7f09-41c3-9829-e83f94789128 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:29.065396 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c88ba-7f09-41c3-9829-e83f94789128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:29.129520 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-065c88ba-7f09-41c3-9829-e83f94789128 None None] MFA Rules not processed for user `344ed3d915d64f9b868e551bbaa042ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:29.134576 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-065c88ba-7f09-41c3-9829-e83f94789128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:29.143759 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591cf2a-2ba0-4b0a-8d4a-8c000eddc5fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:29.144484 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591cf2a-2ba0-4b0a-8d4a-8c000eddc5fe service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:29.144773 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591cf2a-2ba0-4b0a-8d4a-8c000eddc5fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:29.145049 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591cf2a-2ba0-4b0a-8d4a-8c000eddc5fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:29.169892 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591cf2a-2ba0-4b0a-8d4a-8c000eddc5fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:29.171411 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591cf2a-2ba0-4b0a-8d4a-8c000eddc5fe service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:29.204764 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 831/1681] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:29.205804 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591cf2a-2ba0-4b0a-8d4a-8c000eddc5fe service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:29.221634 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591cf2a-2ba0-4b0a-8d4a-8c000eddc5fe service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:29.284386 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:29.287412 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 851/1682] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:29 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:29.298388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c88ba-7f09-41c3-9829-e83f94789128 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:29.300038 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-065c88ba-7f09-41c3-9829-e83f94789128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:29.329963 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928f81d-f8de-40d6-b3ac-6b6d23935381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:29.331198 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928f81d-f8de-40d6-b3ac-6b6d23935381 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:29.331626 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928f81d-f8de-40d6-b3ac-6b6d23935381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:29.332048 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928f81d-f8de-40d6-b3ac-6b6d23935381 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:29.332896 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928f81d-f8de-40d6-b3ac-6b6d23935381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:29.336147 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928f81d-f8de-40d6-b3ac-6b6d23935381 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:29.394852 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:29.399942 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 832/1683] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:17:29 2022] POST /identity/v3/users => generated 286 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:29.404170 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928f81d-f8de-40d6-b3ac-6b6d23935381 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:29.424888 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c88ba-7f09-41c3-9829-e83f94789128 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:29.428997 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f96b6-e56f-43f2-ad48-4debaeefa892 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:29.429928 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f96b6-e56f-43f2-ad48-4debaeefa892 service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:29.430416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f96b6-e56f-43f2-ad48-4debaeefa892 service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:29.431267 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f96b6-e56f-43f2-ad48-4debaeefa892 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:29.431965 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928f81d-f8de-40d6-b3ac-6b6d23935381 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:29.447072 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f96b6-e56f-43f2-ad48-4debaeefa892 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:29.448688 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f96b6-e56f-43f2-ad48-4debaeefa892 service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:29.456595 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4b3fa-3da0-47f9-b4dd-0b989c3773ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:29.457476 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4b3fa-3da0-47f9-b4dd-0b989c3773ac admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:29.457823 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4b3fa-3da0-47f9-b4dd-0b989c3773ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:29.458220 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4b3fa-3da0-47f9-b4dd-0b989c3773ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:29.459087 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4b3fa-3da0-47f9-b4dd-0b989c3773ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:29.460815 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4b3fa-3da0-47f9-b4dd-0b989c3773ac admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:29.463288 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 852/1684] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:29 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:29.495772 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 833/1685] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:17:29.499520 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f96b6-e56f-43f2-ad48-4debaeefa892 service cinder] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:29.522313 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f96b6-e56f-43f2-ad48-4debaeefa892 service cinder] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:29.538682 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2409c-24ac-4459-8562-2e6d0359a040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:29.539359 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4b3fa-3da0-47f9-b4dd-0b989c3773ac admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:29.539525 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2409c-24ac-4459-8562-2e6d0359a040 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:29.539957 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2409c-24ac-4459-8562-2e6d0359a040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:29.540672 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2409c-24ac-4459-8562-2e6d0359a040 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:29.541262 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd2409c-24ac-4459-8562-2e6d0359a040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:29.542618 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-ceb4b3fa-3da0-47f9-b4dd-0b989c3773ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:29.545571 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd2409c-24ac-4459-8562-2e6d0359a040 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:29.562907 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 853/1686] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:29.566716 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2409c-24ac-4459-8562-2e6d0359a040 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:29.566998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4b3fa-3da0-47f9-b4dd-0b989c3773ac admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:29.578655 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985b48f-d89c-42d0-9a6f-7ba1f69d0751 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:29.579649 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985b48f-d89c-42d0-9a6f-7ba1f69d0751 service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:29.580165 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985b48f-d89c-42d0-9a6f-7ba1f69d0751 service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:29.580687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985b48f-d89c-42d0-9a6f-7ba1f69d0751 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:29.581495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2409c-24ac-4459-8562-2e6d0359a040 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:29.586567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-7985b48f-d89c-42d0-9a6f-7ba1f69d0751 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:29.590001 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724ddd0-4e17-4986-b546-353d337660c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:29.592548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724ddd0-4e17-4986-b546-353d337660c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:29.593162 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724ddd0-4e17-4986-b546-353d337660c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:29.593573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724ddd0-4e17-4986-b546-353d337660c6 admin admin] PATH_INFO: `/v3/projects/cb12b857df614208af36d0428e7352e0/users/f9eb722aa59341d192801c938b9883f4/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:29.617236 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724ddd0-4e17-4986-b546-353d337660c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb12b857df614208af36d0428e7352e0, user_id=f9eb722aa59341d192801c938b9883f4, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:29.620606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724ddd0-4e17-4986-b546-353d337660c6 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:29.647566 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 854/1687] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:29 2022] PUT /identity/v3/projects/cb12b857df614208af36d0428e7352e0/users/f9eb722aa59341d192801c938b9883f4/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:29.659604 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24110ad-9760-4ba5-b0ad-1c18ce57a27f None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:29.660094 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24110ad-9760-4ba5-b0ad-1c18ce57a27f None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:29.660479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24110ad-9760-4ba5-b0ad-1c18ce57a27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:29.721268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-a24110ad-9760-4ba5-b0ad-1c18ce57a27f None None] MFA Rules not processed for user `f9eb722aa59341d192801c938b9883f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:29.722713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a24110ad-9760-4ba5-b0ad-1c18ce57a27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:29.744709 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985b48f-d89c-42d0-9a6f-7ba1f69d0751 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:29.747071 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985b48f-d89c-42d0-9a6f-7ba1f69d0751 service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:29.804747 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 834/1688] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:29 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:17:29.809338 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be11104-38ed-42f7-8750-65f7619f79ae None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:29.810518 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be11104-38ed-42f7-8750-65f7619f79ae None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:29.810961 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be11104-38ed-42f7-8750-65f7619f79ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:29.888943 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-0be11104-38ed-42f7-8750-65f7619f79ae None None] MFA Rules not processed for user `f558b5ee5b5e43f4894d350fc73df0f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:29.890436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-0be11104-38ed-42f7-8750-65f7619f79ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:29.938921 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 855/1689] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:17:29.943842 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24110ad-9760-4ba5-b0ad-1c18ce57a27f None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:30.040431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24110ad-9760-4ba5-b0ad-1c18ce57a27f None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:30.047962 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0496d-1bdb-42a6-b531-83ee2bedb50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:30.048974 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0496d-1bdb-42a6-b531-83ee2bedb50e admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:30.049489 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0496d-1bdb-42a6-b531-83ee2bedb50e admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:30.049964 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0496d-1bdb-42a6-b531-83ee2bedb50e admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:30.050928 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0496d-1bdb-42a6-b531-83ee2bedb50e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:30.053458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0496d-1bdb-42a6-b531-83ee2bedb50e admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:30.081471 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 835/1690] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:30.084682 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be11104-38ed-42f7-8750-65f7619f79ae None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:30.086341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-0be11104-38ed-42f7-8750-65f7619f79ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:30.104651 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 856/1691] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:17:29 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:17:30.108980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0496d-1bdb-42a6-b531-83ee2bedb50e admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:30.173304 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:30.229471 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:30.346223 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be11104-38ed-42f7-8750-65f7619f79ae None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:30.435786 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0496d-1bdb-42a6-b531-83ee2bedb50e admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:30.459634 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901432e-cacd-4588-a9fb-378ca68f16db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:30.460585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901432e-cacd-4588-a9fb-378ca68f16db admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:30.460877 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901432e-cacd-4588-a9fb-378ca68f16db admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:30.461153 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901432e-cacd-4588-a9fb-378ca68f16db admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:30.464210 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901432e-cacd-4588-a9fb-378ca68f16db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:30.467081 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901432e-cacd-4588-a9fb-378ca68f16db admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:30.582684 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e9dbb-e260-4cfc-a8bf-e31829bbe67b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:30.583778 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e9dbb-e260-4cfc-a8bf-e31829bbe67b service nova] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:30.583778 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e9dbb-e260-4cfc-a8bf-e31829bbe67b service nova] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:30.583985 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e9dbb-e260-4cfc-a8bf-e31829bbe67b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:30.596051 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 857/1692] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:17:30 2022] POST /identity/v3/users => generated 293 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:30.597441 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901432e-cacd-4588-a9fb-378ca68f16db admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:30.603372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-8901432e-cacd-4588-a9fb-378ca68f16db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:30.646144 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901432e-cacd-4588-a9fb-378ca68f16db admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:30.656412 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d569546-c14e-48b3-b29b-cf481364c4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:30.657306 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d569546-c14e-48b3-b29b-cf481364c4a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:30.657647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d569546-c14e-48b3-b29b-cf481364c4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:30.657932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d569546-c14e-48b3-b29b-cf481364c4a5 admin admin] PATH_INFO: `/v3/projects/4fd1219cf7924a4d81a56e05f2011bfa` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:30.663170 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d569546-c14e-48b3-b29b-cf481364c4a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fd1219cf7924a4d81a56e05f2011bfa)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:30.665606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d569546-c14e-48b3-b29b-cf481364c4a5 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:30.848002 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-0d569546-c14e-48b3-b29b-cf481364c4a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd1219cf7924a4d81a56e05f2011bfa', 'request_id': 'req-0d569546-c14e-48b3-b29b-cf481364c4a5'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:30.861608 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e9dbb-e260-4cfc-a8bf-e31829bbe67b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:30.864594 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e9dbb-e260-4cfc-a8bf-e31829bbe67b service nova] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:30.867891 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-0d569546-c14e-48b3-b29b-cf481364c4a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd1219cf7924a4d81a56e05f2011bfa', 'request_id': 'req-0d569546-c14e-48b3-b29b-cf481364c4a5'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:30.887562 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 836/1693] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 805 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:30.889316 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e9dbb-e260-4cfc-a8bf-e31829bbe67b service nova] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:30.890388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-0d569546-c14e-48b3-b29b-cf481364c4a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd1219cf7924a4d81a56e05f2011bfa', 'request_id': 'req-0d569546-c14e-48b3-b29b-cf481364c4a5'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:30.908819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-0d569546-c14e-48b3-b29b-cf481364c4a5 admin admin] The token cache is being invalidate because project 4fd1219cf7924a4d81a56e05f2011bfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:17:30.909303 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-0d569546-c14e-48b3-b29b-cf481364c4a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:30.910747 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-0d569546-c14e-48b3-b29b-cf481364c4a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:30.913034 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 858/1694] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:17:30 2022] DELETE /identity/v3/projects/4fd1219cf7924a4d81a56e05f2011bfa => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:30.914953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e9dbb-e260-4cfc-a8bf-e31829bbe67b service nova] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:30.917478 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfb3d3-a468-4369-ae2f-bc4c305b1c4e None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:30.918390 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfb3d3-a468-4369-ae2f-bc4c305b1c4e None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:30.918865 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfb3d3-a468-4369-ae2f-bc4c305b1c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:30.942506 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-b9bfb3d3-a468-4369-ae2f-bc4c305b1c4e None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:30.944095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-b9bfb3d3-a468-4369-ae2f-bc4c305b1c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:31.031033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 859/1695] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:31.038451 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cadb8-8513-4987-9610-e3577e439057 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:31.039010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cadb8-8513-4987-9610-e3577e439057 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:31.039388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cadb8-8513-4987-9610-e3577e439057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:31.067728 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-5c8cadb8-8513-4987-9610-e3577e439057 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:31.069454 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-5c8cadb8-8513-4987-9610-e3577e439057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:31.081159 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 860/1696] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:17:31.085472 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8cadb8-8513-4987-9610-e3577e439057 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:31.089749 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd4a02-8331-4cc1-9307-2dd7a65134a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:31.091229 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd4a02-8331-4cc1-9307-2dd7a65134a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:31.091625 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd4a02-8331-4cc1-9307-2dd7a65134a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:31.092186 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd4a02-8331-4cc1-9307-2dd7a65134a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:31.093347 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd4a02-8331-4cc1-9307-2dd7a65134a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:31.096280 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd4a02-8331-4cc1-9307-2dd7a65134a9 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:31.132427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8cadb8-8513-4987-9610-e3577e439057 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:31.148630 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 837/1697] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:31.153947 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c45f1-a9e0-4a0c-8ab2-fa3567a9d264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:31.154948 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c45f1-a9e0-4a0c-8ab2-fa3567a9d264 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:31.155558 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c45f1-a9e0-4a0c-8ab2-fa3567a9d264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:31.155558 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c45f1-a9e0-4a0c-8ab2-fa3567a9d264 admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:31.156597 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c45f1-a9e0-4a0c-8ab2-fa3567a9d264 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:17:31.156772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c45f1-a9e0-4a0c-8ab2-fa3567a9d264 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:31.157526 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd4a02-8331-4cc1-9307-2dd7a65134a9 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:31.159234 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c45f1-a9e0-4a0c-8ab2-fa3567a9d264 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:31.160810 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-47cd4a02-8331-4cc1-9307-2dd7a65134a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:31.187184 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd4a02-8331-4cc1-9307-2dd7a65134a9 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:31.193156 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1b07f-8863-4172-9e7f-b55f465cd0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:31.194656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1b07f-8863-4172-9e7f-b55f465cd0e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:31.195096 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1b07f-8863-4172-9e7f-b55f465cd0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:31.195551 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1b07f-8863-4172-9e7f-b55f465cd0e4 admin admin] PATH_INFO: `/v3/projects/8f2d6f362a7046a59b51a86874f1363e/users/7530f65fc1a145f2899fba289b29af25/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:31.201829 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 861/1698] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:17:31.203831 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c45f1-a9e0-4a0c-8ab2-fa3567a9d264 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:31.217762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:31.228198 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1b07f-8863-4172-9e7f-b55f465cd0e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f2d6f362a7046a59b51a86874f1363e, user_id=7530f65fc1a145f2899fba289b29af25, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:31.231771 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1b07f-8863-4172-9e7f-b55f465cd0e4 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:31.237173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c45f1-a9e0-4a0c-8ab2-fa3567a9d264 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:31.244747 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ad9b8-aff6-4c65-a362-b0089c72cac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:31.245706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ad9b8-aff6-4c65-a362-b0089c72cac5 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:31.246063 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ad9b8-aff6-4c65-a362-b0089c72cac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:31.246382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ad9b8-aff6-4c65-a362-b0089c72cac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:31.251542 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ad9b8-aff6-4c65-a362-b0089c72cac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:31.257720 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ad9b8-aff6-4c65-a362-b0089c72cac5 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:31.266302 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 838/1699] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:31 2022] PUT /identity/v3/projects/8f2d6f362a7046a59b51a86874f1363e/users/7530f65fc1a145f2899fba289b29af25/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:31.270557 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1b07f-8863-4172-9e7f-b55f465cd0e4 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:31.285637 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:31.325920 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 862/1700] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:17:31 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:31.329776 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ad9b8-aff6-4c65-a362-b0089c72cac5 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:31.465213 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1b07f-8863-4172-9e7f-b55f465cd0e4 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:31.535014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ad9b8-aff6-4c65-a362-b0089c72cac5 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:31.547358 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f06b56-a9c7-4c97-867f-ba9022554adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:31.547836 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f06b56-a9c7-4c97-867f-ba9022554adc admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:31.548133 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f06b56-a9c7-4c97-867f-ba9022554adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:31.551601 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f06b56-a9c7-4c97-867f-ba9022554adc admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:31.551974 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f06b56-a9c7-4c97-867f-ba9022554adc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:31.556129 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f06b56-a9c7-4c97-867f-ba9022554adc admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:31.611763 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 863/1701] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:17:31 2022] POST /identity/v3/users => generated 285 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:17:31.613088 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f06b56-a9c7-4c97-867f-ba9022554adc admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:31.644449 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f06b56-a9c7-4c97-867f-ba9022554adc admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:31.651483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9ff56-3261-4dc9-8881-b43dacee9f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:31.652824 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9ff56-3261-4dc9-8881-b43dacee9f8e admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:31.653115 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9ff56-3261-4dc9-8881-b43dacee9f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:31.653960 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9ff56-3261-4dc9-8881-b43dacee9f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:31.662027 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d147d-1031-4395-8abc-1eb6fef75963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:31.662327 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9ff56-3261-4dc9-8881-b43dacee9f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:31.665460 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d147d-1031-4395-8abc-1eb6fef75963 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:31.666951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d147d-1031-4395-8abc-1eb6fef75963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:31.667278 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d147d-1031-4395-8abc-1eb6fef75963 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:31.667858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9ff56-3261-4dc9-8881-b43dacee9f8e admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:31.720239 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d147d-1031-4395-8abc-1eb6fef75963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:31.722356 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d147d-1031-4395-8abc-1eb6fef75963 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:31.734708 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 839/1702] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:31.739110 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9ff56-3261-4dc9-8881-b43dacee9f8e admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:31.753925 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9ff56-3261-4dc9-8881-b43dacee9f8e admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:31.759523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5361c2-927a-4abd-9eb7-ec9d90458f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:31.763768 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5361c2-927a-4abd-9eb7-ec9d90458f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:31.763768 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5361c2-927a-4abd-9eb7-ec9d90458f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:31.763768 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5361c2-927a-4abd-9eb7-ec9d90458f0b admin admin] PATH_INFO: `/v3/projects/8f2d6f362a7046a59b51a86874f1363e/users/7530f65fc1a145f2899fba289b29af25/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:31.765666 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 864/1703] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:31.767003 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d147d-1031-4395-8abc-1eb6fef75963 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:31.769689 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5361c2-927a-4abd-9eb7-ec9d90458f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f2d6f362a7046a59b51a86874f1363e, user_id=7530f65fc1a145f2899fba289b29af25, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:31.782498 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5361c2-927a-4abd-9eb7-ec9d90458f0b admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:31.795739 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d147d-1031-4395-8abc-1eb6fef75963 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:31.808913 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ee5c0-a989-40d3-b506-8cceccb650fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:31.809856 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ee5c0-a989-40d3-b506-8cceccb650fb admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:31.810374 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ee5c0-a989-40d3-b506-8cceccb650fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:31.810757 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ee5c0-a989-40d3-b506-8cceccb650fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:31.811657 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ee5c0-a989-40d3-b506-8cceccb650fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:31.817874 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ee5c0-a989-40d3-b506-8cceccb650fb admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:31.849232 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 865/1705] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:31.853787 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ee5c0-a989-40d3-b506-8cceccb650fb admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:31.858487 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 840/1705] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:31 2022] PUT /identity/v3/projects/8f2d6f362a7046a59b51a86874f1363e/users/7530f65fc1a145f2899fba289b29af25/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:31.861796 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488907d-bce6-4186-931c-a2e496a8cb7c None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:31.862439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488907d-bce6-4186-931c-a2e496a8cb7c None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:31.862439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488907d-bce6-4186-931c-a2e496a8cb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:31.899416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ee5c0-a989-40d3-b506-8cceccb650fb admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:31.946343 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-6488907d-bce6-4186-931c-a2e496a8cb7c None None] MFA Rules not processed for user `7530f65fc1a145f2899fba289b29af25`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:31.947866 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-6488907d-bce6-4186-931c-a2e496a8cb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:32.137506 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9746f-97ff-483e-9712-a873148c4fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:32.143775 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9746f-97ff-483e-9712-a873148c4fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:32.148728 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9746f-97ff-483e-9712-a873148c4fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:32.149180 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9746f-97ff-483e-9712-a873148c4fa2 admin admin] PATH_INFO: `/v3/projects/eb24e8bad70e4e9ca049f569411347bc/users/d8f2977579834bbda19a255938d730e3/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:32.167067 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 841/1706] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:32.167067 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731be25-d3ab-4564-9720-998c6491e7bb None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:32.167067 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731be25-d3ab-4564-9720-998c6491e7bb None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:32.167067 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731be25-d3ab-4564-9720-998c6491e7bb None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:32.167646 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 842/1707] 10.222.0.17 () {54 vars in 921 bytes} [Tue Jul 12 13:17:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:17:32.182076 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731be25-d3ab-4564-9720-998c6491e7bb None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:32.190236 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-3731be25-d3ab-4564-9720-998c6491e7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:32.193551 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9746f-97ff-483e-9712-a873148c4fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb24e8bad70e4e9ca049f569411347bc, user_id=d8f2977579834bbda19a255938d730e3, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:32.197622 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9746f-97ff-483e-9712-a873148c4fa2 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:32.216704 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:32.223250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 866/1708] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:31 2022] PUT /identity/v3/projects/eb24e8bad70e4e9ca049f569411347bc/users/d8f2977579834bbda19a255938d730e3/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:32.235337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482b3ec-01dd-48dc-984e-2acf222727ab None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:32.236471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482b3ec-01dd-48dc-984e-2acf222727ab None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:32.237139 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482b3ec-01dd-48dc-984e-2acf222727ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:32.306078 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-5482b3ec-01dd-48dc-984e-2acf222727ab None None] MFA Rules not processed for user `d8f2977579834bbda19a255938d730e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:32.307403 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-5482b3ec-01dd-48dc-984e-2acf222727ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:32.420009 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:32.436686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731be25-d3ab-4564-9720-998c6491e7bb None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:32.554469 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 867/1709] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:32.557161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f038c54-e2a0-4417-8ac5-9727b7bdc0b5 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:32.561557 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f038c54-e2a0-4417-8ac5-9727b7bdc0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:32.563181 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f038c54-e2a0-4417-8ac5-9727b7bdc0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:32.627283 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-9f038c54-e2a0-4417-8ac5-9727b7bdc0b5 None None] MFA Rules not processed for user `698828dd940f46e2b493ba55cd894eac`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:32.628755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-9f038c54-e2a0-4417-8ac5-9727b7bdc0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:32.665872 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ad316-5c9e-4b25-baa8-c8300aab8c19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:32.678667 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ad316-5c9e-4b25-baa8-c8300aab8c19 service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:32.679136 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ad316-5c9e-4b25-baa8-c8300aab8c19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:32.679440 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ad316-5c9e-4b25-baa8-c8300aab8c19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:32.869931 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 868/1710] 10.222.0.17 () {58 vars in 1018 bytes} [Tue Jul 12 13:17:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:32.871682 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f038c54-e2a0-4417-8ac5-9727b7bdc0b5 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:32.891112 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ad316-5c9e-4b25-baa8-c8300aab8c19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:32.893113 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ad316-5c9e-4b25-baa8-c8300aab8c19 service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:32.931582 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 843/1711] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:32 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 750 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:32.945511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ad316-5c9e-4b25-baa8-c8300aab8c19 service cinder] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:32.947732 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-169ad316-5c9e-4b25-baa8-c8300aab8c19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:32.988035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f038c54-e2a0-4417-8ac5-9727b7bdc0b5 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:32.992474 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ad316-5c9e-4b25-baa8-c8300aab8c19 service cinder] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:32.995459 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f80578-6259-498c-8af0-83fa4aea324b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:32.996279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f80578-6259-498c-8af0-83fa4aea324b admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:32.996705 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f80578-6259-498c-8af0-83fa4aea324b admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:32.997685 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f80578-6259-498c-8af0-83fa4aea324b admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:33.010351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f80578-6259-498c-8af0-83fa4aea324b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:33.010351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f80578-6259-498c-8af0-83fa4aea324b admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:33.019048 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bbe9b5-127b-45fb-814e-114cf271553a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '698828dd940f46e2b493ba55cd894eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:33.019598 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbe9b5-127b-45fb-814e-114cf271553a service placement] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:33.019867 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbe9b5-127b-45fb-814e-114cf271553a service placement] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:33.020164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbe9b5-127b-45fb-814e-114cf271553a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:33.042703 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 869/1712] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:17:32 2022] POST /identity/v3/projects => generated 367 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:33.046643 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bbe9b5-127b-45fb-814e-114cf271553a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:33.048271 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bbe9b5-127b-45fb-814e-114cf271553a service placement] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:33.051708 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f80578-6259-498c-8af0-83fa4aea324b admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:33.082659 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 844/1713] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:17:33.203972 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bbe9b5-127b-45fb-814e-114cf271553a service placement] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:33.205868 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-d5bbe9b5-127b-45fb-814e-114cf271553a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:33.253119 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bbe9b5-127b-45fb-814e-114cf271553a service placement] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:33.326883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:33.373036 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f80578-6259-498c-8af0-83fa4aea324b admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:33.390189 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a1e9f-8004-4e6e-a328-003d1f397b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:33.390966 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a1e9f-8004-4e6e-a328-003d1f397b37 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:33.391197 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a1e9f-8004-4e6e-a328-003d1f397b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:33.391484 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a1e9f-8004-4e6e-a328-003d1f397b37 admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:33.392513 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a1e9f-8004-4e6e-a328-003d1f397b37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:33.396651 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a1e9f-8004-4e6e-a328-003d1f397b37 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:33.476798 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:33.482968 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 870/1714] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:17:33 2022] POST /identity/v3/users => generated 290 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:33.484367 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a1e9f-8004-4e6e-a328-003d1f397b37 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:33.494126 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65461c3-cddd-4d89-931a-77f510f00ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:33.495469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65461c3-cddd-4d89-931a-77f510f00ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:33.495863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65461c3-cddd-4d89-931a-77f510f00ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:33.496245 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65461c3-cddd-4d89-931a-77f510f00ced admin admin] PATH_INFO: `/v3/users/2e87fb049d2a4265b2687bb195ce34b8` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:33.498708 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65461c3-cddd-4d89-931a-77f510f00ced admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e87fb049d2a4265b2687bb195ce34b8)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:33.503801 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65461c3-cddd-4d89-931a-77f510f00ced admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:33.510867 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a1e9f-8004-4e6e-a328-003d1f397b37 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:33.535184 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6defe-828e-40fa-902d-07ef829669da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:33.536052 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6defe-828e-40fa-902d-07ef829669da admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:33.536351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6defe-828e-40fa-902d-07ef829669da admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:33.537609 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6defe-828e-40fa-902d-07ef829669da admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:33.538308 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6defe-828e-40fa-902d-07ef829669da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:33.539990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6defe-828e-40fa-902d-07ef829669da admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:33.579969 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 871/1715] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:17:33.591607 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6defe-828e-40fa-902d-07ef829669da admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:33.614911 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d65461c3-cddd-4d89-931a-77f510f00ced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e87fb049d2a4265b2687bb195ce34b8'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:33.618562 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d65461c3-cddd-4d89-931a-77f510f00ced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e87fb049d2a4265b2687bb195ce34b8'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:33.629413 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6defe-828e-40fa-902d-07ef829669da admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:33.645703 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d65461c3-cddd-4d89-931a-77f510f00ced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e87fb049d2a4265b2687bb195ce34b8'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:33.652711 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1443a-8ca3-4d05-b8bb-53c346bc52fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:33.655982 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1443a-8ca3-4d05-b8bb-53c346bc52fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:33.659488 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1443a-8ca3-4d05-b8bb-53c346bc52fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:33.659826 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1443a-8ca3-4d05-b8bb-53c346bc52fa admin admin] PATH_INFO: `/v3/projects/b7fabf88029246b797eae7307e9be593/users/5c11b414d3f344259ea0e8bd77923a9f/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:33.670894 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d65461c3-cddd-4d89-931a-77f510f00ced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e87fb049d2a4265b2687bb195ce34b8'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:33.719227 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1443a-8ca3-4d05-b8bb-53c346bc52fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7fabf88029246b797eae7307e9be593, user_id=5c11b414d3f344259ea0e8bd77923a9f, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:33.719908 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d65461c3-cddd-4d89-931a-77f510f00ced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e87fb049d2a4265b2687bb195ce34b8'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:33.726824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1443a-8ca3-4d05-b8bb-53c346bc52fa admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:33.742195 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 845/1716] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:17:33 2022] DELETE /identity/v3/users/2e87fb049d2a4265b2687bb195ce34b8 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:17:33.766243 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 872/1717] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:33 2022] PUT /identity/v3/projects/b7fabf88029246b797eae7307e9be593/users/5c11b414d3f344259ea0e8bd77923a9f/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:33.770276 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65461c3-cddd-4d89-931a-77f510f00ced admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:33.771974 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-d65461c3-cddd-4d89-931a-77f510f00ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:33.858658 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65461c3-cddd-4d89-931a-77f510f00ced admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:33.870432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1443a-8ca3-4d05-b8bb-53c346bc52fa admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:33.872937 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-4da1443a-8ca3-4d05-b8bb-53c346bc52fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:34.027213 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9cf91-c5b0-4d21-a5bd-f5786f49ff47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:34.027901 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9cf91-c5b0-4d21-a5bd-f5786f49ff47 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:34.028277 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9cf91-c5b0-4d21-a5bd-f5786f49ff47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:34.029048 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9cf91-c5b0-4d21-a5bd-f5786f49ff47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:34.030028 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9cf91-c5b0-4d21-a5bd-f5786f49ff47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:34.036341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9cf91-c5b0-4d21-a5bd-f5786f49ff47 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:34.046434 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1443a-8ca3-4d05-b8bb-53c346bc52fa admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:34.072760 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d06cf-f0c7-479e-93fa-150272209f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:34.073678 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d06cf-f0c7-479e-93fa-150272209f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:34.073968 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d06cf-f0c7-479e-93fa-150272209f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:34.077218 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d06cf-f0c7-479e-93fa-150272209f96 admin admin] PATH_INFO: `/v3/users/f9eb722aa59341d192801c938b9883f4` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:34.080947 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 846/1718] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:34.081120 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d06cf-f0c7-479e-93fa-150272209f96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9eb722aa59341d192801c938b9883f4)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:34.084689 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9cf91-c5b0-4d21-a5bd-f5786f49ff47 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:34.088586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d06cf-f0c7-479e-93fa-150272209f96 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:34.118615 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9cf91-c5b0-4d21-a5bd-f5786f49ff47 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:34.136257 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184ffaf-cc1e-4fac-a623-f5f18137382c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:34.137201 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184ffaf-cc1e-4fac-a623-f5f18137382c admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:34.137492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184ffaf-cc1e-4fac-a623-f5f18137382c admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:34.139280 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184ffaf-cc1e-4fac-a623-f5f18137382c admin admin] PATH_INFO: `/v3/projects/b7fabf88029246b797eae7307e9be593/users/5c11b414d3f344259ea0e8bd77923a9f/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:34.147495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184ffaf-cc1e-4fac-a623-f5f18137382c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7fabf88029246b797eae7307e9be593, user_id=5c11b414d3f344259ea0e8bd77923a9f, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:34.150268 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184ffaf-cc1e-4fac-a623-f5f18137382c admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:34.191338 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 847/1719] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:34 2022] PUT /identity/v3/projects/b7fabf88029246b797eae7307e9be593/users/5c11b414d3f344259ea0e8bd77923a9f/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:34.202907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc9041-edff-4bd2-b106-d83ce777ebbd None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:34.203226 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc9041-edff-4bd2-b106-d83ce777ebbd None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:34.203491 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc9041-edff-4bd2-b106-d83ce777ebbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:34.228607 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-916d06cf-f0c7-479e-93fa-150272209f96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9eb722aa59341d192801c938b9883f4'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:34.240406 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:34.242478 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-916d06cf-f0c7-479e-93fa-150272209f96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9eb722aa59341d192801c938b9883f4'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:34.266493 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-916d06cf-f0c7-479e-93fa-150272209f96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9eb722aa59341d192801c938b9883f4'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:34.267275 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-916d06cf-f0c7-479e-93fa-150272209f96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9eb722aa59341d192801c938b9883f4'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:34.283036 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-916d06cf-f0c7-479e-93fa-150272209f96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9eb722aa59341d192801c938b9883f4'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:34.291257 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 873/1720] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:17:33 2022] DELETE /identity/v3/users/f9eb722aa59341d192801c938b9883f4 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:34.292295 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d06cf-f0c7-479e-93fa-150272209f96 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:34.299692 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-0acc9041-edff-4bd2-b106-d83ce777ebbd None None] MFA Rules not processed for user `5c11b414d3f344259ea0e8bd77923a9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:34.301281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-0acc9041-edff-4bd2-b106-d83ce777ebbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:34.315953 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-916d06cf-f0c7-479e-93fa-150272209f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:34.365757 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:34.471090 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d06cf-f0c7-479e-93fa-150272209f96 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:34.484152 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc25127-7692-4cdc-b2f8-25762ce41d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:34.485153 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc25127-7692-4cdc-b2f8-25762ce41d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:34.487151 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc25127-7692-4cdc-b2f8-25762ce41d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:34.490481 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc25127-7692-4cdc-b2f8-25762ce41d4b admin admin] PATH_INFO: `/v3/projects/ba1ac451b19a4daaaa87204e5f76ecb9` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:34.498476 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc25127-7692-4cdc-b2f8-25762ce41d4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba1ac451b19a4daaaa87204e5f76ecb9)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:34.500658 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc25127-7692-4cdc-b2f8-25762ce41d4b admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:34.536953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 848/1721] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:34 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:17:34.538345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e514d42-b915-4b59-8330-3bbba6b0b06e None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:34.538641 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e514d42-b915-4b59-8330-3bbba6b0b06e None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:34.538927 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e514d42-b915-4b59-8330-3bbba6b0b06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:34.609333 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-5e514d42-b915-4b59-8330-3bbba6b0b06e None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:34.621945 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-7fc25127-7692-4cdc-b2f8-25762ce41d4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba1ac451b19a4daaaa87204e5f76ecb9', 'request_id': 'req-7fc25127-7692-4cdc-b2f8-25762ce41d4b'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:34.623208 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-5e514d42-b915-4b59-8330-3bbba6b0b06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:34.640446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-7fc25127-7692-4cdc-b2f8-25762ce41d4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba1ac451b19a4daaaa87204e5f76ecb9', 'request_id': 'req-7fc25127-7692-4cdc-b2f8-25762ce41d4b'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:34.665631 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-7fc25127-7692-4cdc-b2f8-25762ce41d4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba1ac451b19a4daaaa87204e5f76ecb9', 'request_id': 'req-7fc25127-7692-4cdc-b2f8-25762ce41d4b'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:34.699065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-7fc25127-7692-4cdc-b2f8-25762ce41d4b admin admin] The token cache is being invalidate because project ba1ac451b19a4daaaa87204e5f76ecb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:17:34.699344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-7fc25127-7692-4cdc-b2f8-25762ce41d4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:34.705292 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-7fc25127-7692-4cdc-b2f8-25762ce41d4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:34.711556 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 874/1722] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:17:34 2022] DELETE /identity/v3/projects/ba1ac451b19a4daaaa87204e5f76ecb9 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:34.714629 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc25127-7692-4cdc-b2f8-25762ce41d4b admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:34.720737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-7fc25127-7692-4cdc-b2f8-25762ce41d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:34.805965 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 849/1723] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:34.809426 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e514d42-b915-4b59-8330-3bbba6b0b06e None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:34.812696 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-5e514d42-b915-4b59-8330-3bbba6b0b06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:34.846714 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e514d42-b915-4b59-8330-3bbba6b0b06e None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:34.861042 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11f6b8-de21-4aab-a919-7c512b494d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:34.862214 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11f6b8-de21-4aab-a919-7c512b494d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:34.862509 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11f6b8-de21-4aab-a919-7c512b494d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:34.862792 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11f6b8-de21-4aab-a919-7c512b494d71 admin admin] PATH_INFO: `/v3/users/df9fa85fad864a0ba09513da7d54ddd4` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:34.869032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11f6b8-de21-4aab-a919-7c512b494d71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df9fa85fad864a0ba09513da7d54ddd4)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:34.873687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11f6b8-de21-4aab-a919-7c512b494d71 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:34.886965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc25127-7692-4cdc-b2f8-25762ce41d4b admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:34.898896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccd42e-8df0-4990-874a-bad94ccb7658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:34.900904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccd42e-8df0-4990-874a-bad94ccb7658 service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:34.901431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccd42e-8df0-4990-874a-bad94ccb7658 service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:34.902394 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccd42e-8df0-4990-874a-bad94ccb7658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:34.910304 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-fcccd42e-8df0-4990-874a-bad94ccb7658 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:34.987382 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-1b11f6b8-de21-4aab-a919-7c512b494d71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df9fa85fad864a0ba09513da7d54ddd4'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:34.988125 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-1b11f6b8-de21-4aab-a919-7c512b494d71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df9fa85fad864a0ba09513da7d54ddd4'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:34.997627 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-1b11f6b8-de21-4aab-a919-7c512b494d71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df9fa85fad864a0ba09513da7d54ddd4'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:35.020647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-1b11f6b8-de21-4aab-a919-7c512b494d71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df9fa85fad864a0ba09513da7d54ddd4'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:35.067523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-1b11f6b8-de21-4aab-a919-7c512b494d71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df9fa85fad864a0ba09513da7d54ddd4'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:35.085400 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 850/1724] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:17:34 2022] DELETE /identity/v3/users/df9fa85fad864a0ba09513da7d54ddd4 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:35.087923 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11f6b8-de21-4aab-a919-7c512b494d71 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:35.090491 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-1b11f6b8-de21-4aab-a919-7c512b494d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:35.101842 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccd42e-8df0-4990-874a-bad94ccb7658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:35.102682 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccd42e-8df0-4990-874a-bad94ccb7658 service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:35.104449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:35.128535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 875/1725] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:34 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:35.314240 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11f6b8-de21-4aab-a919-7c512b494d71 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:35.331647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb17b6-407b-4760-b779-c5476f914c99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:35.335741 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb17b6-407b-4760-b779-c5476f914c99 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:35.336166 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb17b6-407b-4760-b779-c5476f914c99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:35.336556 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb17b6-407b-4760-b779-c5476f914c99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:35.343835 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-cedb17b6-407b-4760-b779-c5476f914c99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:35.377804 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b60648-a295-4a74-a9ae-109c81d4acd3 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:35.378460 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b60648-a295-4a74-a9ae-109c81d4acd3 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:35.378460 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b60648-a295-4a74-a9ae-109c81d4acd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:35.404303 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:35.413170 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-88b60648-a295-4a74-a9ae-109c81d4acd3 None None] MFA Rules not processed for user `f558b5ee5b5e43f4894d350fc73df0f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:35.419242 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-88b60648-a295-4a74-a9ae-109c81d4acd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:35.547885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb17b6-407b-4760-b779-c5476f914c99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:35.550371 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb17b6-407b-4760-b779-c5476f914c99 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:35.570421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 876/1726] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:17:35.571537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b60648-a295-4a74-a9ae-109c81d4acd3 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:35.573703 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 851/1727] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:35.582184 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-88b60648-a295-4a74-a9ae-109c81d4acd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:35.633216 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b60648-a295-4a74-a9ae-109c81d4acd3 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:35.654978 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048c18b-a57c-4b3d-8396-67a78e5b1060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:35.656498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048c18b-a57c-4b3d-8396-67a78e5b1060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:35.657977 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048c18b-a57c-4b3d-8396-67a78e5b1060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:35.658507 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048c18b-a57c-4b3d-8396-67a78e5b1060 admin admin] PATH_INFO: `/v3/users/14401b0867914d5993612d99c1b39b05` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:35.666680 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048c18b-a57c-4b3d-8396-67a78e5b1060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14401b0867914d5993612d99c1b39b05)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:35.696153 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048c18b-a57c-4b3d-8396-67a78e5b1060 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:35.819771 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-d048c18b-a57c-4b3d-8396-67a78e5b1060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14401b0867914d5993612d99c1b39b05'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:35.850473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-d048c18b-a57c-4b3d-8396-67a78e5b1060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14401b0867914d5993612d99c1b39b05'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:35.863810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-d048c18b-a57c-4b3d-8396-67a78e5b1060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14401b0867914d5993612d99c1b39b05'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:35.864828 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-d048c18b-a57c-4b3d-8396-67a78e5b1060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14401b0867914d5993612d99c1b39b05'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:35.888933 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-d048c18b-a57c-4b3d-8396-67a78e5b1060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14401b0867914d5993612d99c1b39b05'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:35.898786 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 877/1728] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:17:35 2022] DELETE /identity/v3/users/14401b0867914d5993612d99c1b39b05 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:35.905991 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88377f59-4ab1-41ae-887f-744ced2bbf22 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:35.906441 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88377f59-4ab1-41ae-887f-744ced2bbf22 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:35.906947 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88377f59-4ab1-41ae-887f-744ced2bbf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:35.944257 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-88377f59-4ab1-41ae-887f-744ced2bbf22 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:35.946357 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-88377f59-4ab1-41ae-887f-744ced2bbf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:36.139694 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048c18b-a57c-4b3d-8396-67a78e5b1060 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:36.141461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-d048c18b-a57c-4b3d-8396-67a78e5b1060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:36.188911 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 852/1729] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:17:36.386504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88377f59-4ab1-41ae-887f-744ced2bbf22 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:36.390144 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-88377f59-4ab1-41ae-887f-744ced2bbf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:36.409623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048c18b-a57c-4b3d-8396-67a78e5b1060 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:36.426915 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0255f29-94da-43fb-bedf-2127f7a71a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:36.428332 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0255f29-94da-43fb-bedf-2127f7a71a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:36.428930 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0255f29-94da-43fb-bedf-2127f7a71a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:36.430267 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0255f29-94da-43fb-bedf-2127f7a71a6c admin admin] PATH_INFO: `/v3/projects/e68721d260f94d6c801570d383fb4fa2` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:36.435470 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0255f29-94da-43fb-bedf-2127f7a71a6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e68721d260f94d6c801570d383fb4fa2)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:36.439291 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0255f29-94da-43fb-bedf-2127f7a71a6c admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:36.550052 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:36.597278 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88377f59-4ab1-41ae-887f-744ced2bbf22 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:36.611873 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b0255f29-94da-43fb-bedf-2127f7a71a6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e68721d260f94d6c801570d383fb4fa2', 'request_id': 'req-b0255f29-94da-43fb-bedf-2127f7a71a6c'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:36.624136 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:36.631287 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b0255f29-94da-43fb-bedf-2127f7a71a6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e68721d260f94d6c801570d383fb4fa2', 'request_id': 'req-b0255f29-94da-43fb-bedf-2127f7a71a6c'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:36.650667 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b0255f29-94da-43fb-bedf-2127f7a71a6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e68721d260f94d6c801570d383fb4fa2', 'request_id': 'req-b0255f29-94da-43fb-bedf-2127f7a71a6c'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:36.694426 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b0255f29-94da-43fb-bedf-2127f7a71a6c admin admin] The token cache is being invalidate because project e68721d260f94d6c801570d383fb4fa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:17:36.706025 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b0255f29-94da-43fb-bedf-2127f7a71a6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:36.707213 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b0255f29-94da-43fb-bedf-2127f7a71a6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:36.709337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 878/1730] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:17:36 2022] DELETE /identity/v3/projects/e68721d260f94d6c801570d383fb4fa2 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:17:36.715135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d824290-ea48-42d2-874f-d7a631891d9d None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:36.716390 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d824290-ea48-42d2-874f-d7a631891d9d None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:36.717475 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d824290-ea48-42d2-874f-d7a631891d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:36.741162 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ee579-50f2-408f-89e4-83d50faab2eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:36.742093 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ee579-50f2-408f-89e4-83d50faab2eb service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:36.742639 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ee579-50f2-408f-89e4-83d50faab2eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:36.742927 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ee579-50f2-408f-89e4-83d50faab2eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:36.744850 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-527ee579-50f2-408f-89e4-83d50faab2eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:36.760326 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-1d824290-ea48-42d2-874f-d7a631891d9d None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:36.763183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-1d824290-ea48-42d2-874f-d7a631891d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:36.903082 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 879/1731] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:17:36.908707 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ee579-50f2-408f-89e4-83d50faab2eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:36.910389 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ee579-50f2-408f-89e4-83d50faab2eb service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:36.915812 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bd2ed-fc10-4122-8cd5-2ad33a6e58ba None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:36.916109 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bd2ed-fc10-4122-8cd5-2ad33a6e58ba None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:36.918479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bd2ed-fc10-4122-8cd5-2ad33a6e58ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:36.948048 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-d02bd2ed-fc10-4122-8cd5-2ad33a6e58ba None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:36.948754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-d02bd2ed-fc10-4122-8cd5-2ad33a6e58ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:36.951969 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 853/1732] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:36.966446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 880/1733] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:36.975717 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ee579-50f2-408f-89e4-83d50faab2eb service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:36.994463 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ee579-50f2-408f-89e4-83d50faab2eb service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:37.000944 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc42e2-43aa-466a-ae70-c0379fc77dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:37.001902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc42e2-43aa-466a-ae70-c0379fc77dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:37.002715 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc42e2-43aa-466a-ae70-c0379fc77dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:37.003202 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc42e2-43aa-466a-ae70-c0379fc77dc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:37.004161 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc42e2-43aa-466a-ae70-c0379fc77dc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:17:37.004668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc42e2-43aa-466a-ae70-c0379fc77dc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:37.006610 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc42e2-43aa-466a-ae70-c0379fc77dc7 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:37.023704 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 854/1734] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:17:37.027822 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02bd2ed-fc10-4122-8cd5-2ad33a6e58ba None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:37.039893 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02bd2ed-fc10-4122-8cd5-2ad33a6e58ba None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:37.050756 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13200590-cd95-4ab8-9130-1ed83367471f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:37.051907 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13200590-cd95-4ab8-9130-1ed83367471f admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:37.053019 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13200590-cd95-4ab8-9130-1ed83367471f admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:37.053631 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13200590-cd95-4ab8-9130-1ed83367471f admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:37.055010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13200590-cd95-4ab8-9130-1ed83367471f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:37.058964 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13200590-cd95-4ab8-9130-1ed83367471f admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:37.151038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc42e2-43aa-466a-ae70-c0379fc77dc7 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:37.160197 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 881/1735] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:17:37 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:37.166577 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc42e2-43aa-466a-ae70-c0379fc77dc7 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:37.230202 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d56b28-6cbd-4458-81eb-5b928f4d66bc None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:37.230629 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d56b28-6cbd-4458-81eb-5b928f4d66bc None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:37.231009 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d56b28-6cbd-4458-81eb-5b928f4d66bc None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:37.233251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 882/1736] 10.222.0.17 () {54 vars in 912 bytes} [Tue Jul 12 13:17:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:17:37.244168 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a16ca-3713-4263-8a7d-b1aece313057 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:37.246823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a16ca-3713-4263-8a7d-b1aece313057 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:37.251877 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a16ca-3713-4263-8a7d-b1aece313057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:37.301421 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219a734-3928-48fd-960a-b5af3e01ba7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:37.302226 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219a734-3928-48fd-960a-b5af3e01ba7a admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:37.302515 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219a734-3928-48fd-960a-b5af3e01ba7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:37.302974 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219a734-3928-48fd-960a-b5af3e01ba7a admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:37.303843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219a734-3928-48fd-960a-b5af3e01ba7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:37.306047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219a734-3928-48fd-960a-b5af3e01ba7a admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:37.373014 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 855/1737] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:17:37 2022] POST /identity/v3/users => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:37.373867 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219a734-3928-48fd-960a-b5af3e01ba7a admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:37.376664 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-760a16ca-3713-4263-8a7d-b1aece313057 None None] MFA Rules not processed for user `0f39694be5f447f9a25dacf7e4c99a4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:37.378664 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-760a16ca-3713-4263-8a7d-b1aece313057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:37.399011 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219a734-3928-48fd-960a-b5af3e01ba7a admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:37.411243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599fd21-28ae-4a98-ae47-091017fe0c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:37.412480 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599fd21-28ae-4a98-ae47-091017fe0c9b admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:37.412902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599fd21-28ae-4a98-ae47-091017fe0c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:37.413341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599fd21-28ae-4a98-ae47-091017fe0c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:37.414433 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599fd21-28ae-4a98-ae47-091017fe0c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:37.416464 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599fd21-28ae-4a98-ae47-091017fe0c9b admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:37.456924 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 856/1738] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:37.460794 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599fd21-28ae-4a98-ae47-091017fe0c9b admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:37.487534 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599fd21-28ae-4a98-ae47-091017fe0c9b admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:37.499508 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb18975-6bd2-4576-b85e-e120d4e7749f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:37.502466 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb18975-6bd2-4576-b85e-e120d4e7749f admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:37.502760 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb18975-6bd2-4576-b85e-e120d4e7749f admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:37.503721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb18975-6bd2-4576-b85e-e120d4e7749f admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:37.505387 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb18975-6bd2-4576-b85e-e120d4e7749f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:37.505816 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 883/1739] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Jul 12 13:17:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:17:37.509936 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb18975-6bd2-4576-b85e-e120d4e7749f admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:37.517659 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a16ca-3713-4263-8a7d-b1aece313057 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:37.519444 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-760a16ca-3713-4263-8a7d-b1aece313057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:37.545491 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 857/1740] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:37.546899 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb18975-6bd2-4576-b85e-e120d4e7749f admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:37.554278 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a16ca-3713-4263-8a7d-b1aece313057 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:37.566204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c638136-d8a9-4569-a18c-67b7d6bd9223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:37.567622 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c638136-d8a9-4569-a18c-67b7d6bd9223 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:37.568532 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c638136-d8a9-4569-a18c-67b7d6bd9223 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:37.569214 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c638136-d8a9-4569-a18c-67b7d6bd9223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:37.579314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c638136-d8a9-4569-a18c-67b7d6bd9223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:37.581145 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c638136-d8a9-4569-a18c-67b7d6bd9223 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:37.585964 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb18975-6bd2-4576-b85e-e120d4e7749f admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:37.593057 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 884/1741] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:17:37.602859 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdce12-f634-4a56-92e5-b3c511df049c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:37.605112 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdce12-f634-4a56-92e5-b3c511df049c admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:37.607504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdce12-f634-4a56-92e5-b3c511df049c admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:37.607902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdce12-f634-4a56-92e5-b3c511df049c admin admin] PATH_INFO: `/v3/projects/787c4b9b4e74467fa39b57d0a7b2803b/users/3e93e0354f5842b1a05ea7cbe548436f/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:37.643029 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:37.651677 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdce12-f634-4a56-92e5-b3c511df049c admin admin] RBAC: Authorizing `identity:create_grant(project_id=787c4b9b4e74467fa39b57d0a7b2803b, user_id=3e93e0354f5842b1a05ea7cbe548436f, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:37.661985 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdce12-f634-4a56-92e5-b3c511df049c admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:37.713932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef9a0a-e23f-451d-9cb5-7af2e3b884c7 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:37.714560 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef9a0a-e23f-451d-9cb5-7af2e3b884c7 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:37.715138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 858/1742] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:37 2022] PUT /identity/v3/projects/787c4b9b4e74467fa39b57d0a7b2803b/users/3e93e0354f5842b1a05ea7cbe548436f/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:37.715613 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef9a0a-e23f-451d-9cb5-7af2e3b884c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:37.755998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:37.771168 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-a6ef9a0a-e23f-451d-9cb5-7af2e3b884c7 None None] MFA Rules not processed for user `3e93e0354f5842b1a05ea7cbe548436f`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:37.772932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a6ef9a0a-e23f-451d-9cb5-7af2e3b884c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:37.875169 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdce12-f634-4a56-92e5-b3c511df049c admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:37.877681 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-bfbdce12-f634-4a56-92e5-b3c511df049c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:37.910701 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 885/1743] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:17:37.915967 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef9a0a-e23f-451d-9cb5-7af2e3b884c7 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:38.010210 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef9a0a-e23f-451d-9cb5-7af2e3b884c7 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:38.019856 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049b592-1da5-4838-a239-22e5699b8dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:38.020816 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049b592-1da5-4838-a239-22e5699b8dda admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:38.021291 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049b592-1da5-4838-a239-22e5699b8dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:38.021678 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049b592-1da5-4838-a239-22e5699b8dda admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:38.022553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049b592-1da5-4838-a239-22e5699b8dda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:38.026634 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049b592-1da5-4838-a239-22e5699b8dda admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:38.060388 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdce12-f634-4a56-92e5-b3c511df049c admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:38.068321 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16627512-5339-40c9-8d4c-ab407bbbff80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:38.070248 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16627512-5339-40c9-8d4c-ab407bbbff80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:38.070883 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16627512-5339-40c9-8d4c-ab407bbbff80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:38.071688 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 886/1744] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:17:37 2022] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:38.076412 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16627512-5339-40c9-8d4c-ab407bbbff80 admin admin] PATH_INFO: `/v3/users/d8f2977579834bbda19a255938d730e3` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:38.077415 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049b592-1da5-4838-a239-22e5699b8dda admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:38.078472 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16627512-5339-40c9-8d4c-ab407bbbff80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8f2977579834bbda19a255938d730e3)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:38.080780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16627512-5339-40c9-8d4c-ab407bbbff80 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:38.081715 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a049b592-1da5-4838-a239-22e5699b8dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:38.182581 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049b592-1da5-4838-a239-22e5699b8dda admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:38.185297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-16627512-5339-40c9-8d4c-ab407bbbff80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8f2977579834bbda19a255938d730e3'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:38.186291 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-16627512-5339-40c9-8d4c-ab407bbbff80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8f2977579834bbda19a255938d730e3'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:38.189688 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76373ea6-d104-4803-b634-e79d7fe0e810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:38.190954 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76373ea6-d104-4803-b634-e79d7fe0e810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:38.191294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76373ea6-d104-4803-b634-e79d7fe0e810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:38.192279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76373ea6-d104-4803-b634-e79d7fe0e810 admin admin] PATH_INFO: `/v3/projects/51442b29253a484394162f95c7200941` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:38.193904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76373ea6-d104-4803-b634-e79d7fe0e810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51442b29253a484394162f95c7200941)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:38.196034 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76373ea6-d104-4803-b634-e79d7fe0e810 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:38.203268 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-16627512-5339-40c9-8d4c-ab407bbbff80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8f2977579834bbda19a255938d730e3'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:38.219263 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-16627512-5339-40c9-8d4c-ab407bbbff80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8f2977579834bbda19a255938d730e3'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:38.236831 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:38.251007 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-16627512-5339-40c9-8d4c-ab407bbbff80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8f2977579834bbda19a255938d730e3'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:38.265115 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-76373ea6-d104-4803-b634-e79d7fe0e810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51442b29253a484394162f95c7200941', 'request_id': 'req-76373ea6-d104-4803-b634-e79d7fe0e810'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:38.269110 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 859/1745] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:17:37 2022] DELETE /identity/v3/users/d8f2977579834bbda19a255938d730e3 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:17:38.269997 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16627512-5339-40c9-8d4c-ab407bbbff80 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:38.273981 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-16627512-5339-40c9-8d4c-ab407bbbff80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:38.280219 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-76373ea6-d104-4803-b634-e79d7fe0e810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51442b29253a484394162f95c7200941', 'request_id': 'req-76373ea6-d104-4803-b634-e79d7fe0e810'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:38.292128 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-76373ea6-d104-4803-b634-e79d7fe0e810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51442b29253a484394162f95c7200941', 'request_id': 'req-76373ea6-d104-4803-b634-e79d7fe0e810'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:38.317436 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-76373ea6-d104-4803-b634-e79d7fe0e810 admin admin] The token cache is being invalidate because project 51442b29253a484394162f95c7200941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:17:38.317918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-76373ea6-d104-4803-b634-e79d7fe0e810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:38.319230 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-76373ea6-d104-4803-b634-e79d7fe0e810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:38.321294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 887/1746] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:17:38 2022] DELETE /identity/v3/projects/51442b29253a484394162f95c7200941 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:38.327079 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc4ff5-b397-4f9d-94a2-a6df0d8cdfd1 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:38.327537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc4ff5-b397-4f9d-94a2-a6df0d8cdfd1 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:38.327826 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc4ff5-b397-4f9d-94a2-a6df0d8cdfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:38.352425 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-08bc4ff5-b397-4f9d-94a2-a6df0d8cdfd1 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:38.353817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-08bc4ff5-b397-4f9d-94a2-a6df0d8cdfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:38.361945 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16627512-5339-40c9-8d4c-ab407bbbff80 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:38.367877 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 888/1747] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:38.369191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc4ff5-b397-4f9d-94a2-a6df0d8cdfd1 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:38.370803 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-08bc4ff5-b397-4f9d-94a2-a6df0d8cdfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:38.371784 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafac5f5-e890-4100-9a46-83a26c522f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:38.372542 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafac5f5-e890-4100-9a46-83a26c522f87 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:38.372845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafac5f5-e890-4100-9a46-83a26c522f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:38.373134 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafac5f5-e890-4100-9a46-83a26c522f87 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:38.373849 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafac5f5-e890-4100-9a46-83a26c522f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:38.377864 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafac5f5-e890-4100-9a46-83a26c522f87 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:38.393289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc4ff5-b397-4f9d-94a2-a6df0d8cdfd1 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:38.400365 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddccdf-dcaa-44f5-917c-bcef6bdfc836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:38.401473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddccdf-dcaa-44f5-917c-bcef6bdfc836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:38.401932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddccdf-dcaa-44f5-917c-bcef6bdfc836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:38.402425 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddccdf-dcaa-44f5-917c-bcef6bdfc836 admin admin] PATH_INFO: `/v3/users/344ed3d915d64f9b868e551bbaa042ab` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:38.404381 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ddccdf-dcaa-44f5-917c-bcef6bdfc836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=344ed3d915d64f9b868e551bbaa042ab)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:38.408255 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:38.413528 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ddccdf-dcaa-44f5-917c-bcef6bdfc836 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:38.418097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 860/1748] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:17:38 2022] POST /identity/v3/users => generated 295 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:38.427222 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafac5f5-e890-4100-9a46-83a26c522f87 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:38.435943 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-dafac5f5-e890-4100-9a46-83a26c522f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:38.596647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-78ddccdf-dcaa-44f5-917c-bcef6bdfc836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '344ed3d915d64f9b868e551bbaa042ab'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:38.598595 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafac5f5-e890-4100-9a46-83a26c522f87 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:38.609495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97b6af-a510-4f26-b49f-ec5642c35ef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:38.611503 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97b6af-a510-4f26-b49f-ec5642c35ef3 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:38.611869 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-78ddccdf-dcaa-44f5-917c-bcef6bdfc836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '344ed3d915d64f9b868e551bbaa042ab'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:38.612113 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97b6af-a510-4f26-b49f-ec5642c35ef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:38.613441 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97b6af-a510-4f26-b49f-ec5642c35ef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:38.636010 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a97b6af-a510-4f26-b49f-ec5642c35ef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:38.636950 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-78ddccdf-dcaa-44f5-917c-bcef6bdfc836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '344ed3d915d64f9b868e551bbaa042ab'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:38.638404 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-78ddccdf-dcaa-44f5-917c-bcef6bdfc836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '344ed3d915d64f9b868e551bbaa042ab'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:38.639608 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a97b6af-a510-4f26-b49f-ec5642c35ef3 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:38.683245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-78ddccdf-dcaa-44f5-917c-bcef6bdfc836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '344ed3d915d64f9b868e551bbaa042ab'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:38.685150 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 861/1749] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:38.692610 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97b6af-a510-4f26-b49f-ec5642c35ef3 service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:38.705291 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-8a97b6af-a510-4f26-b49f-ec5642c35ef3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:38.711967 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 889/1750] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:17:38 2022] DELETE /identity/v3/users/344ed3d915d64f9b868e551bbaa042ab => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:38.712737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5fa5b-67a4-46c9-a5ea-4c6801df5b92 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:38.713133 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5fa5b-67a4-46c9-a5ea-4c6801df5b92 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:38.713519 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5fa5b-67a4-46c9-a5ea-4c6801df5b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:38.737641 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97b6af-a510-4f26-b49f-ec5642c35ef3 service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:38.815935 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-0cf5fa5b-67a4-46c9-a5ea-4c6801df5b92 None None] MFA Rules not processed for user `155dfbdcace94d9d93d8d4758fbcb372`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:38.817362 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-0cf5fa5b-67a4-46c9-a5ea-4c6801df5b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:38.885721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5fbbed-7de1-49ff-ac47-75495f2e125b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:38.887211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fbbed-7de1-49ff-ac47-75495f2e125b admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:38.891026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fbbed-7de1-49ff-ac47-75495f2e125b admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:38.891485 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fbbed-7de1-49ff-ac47-75495f2e125b admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:38.893577 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5fbbed-7de1-49ff-ac47-75495f2e125b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:38.910252 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5fbbed-7de1-49ff-ac47-75495f2e125b admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:38.926414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 862/1751] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:38.930543 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb145f-4dac-45df-8b9d-ca6b7089547d None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:38.930543 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb145f-4dac-45df-8b9d-ca6b7089547d None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:38.930543 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb145f-4dac-45df-8b9d-ca6b7089547d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:38.993209 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-c5cb145f-4dac-45df-8b9d-ca6b7089547d None None] MFA Rules not processed for user `ca43e59f48fd49e18e1359e9d26c5bab`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:38.995049 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-c5cb145f-4dac-45df-8b9d-ca6b7089547d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:39.010532 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 890/1752] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:39.011759 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5fa5b-67a4-46c9-a5ea-4c6801df5b92 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:39.017069 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-0cf5fa5b-67a4-46c9-a5ea-4c6801df5b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:39.044401 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5fa5b-67a4-46c9-a5ea-4c6801df5b92 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:39.052836 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fa67f-b3da-4cb5-8a5a-46f2fc031f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:39.054263 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fa67f-b3da-4cb5-8a5a-46f2fc031f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:39.054674 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fa67f-b3da-4cb5-8a5a-46f2fc031f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:39.055688 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fa67f-b3da-4cb5-8a5a-46f2fc031f9d admin admin] PATH_INFO: `/v3/projects/cb12b857df614208af36d0428e7352e0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:39.057776 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fa67f-b3da-4cb5-8a5a-46f2fc031f9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb12b857df614208af36d0428e7352e0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:39.060705 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fa67f-b3da-4cb5-8a5a-46f2fc031f9d admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:39.065841 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:39.149466 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f94fa67f-b3da-4cb5-8a5a-46f2fc031f9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb12b857df614208af36d0428e7352e0', 'request_id': 'req-f94fa67f-b3da-4cb5-8a5a-46f2fc031f9d'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:39.167285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 863/1753] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:39.168426 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb145f-4dac-45df-8b9d-ca6b7089547d None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:39.168642 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f94fa67f-b3da-4cb5-8a5a-46f2fc031f9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb12b857df614208af36d0428e7352e0', 'request_id': 'req-f94fa67f-b3da-4cb5-8a5a-46f2fc031f9d'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:39.175745 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-c5cb145f-4dac-45df-8b9d-ca6b7089547d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:39.188185 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f94fa67f-b3da-4cb5-8a5a-46f2fc031f9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb12b857df614208af36d0428e7352e0', 'request_id': 'req-f94fa67f-b3da-4cb5-8a5a-46f2fc031f9d'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:39.217881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f94fa67f-b3da-4cb5-8a5a-46f2fc031f9d admin admin] The token cache is being invalidate because project cb12b857df614208af36d0428e7352e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:17:39.218317 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f94fa67f-b3da-4cb5-8a5a-46f2fc031f9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:39.221762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f94fa67f-b3da-4cb5-8a5a-46f2fc031f9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:39.223971 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 891/1754] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:17:39 2022] DELETE /identity/v3/projects/cb12b857df614208af36d0428e7352e0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:39.224815 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fa67f-b3da-4cb5-8a5a-46f2fc031f9d admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:39.228924 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-f94fa67f-b3da-4cb5-8a5a-46f2fc031f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:39.270538 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:39.328624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fa67f-b3da-4cb5-8a5a-46f2fc031f9d admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:39.335492 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fafea9-0927-4d02-b591-e731fbabf164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:39.336680 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fafea9-0927-4d02-b591-e731fbabf164 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:39.337085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fafea9-0927-4d02-b591-e731fbabf164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:39.337472 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fafea9-0927-4d02-b591-e731fbabf164 admin admin] PATH_INFO: `/v3/projects/dcd2d9e065424837af0c8a653f9bc895/users/08a2b92646a24fc99082ace1847af662/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:39.357949 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fafea9-0927-4d02-b591-e731fbabf164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd2d9e065424837af0c8a653f9bc895, user_id=08a2b92646a24fc99082ace1847af662, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:39.361433 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fafea9-0927-4d02-b591-e731fbabf164 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:39.373661 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb145f-4dac-45df-8b9d-ca6b7089547d None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:39.382673 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 892/1755] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:39 2022] PUT /identity/v3/projects/dcd2d9e065424837af0c8a653f9bc895/users/08a2b92646a24fc99082ace1847af662/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:39.386525 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580527f2-1e39-469b-bc3d-98cdcd49e2e9 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:39.388404 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580527f2-1e39-469b-bc3d-98cdcd49e2e9 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:39.392330 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580527f2-1e39-469b-bc3d-98cdcd49e2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:39.418482 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-580527f2-1e39-469b-bc3d-98cdcd49e2e9 None None] MFA Rules not processed for user `155dfbdcace94d9d93d8d4758fbcb372`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:39.420495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-580527f2-1e39-469b-bc3d-98cdcd49e2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:39.533804 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc162f38-1300-4c8a-b59a-c061b30a93de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '698828dd940f46e2b493ba55cd894eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:39.534827 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc162f38-1300-4c8a-b59a-c061b30a93de service placement] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:39.535736 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc162f38-1300-4c8a-b59a-c061b30a93de service placement] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:39.536234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc162f38-1300-4c8a-b59a-c061b30a93de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:39.539134 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-dc162f38-1300-4c8a-b59a-c061b30a93de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:39.554762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc162f38-1300-4c8a-b59a-c061b30a93de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:39.556873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc162f38-1300-4c8a-b59a-c061b30a93de service placement] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:39.562514 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 893/1756] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:39.562514 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a561fc1-2538-48f7-ad1b-7b6fb41c58ca None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:39.563864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a561fc1-2538-48f7-ad1b-7b6fb41c58ca None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:39.565361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a561fc1-2538-48f7-ad1b-7b6fb41c58ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:39.606249 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 864/1757] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:39.607536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc162f38-1300-4c8a-b59a-c061b30a93de service placement] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:39.609784 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-dc162f38-1300-4c8a-b59a-c061b30a93de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:39.618424 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-2a561fc1-2538-48f7-ad1b-7b6fb41c58ca None None] MFA Rules not processed for user `ca43e59f48fd49e18e1359e9d26c5bab`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:39.619983 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-2a561fc1-2538-48f7-ad1b-7b6fb41c58ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:39.652383 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:39.754353 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 894/1758] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:39.756249 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a561fc1-2538-48f7-ad1b-7b6fb41c58ca None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:39.849858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc162f38-1300-4c8a-b59a-c061b30a93de service placement] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:39.884948 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339ed9e-f4f3-4811-97ec-5d0c245f4cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:39.885848 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339ed9e-f4f3-4811-97ec-5d0c245f4cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:39.885848 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339ed9e-f4f3-4811-97ec-5d0c245f4cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:39.885848 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339ed9e-f4f3-4811-97ec-5d0c245f4cca admin admin] PATH_INFO: `/v3/users/7530f65fc1a145f2899fba289b29af25` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:39.893185 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339ed9e-f4f3-4811-97ec-5d0c245f4cca admin admin] RBAC: Authorizing `identity:delete_user(user_id=7530f65fc1a145f2899fba289b29af25)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:39.895837 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339ed9e-f4f3-4811-97ec-5d0c245f4cca admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:39.951219 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a561fc1-2538-48f7-ad1b-7b6fb41c58ca None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:39.974276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b410ab-3fe9-43fd-bee0-b9cb61efda4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:39.975208 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b410ab-3fe9-43fd-bee0-b9cb61efda4c admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:39.977050 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b410ab-3fe9-43fd-bee0-b9cb61efda4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:39.977683 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b410ab-3fe9-43fd-bee0-b9cb61efda4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:39.980904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b410ab-3fe9-43fd-bee0-b9cb61efda4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:39.987540 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b410ab-3fe9-43fd-bee0-b9cb61efda4c admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:40.014053 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 895/1759] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:40.017967 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a339ed9e-f4f3-4811-97ec-5d0c245f4cca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7530f65fc1a145f2899fba289b29af25'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:40.018634 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b410ab-3fe9-43fd-bee0-b9cb61efda4c admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:40.020497 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a339ed9e-f4f3-4811-97ec-5d0c245f4cca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7530f65fc1a145f2899fba289b29af25'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:40.023664 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-84b410ab-3fe9-43fd-bee0-b9cb61efda4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:40.032772 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a339ed9e-f4f3-4811-97ec-5d0c245f4cca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7530f65fc1a145f2899fba289b29af25'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:40.051004 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a339ed9e-f4f3-4811-97ec-5d0c245f4cca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7530f65fc1a145f2899fba289b29af25'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:40.052415 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:40.066545 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b410ab-3fe9-43fd-bee0-b9cb61efda4c admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:40.080730 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd479bdb-0760-4acb-b9cb-8585463949ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:40.080891 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a339ed9e-f4f3-4811-97ec-5d0c245f4cca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7530f65fc1a145f2899fba289b29af25'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:40.085098 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd479bdb-0760-4acb-b9cb-8585463949ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:40.085759 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd479bdb-0760-4acb-b9cb-8585463949ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:40.086669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd479bdb-0760-4acb-b9cb-8585463949ea admin admin] PATH_INFO: `/v3/projects/eb24e8bad70e4e9ca049f569411347bc` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:40.092917 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd479bdb-0760-4acb-b9cb-8585463949ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb24e8bad70e4e9ca049f569411347bc)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:40.095657 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 865/1760] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:17:39 2022] DELETE /identity/v3/users/7530f65fc1a145f2899fba289b29af25 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:40.096839 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339ed9e-f4f3-4811-97ec-5d0c245f4cca admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:40.099339 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-a339ed9e-f4f3-4811-97ec-5d0c245f4cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:40.109146 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd479bdb-0760-4acb-b9cb-8585463949ea admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:40.251959 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-cd479bdb-0760-4acb-b9cb-8585463949ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb24e8bad70e4e9ca049f569411347bc', 'request_id': 'req-cd479bdb-0760-4acb-b9cb-8585463949ea'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:40.264233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-cd479bdb-0760-4acb-b9cb-8585463949ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb24e8bad70e4e9ca049f569411347bc', 'request_id': 'req-cd479bdb-0760-4acb-b9cb-8585463949ea'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:40.277488 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-cd479bdb-0760-4acb-b9cb-8585463949ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb24e8bad70e4e9ca049f569411347bc', 'request_id': 'req-cd479bdb-0760-4acb-b9cb-8585463949ea'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:40.302931 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-cd479bdb-0760-4acb-b9cb-8585463949ea admin admin] The token cache is being invalidate because project eb24e8bad70e4e9ca049f569411347bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:17:40.303305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-cd479bdb-0760-4acb-b9cb-8585463949ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:40.304009 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-cd479bdb-0760-4acb-b9cb-8585463949ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:40.309191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 896/1761] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:17:40 2022] DELETE /identity/v3/projects/eb24e8bad70e4e9ca049f569411347bc => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:40.309191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd479bdb-0760-4acb-b9cb-8585463949ea admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:40.310412 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-cd479bdb-0760-4acb-b9cb-8585463949ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:40.369793 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339ed9e-f4f3-4811-97ec-5d0c245f4cca admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:40.417020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:40.459556 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd479bdb-0760-4acb-b9cb-8585463949ea admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:40.472254 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edc574-98bc-478d-a8b6-fba9a12deae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:40.473931 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edc574-98bc-478d-a8b6-fba9a12deae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:40.474256 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edc574-98bc-478d-a8b6-fba9a12deae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:40.474551 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edc574-98bc-478d-a8b6-fba9a12deae0 admin admin] PATH_INFO: `/v3/projects/0171a2f7eea34627a9af459954ddad7f` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:40.478223 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87edc574-98bc-478d-a8b6-fba9a12deae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0171a2f7eea34627a9af459954ddad7f)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:40.481946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87edc574-98bc-478d-a8b6-fba9a12deae0 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:40.493380 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c4437-1e45-4ffd-952d-862cb8d24dd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:40.494175 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c4437-1e45-4ffd-952d-862cb8d24dd1 service nova] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:40.494481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c4437-1e45-4ffd-952d-862cb8d24dd1 service nova] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:40.494766 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c4437-1e45-4ffd-952d-862cb8d24dd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:40.498240 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-5c7c4437-1e45-4ffd-952d-862cb8d24dd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:40.589382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-87edc574-98bc-478d-a8b6-fba9a12deae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0171a2f7eea34627a9af459954ddad7f', 'request_id': 'req-87edc574-98bc-478d-a8b6-fba9a12deae0'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:40.611734 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-87edc574-98bc-478d-a8b6-fba9a12deae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0171a2f7eea34627a9af459954ddad7f', 'request_id': 'req-87edc574-98bc-478d-a8b6-fba9a12deae0'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:40.623755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-87edc574-98bc-478d-a8b6-fba9a12deae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0171a2f7eea34627a9af459954ddad7f', 'request_id': 'req-87edc574-98bc-478d-a8b6-fba9a12deae0'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:40.644938 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-87edc574-98bc-478d-a8b6-fba9a12deae0 admin admin] The token cache is being invalidate because project 0171a2f7eea34627a9af459954ddad7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:17:40.645757 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-87edc574-98bc-478d-a8b6-fba9a12deae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:40.646545 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-87edc574-98bc-478d-a8b6-fba9a12deae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:40.648677 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c4437-1e45-4ffd-952d-862cb8d24dd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:40.651735 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c4437-1e45-4ffd-952d-862cb8d24dd1 service nova] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:40.651903 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 897/1762] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:17:40 2022] DELETE /identity/v3/projects/0171a2f7eea34627a9af459954ddad7f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:40.656933 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edc574-98bc-478d-a8b6-fba9a12deae0 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:40.658568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-87edc574-98bc-478d-a8b6-fba9a12deae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:40.678702 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 866/1763] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:40.682674 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c4437-1e45-4ffd-952d-862cb8d24dd1 service nova] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:40.689522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-5c7c4437-1e45-4ffd-952d-862cb8d24dd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:40.726740 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c4437-1e45-4ffd-952d-862cb8d24dd1 service nova] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:40.763250 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:40.795868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edc574-98bc-478d-a8b6-fba9a12deae0 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:40.813276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52bb90f-aff3-4fa1-a8b5-73a4482142c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:40.815869 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bb90f-aff3-4fa1-a8b5-73a4482142c2 service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:40.816233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bb90f-aff3-4fa1-a8b5-73a4482142c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:40.816525 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bb90f-aff3-4fa1-a8b5-73a4482142c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:40.821084 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a52bb90f-aff3-4fa1-a8b5-73a4482142c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:40.872922 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37b9ac-5dac-4795-b84c-b21b6bc43aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:40.874161 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37b9ac-5dac-4795-b84c-b21b6bc43aed admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:40.878413 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37b9ac-5dac-4795-b84c-b21b6bc43aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:40.878706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37b9ac-5dac-4795-b84c-b21b6bc43aed admin admin] PATH_INFO: `/v3/projects/dcd2d9e065424837af0c8a653f9bc895/users/08a2b92646a24fc99082ace1847af662/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:40.883030 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37b9ac-5dac-4795-b84c-b21b6bc43aed admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd2d9e065424837af0c8a653f9bc895, user_id=08a2b92646a24fc99082ace1847af662, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:40.889255 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37b9ac-5dac-4795-b84c-b21b6bc43aed admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:40.919833 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 867/1764] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:40 2022] PUT /identity/v3/projects/dcd2d9e065424837af0c8a653f9bc895/users/08a2b92646a24fc99082ace1847af662/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:40.920974 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33eb128-6a43-4f7c-b701-7c475e224702 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:40.921271 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33eb128-6a43-4f7c-b701-7c475e224702 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:40.921558 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33eb128-6a43-4f7c-b701-7c475e224702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:40.998060 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52bb90f-aff3-4fa1-a8b5-73a4482142c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:41.002095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52bb90f-aff3-4fa1-a8b5-73a4482142c2 service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:41.018598 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-d33eb128-6a43-4f7c-b701-7c475e224702 None None] MFA Rules not processed for user `48f4be3ee79e42aeb67d87c06803c031`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:41.023314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-d33eb128-6a43-4f7c-b701-7c475e224702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:41.025148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 898/1765] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:41.041066 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52bb90f-aff3-4fa1-a8b5-73a4482142c2 service nova] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:41.043085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a52bb90f-aff3-4fa1-a8b5-73a4482142c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:41.090696 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52bb90f-aff3-4fa1-a8b5-73a4482142c2 service nova] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:41.125261 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:41.150392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 868/1766] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:41.152117 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68d99f-12df-44e7-8235-59d6979ba5fb None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:41.152421 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68d99f-12df-44e7-8235-59d6979ba5fb None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:41.153370 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68d99f-12df-44e7-8235-59d6979ba5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:41.179037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-4c68d99f-12df-44e7-8235-59d6979ba5fb None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:41.180449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-4c68d99f-12df-44e7-8235-59d6979ba5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:41.232894 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8832025-f9d6-4aa7-b0e7-76ca544ece8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:41.241211 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8832025-f9d6-4aa7-b0e7-76ca544ece8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:41.241668 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8832025-f9d6-4aa7-b0e7-76ca544ece8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:41.242063 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8832025-f9d6-4aa7-b0e7-76ca544ece8f admin admin] PATH_INFO: `/v3/users/5c11b414d3f344259ea0e8bd77923a9f` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:41.244318 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8832025-f9d6-4aa7-b0e7-76ca544ece8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c11b414d3f344259ea0e8bd77923a9f)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:41.247964 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8832025-f9d6-4aa7-b0e7-76ca544ece8f admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:41.284301 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 869/1767] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:41.288020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfbf28-1639-409e-98f8-2dc2ab3d544d None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:41.289315 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfbf28-1639-409e-98f8-2dc2ab3d544d None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:41.290090 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfbf28-1639-409e-98f8-2dc2ab3d544d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:41.339578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-7fbfbf28-1639-409e-98f8-2dc2ab3d544d None None] MFA Rules not processed for user `08a2b92646a24fc99082ace1847af662`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:41.340863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-7fbfbf28-1639-409e-98f8-2dc2ab3d544d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:41.368411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b8832025-f9d6-4aa7-b0e7-76ca544ece8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c11b414d3f344259ea0e8bd77923a9f'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:41.383675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b8832025-f9d6-4aa7-b0e7-76ca544ece8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c11b414d3f344259ea0e8bd77923a9f'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:41.402443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b8832025-f9d6-4aa7-b0e7-76ca544ece8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c11b414d3f344259ea0e8bd77923a9f'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:41.403557 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b8832025-f9d6-4aa7-b0e7-76ca544ece8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c11b414d3f344259ea0e8bd77923a9f'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:41.410792 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:41.444400 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b8832025-f9d6-4aa7-b0e7-76ca544ece8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c11b414d3f344259ea0e8bd77923a9f'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:41.490406 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 899/1768] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:17:41 2022] DELETE /identity/v3/users/5c11b414d3f344259ea0e8bd77923a9f => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:41.493544 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8832025-f9d6-4aa7-b0e7-76ca544ece8f admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:41.508933 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-b8832025-f9d6-4aa7-b0e7-76ca544ece8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:41.591077 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 870/1769] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:41.591077 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d361f-060b-4018-ae9f-cd5c17df25fe None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:41.591077 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d361f-060b-4018-ae9f-cd5c17df25fe None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:41.592138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d361f-060b-4018-ae9f-cd5c17df25fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:41.634008 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-5b3d361f-060b-4018-ae9f-cd5c17df25fe None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:41.638307 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-5b3d361f-060b-4018-ae9f-cd5c17df25fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:41.791480 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8832025-f9d6-4aa7-b0e7-76ca544ece8f admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:41.798806 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae61fb0-0b06-4948-afb1-6834533988b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:41.799834 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae61fb0-0b06-4948-afb1-6834533988b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:41.800119 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae61fb0-0b06-4948-afb1-6834533988b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:41.800421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae61fb0-0b06-4948-afb1-6834533988b2 admin admin] PATH_INFO: `/v3/projects/8f2d6f362a7046a59b51a86874f1363e` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:41.804398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae61fb0-0b06-4948-afb1-6834533988b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f2d6f362a7046a59b51a86874f1363e)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:41.806519 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae61fb0-0b06-4948-afb1-6834533988b2 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:41.855562 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 871/1770] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:41.864118 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d361f-060b-4018-ae9f-cd5c17df25fe None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:41.868063 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-5b3d361f-060b-4018-ae9f-cd5c17df25fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:41.893508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:41.925057 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-eae61fb0-0b06-4948-afb1-6834533988b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f2d6f362a7046a59b51a86874f1363e', 'request_id': 'req-eae61fb0-0b06-4948-afb1-6834533988b2'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:41.938711 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-eae61fb0-0b06-4948-afb1-6834533988b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f2d6f362a7046a59b51a86874f1363e', 'request_id': 'req-eae61fb0-0b06-4948-afb1-6834533988b2'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:41.958593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-eae61fb0-0b06-4948-afb1-6834533988b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f2d6f362a7046a59b51a86874f1363e', 'request_id': 'req-eae61fb0-0b06-4948-afb1-6834533988b2'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:41.973692 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-eae61fb0-0b06-4948-afb1-6834533988b2 admin admin] The token cache is being invalidate because project 8f2d6f362a7046a59b51a86874f1363e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:17:41.973992 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-eae61fb0-0b06-4948-afb1-6834533988b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:41.977253 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-eae61fb0-0b06-4948-afb1-6834533988b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:41.985334 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 900/1771] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:17:41 2022] DELETE /identity/v3/projects/8f2d6f362a7046a59b51a86874f1363e => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:41.986684 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae61fb0-0b06-4948-afb1-6834533988b2 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:41.987150 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d361f-060b-4018-ae9f-cd5c17df25fe None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:41.993672 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-eae61fb0-0b06-4948-afb1-6834533988b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:42.064387 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc33eaf-d6da-46cc-bc11-c58c2a82c5cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:42.065803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc33eaf-d6da-46cc-bc11-c58c2a82c5cb service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:42.066243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc33eaf-d6da-46cc-bc11-c58c2a82c5cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:42.066631 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc33eaf-d6da-46cc-bc11-c58c2a82c5cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:42.069796 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-2fc33eaf-d6da-46cc-bc11-c58c2a82c5cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:42.130157 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:42.159674 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae61fb0-0b06-4948-afb1-6834533988b2 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:42.174463 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ddb05-5266-4327-ae75-a226657d5de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:42.174896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ddb05-5266-4327-ae75-a226657d5de4 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:42.175313 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ddb05-5266-4327-ae75-a226657d5de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:42.175449 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ddb05-5266-4327-ae75-a226657d5de4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:42.176251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ddb05-5266-4327-ae75-a226657d5de4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:17:42.176468 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ddb05-5266-4327-ae75-a226657d5de4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:42.180506 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ddb05-5266-4327-ae75-a226657d5de4 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:42.207818 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc33eaf-d6da-46cc-bc11-c58c2a82c5cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:42.208829 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc33eaf-d6da-46cc-bc11-c58c2a82c5cb service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:42.214191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 901/1772] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:17:42.214191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12351494-e9c9-474d-84f1-890cee0080e7 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:42.214191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12351494-e9c9-474d-84f1-890cee0080e7 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:42.214191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12351494-e9c9-474d-84f1-890cee0080e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:42.229765 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 872/1773] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:42.239230 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8e879-a7c3-4000-9427-806d9597dfbf None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:42.239523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8e879-a7c3-4000-9427-806d9597dfbf None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:42.239803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8e879-a7c3-4000-9427-806d9597dfbf None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:42.241218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 873/1774] 10.222.0.17 () {54 vars in 912 bytes} [Tue Jul 12 13:17:42 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:17:42.241953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8e879-a7c3-4000-9427-806d9597dfbf None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:42.279698 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-12351494-e9c9-474d-84f1-890cee0080e7 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:42.289816 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-12351494-e9c9-474d-84f1-890cee0080e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:42.292689 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8e879-a7c3-4000-9427-806d9597dfbf None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:42.314277 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e872f92-06dc-4371-ae0e-2ff023449e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:42.317798 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e872f92-06dc-4371-ae0e-2ff023449e01 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:42.318098 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e872f92-06dc-4371-ae0e-2ff023449e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:42.319407 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e872f92-06dc-4371-ae0e-2ff023449e01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:42.321734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e872f92-06dc-4371-ae0e-2ff023449e01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:42.332052 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 902/1775] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:42.333551 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e872f92-06dc-4371-ae0e-2ff023449e01 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:42.334845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95eb06c-4a66-4d3b-a3d2-f69fe42efa97 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:42.335491 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95eb06c-4a66-4d3b-a3d2-f69fe42efa97 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:42.336473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95eb06c-4a66-4d3b-a3d2-f69fe42efa97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:42.385894 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-c95eb06c-4a66-4d3b-a3d2-f69fe42efa97 None None] MFA Rules not processed for user `0f39694be5f447f9a25dacf7e4c99a4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:42.389222 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-c95eb06c-4a66-4d3b-a3d2-f69fe42efa97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:42.400877 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 874/1776] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:17:42 2022] POST /identity/v3/projects => generated 407 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:42.407980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e872f92-06dc-4371-ae0e-2ff023449e01 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:42.412588 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-6e872f92-06dc-4371-ae0e-2ff023449e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:42.645459 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 903/1777] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Jul 12 13:17:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:42.649390 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c88261-63f2-4ef8-9633-bd7afca8f327 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:42.651799 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c88261-63f2-4ef8-9633-bd7afca8f327 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:42.652145 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c88261-63f2-4ef8-9633-bd7afca8f327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:42.686169 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e872f92-06dc-4371-ae0e-2ff023449e01 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:42.692779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-e3c88261-63f2-4ef8-9633-bd7afca8f327 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:42.712211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc177b32-743e-4a30-81e6-03a8963b2116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:42.712725 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-e3c88261-63f2-4ef8-9633-bd7afca8f327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:42.713540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc177b32-743e-4a30-81e6-03a8963b2116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:42.715754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc177b32-743e-4a30-81e6-03a8963b2116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:42.717938 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc177b32-743e-4a30-81e6-03a8963b2116 admin admin] PATH_INFO: `/v3/projects/b7fabf88029246b797eae7307e9be593` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:42.722746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc177b32-743e-4a30-81e6-03a8963b2116 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7fabf88029246b797eae7307e9be593)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:42.732615 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc177b32-743e-4a30-81e6-03a8963b2116 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:42.752889 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 904/1778] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:42.756680 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c88261-63f2-4ef8-9633-bd7afca8f327 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:42.806061 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c88261-63f2-4ef8-9633-bd7afca8f327 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:42.823000 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf71eb-4947-47f3-946d-4dfa84ef2c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:42.823974 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf71eb-4947-47f3-946d-4dfa84ef2c48 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:42.824359 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf71eb-4947-47f3-946d-4dfa84ef2c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:42.824744 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf71eb-4947-47f3-946d-4dfa84ef2c48 admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:42.826505 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf71eb-4947-47f3-946d-4dfa84ef2c48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:42.828771 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf71eb-4947-47f3-946d-4dfa84ef2c48 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:42.897490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 905/1779] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:17:42 2022] POST /identity/v3/users => generated 304 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:42.902552 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf71eb-4947-47f3-946d-4dfa84ef2c48 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:42.909745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-e9bf71eb-4947-47f3-946d-4dfa84ef2c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:42.992956 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-dc177b32-743e-4a30-81e6-03a8963b2116 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7fabf88029246b797eae7307e9be593', 'request_id': 'req-dc177b32-743e-4a30-81e6-03a8963b2116'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:43.015721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-dc177b32-743e-4a30-81e6-03a8963b2116 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7fabf88029246b797eae7307e9be593', 'request_id': 'req-dc177b32-743e-4a30-81e6-03a8963b2116'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:43.031120 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-dc177b32-743e-4a30-81e6-03a8963b2116 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7fabf88029246b797eae7307e9be593', 'request_id': 'req-dc177b32-743e-4a30-81e6-03a8963b2116'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:43.038845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:43.074061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-dc177b32-743e-4a30-81e6-03a8963b2116 admin admin] The token cache is being invalidate because project b7fabf88029246b797eae7307e9be593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:17:43.074365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-dc177b32-743e-4a30-81e6-03a8963b2116 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:43.075725 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-dc177b32-743e-4a30-81e6-03a8963b2116 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:43.078220 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 875/1780] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:17:42 2022] DELETE /identity/v3/projects/b7fabf88029246b797eae7307e9be593 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:43.086169 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc177b32-743e-4a30-81e6-03a8963b2116 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:43.088255 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-dc177b32-743e-4a30-81e6-03a8963b2116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:43.124150 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf71eb-4947-47f3-946d-4dfa84ef2c48 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:43.216963 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:43.250843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc177b32-743e-4a30-81e6-03a8963b2116 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:43.256569 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03ac6c-fbf4-4eae-af7e-da6703398a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:43.258672 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03ac6c-fbf4-4eae-af7e-da6703398a9f admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:43.258966 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03ac6c-fbf4-4eae-af7e-da6703398a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:43.259426 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03ac6c-fbf4-4eae-af7e-da6703398a9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:43.260261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03ac6c-fbf4-4eae-af7e-da6703398a9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:17:43.260578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03ac6c-fbf4-4eae-af7e-da6703398a9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:43.262474 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03ac6c-fbf4-4eae-af7e-da6703398a9f admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:43.282446 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 876/1781] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:17:43.282446 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03ac6c-fbf4-4eae-af7e-da6703398a9f admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:43.288790 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-fe03ac6c-fbf4-4eae-af7e-da6703398a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:43.320346 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f192f3e-afff-4dfc-a577-8cfd448d5c89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:43.321260 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f192f3e-afff-4dfc-a577-8cfd448d5c89 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:43.321768 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f192f3e-afff-4dfc-a577-8cfd448d5c89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:43.322278 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f192f3e-afff-4dfc-a577-8cfd448d5c89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:43.331545 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03ac6c-fbf4-4eae-af7e-da6703398a9f admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:43.338140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-9f192f3e-afff-4dfc-a577-8cfd448d5c89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:43.344736 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ae5a3-5418-4655-b4ac-74b7569cbbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:43.345454 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ae5a3-5418-4655-b4ac-74b7569cbbf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:43.345772 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ae5a3-5418-4655-b4ac-74b7569cbbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:43.346063 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ae5a3-5418-4655-b4ac-74b7569cbbf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:43.349716 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ae5a3-5418-4655-b4ac-74b7569cbbf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:43.356951 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ae5a3-5418-4655-b4ac-74b7569cbbf9 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:43.386887 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 877/1782] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:43.388064 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f192f3e-afff-4dfc-a577-8cfd448d5c89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:43.389764 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f192f3e-afff-4dfc-a577-8cfd448d5c89 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:43.391319 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ae5a3-5418-4655-b4ac-74b7569cbbf9 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:43.395706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-b58ae5a3-5418-4655-b4ac-74b7569cbbf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:43.414620 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 906/1783] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:43.421628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208bb6e-e98b-4e27-a4be-269bcf34d649 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:43.422810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208bb6e-e98b-4e27-a4be-269bcf34d649 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:43.423151 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208bb6e-e98b-4e27-a4be-269bcf34d649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:43.472085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-9208bb6e-e98b-4e27-a4be-269bcf34d649 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:43.473436 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-9208bb6e-e98b-4e27-a4be-269bcf34d649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:43.505884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 907/1784] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:43.507096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208bb6e-e98b-4e27-a4be-269bcf34d649 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:43.522249 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208bb6e-e98b-4e27-a4be-269bcf34d649 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:43.533981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c90a06-d1e7-4a62-80cc-66dd1492e5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:43.534837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c90a06-d1e7-4a62-80cc-66dd1492e5f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:43.535133 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c90a06-d1e7-4a62-80cc-66dd1492e5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:43.535421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c90a06-d1e7-4a62-80cc-66dd1492e5f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:43.536201 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c90a06-d1e7-4a62-80cc-66dd1492e5f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:43.538891 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c90a06-d1e7-4a62-80cc-66dd1492e5f3 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:43.575485 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ae5a3-5418-4655-b4ac-74b7569cbbf9 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:43.584085 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1164bf-0bef-4407-b625-d88196ef2361 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:43.584927 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1164bf-0bef-4407-b625-d88196ef2361 service nova] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:43.585325 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1164bf-0bef-4407-b625-d88196ef2361 service nova] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:43.585757 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1164bf-0bef-4407-b625-d88196ef2361 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:43.587960 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-8d1164bf-0bef-4407-b625-d88196ef2361 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:43.596261 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 908/1785] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:17:43 2022] POST /identity/v3/projects => generated 357 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:43.597287 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c90a06-d1e7-4a62-80cc-66dd1492e5f3 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:43.666805 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1164bf-0bef-4407-b625-d88196ef2361 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:43.669335 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1164bf-0bef-4407-b625-d88196ef2361 service nova] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:43.694304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 878/1786] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:43.699713 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ab068-d5d0-4f0d-bca2-9f0693ee4e93 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:43.700072 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ab068-d5d0-4f0d-bca2-9f0693ee4e93 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:43.700547 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ab068-d5d0-4f0d-bca2-9f0693ee4e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:43.759014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c90a06-d1e7-4a62-80cc-66dd1492e5f3 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:43.773271 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b8a8c-41ea-4166-82de-f42317812690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:43.774060 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b8a8c-41ea-4166-82de-f42317812690 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:43.774383 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b8a8c-41ea-4166-82de-f42317812690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:43.774918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b8a8c-41ea-4166-82de-f42317812690 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:43.775533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b8a8c-41ea-4166-82de-f42317812690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:43.777185 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b8a8c-41ea-4166-82de-f42317812690 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:43.803393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 909/1787] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:43.811465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ba6c4-2abf-43d3-b4bb-06b238dbfe12 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:43.813433 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ba6c4-2abf-43d3-b4bb-06b238dbfe12 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:43.814392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ba6c4-2abf-43d3-b4bb-06b238dbfe12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:43.830421 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-dc9ab068-d5d0-4f0d-bca2-9f0693ee4e93 None None] MFA Rules not processed for user `72f556aac45c460cb573498aab7590fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:43.832728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-dc9ab068-d5d0-4f0d-bca2-9f0693ee4e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:43.875278 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-af4ba6c4-2abf-43d3-b4bb-06b238dbfe12 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:43.876682 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-af4ba6c4-2abf-43d3-b4bb-06b238dbfe12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:43.922332 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 910/1788] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:43.923498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ba6c4-2abf-43d3-b4bb-06b238dbfe12 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:43.931117 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:43.958612 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ba6c4-2abf-43d3-b4bb-06b238dbfe12 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:43.982628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c7d81-8867-4a35-8b28-d5bb6d44a5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:43.983571 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c7d81-8867-4a35-8b28-d5bb6d44a5fe admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:43.987044 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c7d81-8867-4a35-8b28-d5bb6d44a5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:43.987592 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c7d81-8867-4a35-8b28-d5bb6d44a5fe admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:43.988532 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c7d81-8867-4a35-8b28-d5bb6d44a5fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:43.990794 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c7d81-8867-4a35-8b28-d5bb6d44a5fe admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:44.026554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 879/1789] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Jul 12 13:17:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:44.032444 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ab068-d5d0-4f0d-bca2-9f0693ee4e93 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:44.058987 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ab068-d5d0-4f0d-bca2-9f0693ee4e93 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:44.068095 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60bc2d-1bfc-47e1-a67c-eb67af60f3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:44.069034 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60bc2d-1bfc-47e1-a67c-eb67af60f3e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:44.069317 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60bc2d-1bfc-47e1-a67c-eb67af60f3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:44.069595 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60bc2d-1bfc-47e1-a67c-eb67af60f3e1 admin admin] PATH_INFO: `/v3/projects/d69c49a7880d4cff9e4c7810fdece786/users/2e8016b8817d4a479de9620e17fe8b56/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:44.086948 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 911/1790] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:17:43 2022] POST /identity/v3/users => generated 279 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:44.088089 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c7d81-8867-4a35-8b28-d5bb6d44a5fe admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:44.102589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c7d81-8867-4a35-8b28-d5bb6d44a5fe admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:44.111876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4667a-2f26-457a-a809-ddf7931dc101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:44.112769 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4667a-2f26-457a-a809-ddf7931dc101 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:44.113166 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4667a-2f26-457a-a809-ddf7931dc101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:44.113550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4667a-2f26-457a-a809-ddf7931dc101 admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:44.114491 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4667a-2f26-457a-a809-ddf7931dc101 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:17:44.115471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4667a-2f26-457a-a809-ddf7931dc101 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:44.117575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4667a-2f26-457a-a809-ddf7931dc101 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:44.144964 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60bc2d-1bfc-47e1-a67c-eb67af60f3e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d69c49a7880d4cff9e4c7810fdece786, user_id=2e8016b8817d4a479de9620e17fe8b56, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:44.147318 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 912/1791] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:17:44.148425 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4667a-2f26-457a-a809-ddf7931dc101 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:44.151378 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60bc2d-1bfc-47e1-a67c-eb67af60f3e1 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:44.196032 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4667a-2f26-457a-a809-ddf7931dc101 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:44.199864 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 880/1792] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:44 2022] PUT /identity/v3/projects/d69c49a7880d4cff9e4c7810fdece786/users/2e8016b8817d4a479de9620e17fe8b56/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:44.200743 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60bc2d-1bfc-47e1-a67c-eb67af60f3e1 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:44.276974 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:44.345848 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add70f03-cd96-4518-8bcb-104cc9d7e90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:44.346768 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add70f03-cd96-4518-8bcb-104cc9d7e90c admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:44.347089 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add70f03-cd96-4518-8bcb-104cc9d7e90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:44.347545 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add70f03-cd96-4518-8bcb-104cc9d7e90c admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:44.348187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add70f03-cd96-4518-8bcb-104cc9d7e90c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:44.352160 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add70f03-cd96-4518-8bcb-104cc9d7e90c admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:44.368504 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 913/1793] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:44.370594 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c30b91-607f-4319-adf8-841e3efdeba3 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:44.371072 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c30b91-607f-4319-adf8-841e3efdeba3 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:44.371273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c30b91-607f-4319-adf8-841e3efdeba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:44.417392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-a6c30b91-607f-4319-adf8-841e3efdeba3 None None] MFA Rules not processed for user `2e8016b8817d4a479de9620e17fe8b56`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:44.422462 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a6c30b91-607f-4319-adf8-841e3efdeba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:44.437167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60bc2d-1bfc-47e1-a67c-eb67af60f3e1 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:44.451366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dedc308-cb99-4b14-b168-22baf6c8cca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:44.452182 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedc308-cb99-4b14-b168-22baf6c8cca2 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:44.452573 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedc308-cb99-4b14-b168-22baf6c8cca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:44.452951 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedc308-cb99-4b14-b168-22baf6c8cca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:44.453759 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dedc308-cb99-4b14-b168-22baf6c8cca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:44.460056 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dedc308-cb99-4b14-b168-22baf6c8cca2 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:44.540581 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 881/1794] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:17:44 2022] POST /identity/v3/projects => generated 401 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:44.541686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dedc308-cb99-4b14-b168-22baf6c8cca2 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:44.547446 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-5dedc308-cb99-4b14-b168-22baf6c8cca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:44.672515 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 914/1795] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:44 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:44.675403 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c30b91-607f-4319-adf8-841e3efdeba3 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:44.723388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c30b91-607f-4319-adf8-841e3efdeba3 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:44.879051 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dedc308-cb99-4b14-b168-22baf6c8cca2 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:44.905219 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0655ee5-723f-44db-9a7d-b8c56652c6a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe10f0f42b8247c99ed5f88eff5065e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:44.906055 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0655ee5-723f-44db-9a7d-b8c56652c6a3 service swift] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:44.907034 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0655ee5-723f-44db-9a7d-b8c56652c6a3 service swift] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:44.907034 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0655ee5-723f-44db-9a7d-b8c56652c6a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:44.946518 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:44.949326 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70326b73-0e73-411e-b3f4-5fc7c1b3b125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:44.950740 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70326b73-0e73-411e-b3f4-5fc7c1b3b125 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:44.951039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70326b73-0e73-411e-b3f4-5fc7c1b3b125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:44.951334 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70326b73-0e73-411e-b3f4-5fc7c1b3b125 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:44.952070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70326b73-0e73-411e-b3f4-5fc7c1b3b125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:44.954550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70326b73-0e73-411e-b3f4-5fc7c1b3b125 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:44.990605 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 915/1796] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:44.992042 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e9187-6fb8-4fe6-a859-be23e1400f2f None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:44.992338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e9187-6fb8-4fe6-a859-be23e1400f2f None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:44.999316 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e9187-6fb8-4fe6-a859-be23e1400f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:45.051032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0655ee5-723f-44db-9a7d-b8c56652c6a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:45.052662 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0655ee5-723f-44db-9a7d-b8c56652c6a3 service swift] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:45.068772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-cc2e9187-6fb8-4fe6-a859-be23e1400f2f None None] MFA Rules not processed for user `155dfbdcace94d9d93d8d4758fbcb372`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:45.070022 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-cc2e9187-6fb8-4fe6-a859-be23e1400f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:45.072880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 882/1797] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Jul 12 13:17:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:17:45.074032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0655ee5-723f-44db-9a7d-b8c56652c6a3 service swift] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:45.109150 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0655ee5-723f-44db-9a7d-b8c56652c6a3 service swift] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:45.117745 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74a162-81f1-488f-86fd-ab8da382c509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:45.117999 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74a162-81f1-488f-86fd-ab8da382c509 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:45.118148 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74a162-81f1-488f-86fd-ab8da382c509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:45.118438 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74a162-81f1-488f-86fd-ab8da382c509 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:45.120650 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74a162-81f1-488f-86fd-ab8da382c509 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:45.121147 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74a162-81f1-488f-86fd-ab8da382c509 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:45.228386 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 883/1798] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:17:45 2022] POST /identity/v3/users => generated 301 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:45.230263 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74a162-81f1-488f-86fd-ab8da382c509 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:45.244244 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:45.268018 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74a162-81f1-488f-86fd-ab8da382c509 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:45.284062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 916/1799] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:45.284828 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e9187-6fb8-4fe6-a859-be23e1400f2f None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:45.295477 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6157e34-879b-45db-9e93-436b3ff75d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:45.296398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6157e34-879b-45db-9e93-436b3ff75d9e admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:45.296695 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6157e34-879b-45db-9e93-436b3ff75d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:45.296980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6157e34-879b-45db-9e93-436b3ff75d9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:45.297703 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6157e34-879b-45db-9e93-436b3ff75d9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:45.303364 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6157e34-879b-45db-9e93-436b3ff75d9e admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:45.325937 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e9187-6fb8-4fe6-a859-be23e1400f2f None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:45.332735 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857e3e7-589b-4875-bcb4-734938ada970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:45.335195 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857e3e7-589b-4875-bcb4-734938ada970 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:45.335618 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857e3e7-589b-4875-bcb4-734938ada970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:45.336292 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857e3e7-589b-4875-bcb4-734938ada970 admin admin] PATH_INFO: `/v3/projects/40c916ec591f48d2a322041e28a8d067/users/b69cc70d75634e068255a1a2207067b2/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:45.366527 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857e3e7-589b-4875-bcb4-734938ada970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c916ec591f48d2a322041e28a8d067, user_id=b69cc70d75634e068255a1a2207067b2, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:45.371085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857e3e7-589b-4875-bcb4-734938ada970 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:45.398241 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 884/1800] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:17:45 2022] POST /identity/v3/projects => generated 409 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:45.398241 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6157e34-879b-45db-9e93-436b3ff75d9e admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:45.430553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 917/1801] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:45 2022] PUT /identity/v3/projects/40c916ec591f48d2a322041e28a8d067/users/b69cc70d75634e068255a1a2207067b2/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:45.430553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857e3e7-589b-4875-bcb4-734938ada970 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:45.618773 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6157e34-879b-45db-9e93-436b3ff75d9e admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:45.765435 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857e3e7-589b-4875-bcb4-734938ada970 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:45.779676 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00ae6f-81f6-48a4-813d-fd9d8b9bf50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:45.780425 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00ae6f-81f6-48a4-813d-fd9d8b9bf50e admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:45.780760 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00ae6f-81f6-48a4-813d-fd9d8b9bf50e admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:45.781057 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00ae6f-81f6-48a4-813d-fd9d8b9bf50e admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:45.781767 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00ae6f-81f6-48a4-813d-fd9d8b9bf50e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:45.783819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00ae6f-81f6-48a4-813d-fd9d8b9bf50e admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:45.829225 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3683a-7c77-4775-bf04-b2ff58d7fd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:45.829972 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3683a-7c77-4775-bf04-b2ff58d7fd09 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:45.830618 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3683a-7c77-4775-bf04-b2ff58d7fd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:45.830907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3683a-7c77-4775-bf04-b2ff58d7fd09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:45.831819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3683a-7c77-4775-bf04-b2ff58d7fd09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:45.835613 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3683a-7c77-4775-bf04-b2ff58d7fd09 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:45.849661 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 918/1802] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:17:45 2022] POST /identity/v3/users => generated 311 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:45.854491 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ffc69-177d-41ac-92d2-9cfc0d5cc371 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:45.855661 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ffc69-177d-41ac-92d2-9cfc0d5cc371 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:45.856729 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ffc69-177d-41ac-92d2-9cfc0d5cc371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:45.871608 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 885/1803] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 477 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:45.873216 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3683a-7c77-4775-bf04-b2ff58d7fd09 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:45.884803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-ddf3683a-7c77-4775-bf04-b2ff58d7fd09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:45.944472 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-0d1ffc69-177d-41ac-92d2-9cfc0d5cc371 None None] MFA Rules not processed for user `b69cc70d75634e068255a1a2207067b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:45.946065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-0d1ffc69-177d-41ac-92d2-9cfc0d5cc371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:45.964723 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:46.026147 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3683a-7c77-4775-bf04-b2ff58d7fd09 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:46.030483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf72d4-a7b6-4b48-ab63-967427d716e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:46.031255 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf72d4-a7b6-4b48-ab63-967427d716e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:46.031615 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf72d4-a7b6-4b48-ab63-967427d716e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:46.031983 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf72d4-a7b6-4b48-ab63-967427d716e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:46.046216 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-afbf72d4-a7b6-4b48-ab63-967427d716e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:46.117131 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 919/1804] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:45 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:46.119162 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ffc69-177d-41ac-92d2-9cfc0d5cc371 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:46.160234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf72d4-a7b6-4b48-ab63-967427d716e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:46.163325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ffc69-177d-41ac-92d2-9cfc0d5cc371 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:46.164488 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf72d4-a7b6-4b48-ab63-967427d716e6 service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:46.175727 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c48758-c0ea-4fdf-9833-02dd46978b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:46.176540 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c48758-c0ea-4fdf-9833-02dd46978b7d admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:46.176713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c48758-c0ea-4fdf-9833-02dd46978b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:46.176991 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c48758-c0ea-4fdf-9833-02dd46978b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:46.177793 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c48758-c0ea-4fdf-9833-02dd46978b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:46.182961 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c48758-c0ea-4fdf-9833-02dd46978b7d admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:46.213636 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 886/1805] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:45 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:46.213848 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 920/1806] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:46.213848 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c48758-c0ea-4fdf-9833-02dd46978b7d admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:46.214033 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf72d4-a7b6-4b48-ab63-967427d716e6 service cinder] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:46.235945 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c48758-c0ea-4fdf-9833-02dd46978b7d admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:46.239366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf72d4-a7b6-4b48-ab63-967427d716e6 service cinder] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:46.245453 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06291bc-e4c8-4b8a-bef2-0e1c3bda05e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:46.246223 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06291bc-e4c8-4b8a-bef2-0e1c3bda05e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:46.247136 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06291bc-e4c8-4b8a-bef2-0e1c3bda05e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:46.249883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06291bc-e4c8-4b8a-bef2-0e1c3bda05e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:46.250304 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06291bc-e4c8-4b8a-bef2-0e1c3bda05e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:46.253520 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06291bc-e4c8-4b8a-bef2-0e1c3bda05e6 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:46.259785 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135511e2-277a-4759-bcf2-604c9098a906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:46.260664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135511e2-277a-4759-bcf2-604c9098a906 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:46.261108 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135511e2-277a-4759-bcf2-604c9098a906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:46.261656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135511e2-277a-4759-bcf2-604c9098a906 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:46.265630 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135511e2-277a-4759-bcf2-604c9098a906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:46.270481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135511e2-277a-4759-bcf2-604c9098a906 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:46.317808 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 921/1807] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:17:46 2022] POST /identity/v3/projects => generated 355 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:46.320837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06291bc-e4c8-4b8a-bef2-0e1c3bda05e6 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:46.333434 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 887/1808] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:46.333434 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135511e2-277a-4759-bcf2-604c9098a906 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:46.368016 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:46.401573 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135511e2-277a-4759-bcf2-604c9098a906 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:46.555541 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef06ab-7d6f-4ad8-aab5-2d5cf8510ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:46.556360 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef06ab-7d6f-4ad8-aab5-2d5cf8510ead admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:46.556651 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef06ab-7d6f-4ad8-aab5-2d5cf8510ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:46.556934 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef06ab-7d6f-4ad8-aab5-2d5cf8510ead admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:46.557735 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef06ab-7d6f-4ad8-aab5-2d5cf8510ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:46.561588 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef06ab-7d6f-4ad8-aab5-2d5cf8510ead admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:46.571921 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06291bc-e4c8-4b8a-bef2-0e1c3bda05e6 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:46.592934 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 888/1809] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:17:46 2022] POST /identity/v3/users => generated 284 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:46.594011 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef06ab-7d6f-4ad8-aab5-2d5cf8510ead admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:46.596197 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee279413-48b8-4fb0-a26a-2be9c0c06670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:46.600729 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee279413-48b8-4fb0-a26a-2be9c0c06670 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:46.601367 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee279413-48b8-4fb0-a26a-2be9c0c06670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:46.601861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee279413-48b8-4fb0-a26a-2be9c0c06670 admin admin] PATH_INFO: `/v3/projects/3ad6270e53384a5db8da6b1ac5a060aa/users/926ffe520c224a8ca11f69b256633b8c/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:46.609916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef06ab-7d6f-4ad8-aab5-2d5cf8510ead admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:46.616140 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86465775-ccdb-43c2-8f19-f2115753476f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:46.617627 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86465775-ccdb-43c2-8f19-f2115753476f admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:46.617974 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86465775-ccdb-43c2-8f19-f2115753476f admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:46.618408 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86465775-ccdb-43c2-8f19-f2115753476f admin admin] PATH_INFO: `/v3/projects/c0e1d2fc59f94e029a3fddbc009c9424/users/6a6060eb4b5047cab84ed8a6602623a8/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:46.660497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee279413-48b8-4fb0-a26a-2be9c0c06670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ad6270e53384a5db8da6b1ac5a060aa, user_id=926ffe520c224a8ca11f69b256633b8c, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:46.667807 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86465775-ccdb-43c2-8f19-f2115753476f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0e1d2fc59f94e029a3fddbc009c9424, user_id=6a6060eb4b5047cab84ed8a6602623a8, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:46.670834 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee279413-48b8-4fb0-a26a-2be9c0c06670 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:46.674350 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86465775-ccdb-43c2-8f19-f2115753476f admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:46.704289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 922/1810] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:46 2022] PUT /identity/v3/projects/3ad6270e53384a5db8da6b1ac5a060aa/users/926ffe520c224a8ca11f69b256633b8c/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:46.705685 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee279413-48b8-4fb0-a26a-2be9c0c06670 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:46.716281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 889/1811] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:46 2022] PUT /identity/v3/projects/c0e1d2fc59f94e029a3fddbc009c9424/users/6a6060eb4b5047cab84ed8a6602623a8/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:46.724076 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86465775-ccdb-43c2-8f19-f2115753476f admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:46.906904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:46.982749 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee279413-48b8-4fb0-a26a-2be9c0c06670 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:47.200404 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252cc3ea-554d-4fce-afb7-7f33a97c0683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:47.201354 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252cc3ea-554d-4fce-afb7-7f33a97c0683 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:47.201753 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252cc3ea-554d-4fce-afb7-7f33a97c0683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:47.202138 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252cc3ea-554d-4fce-afb7-7f33a97c0683 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:47.203017 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252cc3ea-554d-4fce-afb7-7f33a97c0683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:47.204890 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252cc3ea-554d-4fce-afb7-7f33a97c0683 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:47.226488 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 923/1812] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 518 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:47.226488 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94ca80-2a61-4aa0-9c94-3273298f0368 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:47.226488 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94ca80-2a61-4aa0-9c94-3273298f0368 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:47.226488 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94ca80-2a61-4aa0-9c94-3273298f0368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:47.249240 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86465775-ccdb-43c2-8f19-f2115753476f admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:47.277072 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaee912-2a33-4411-9650-5fb8970f24fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:47.279580 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaee912-2a33-4411-9650-5fb8970f24fc admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:47.280198 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaee912-2a33-4411-9650-5fb8970f24fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:47.280748 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaee912-2a33-4411-9650-5fb8970f24fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:47.282280 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaee912-2a33-4411-9650-5fb8970f24fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:47.287222 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaee912-2a33-4411-9650-5fb8970f24fc admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:47.296890 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-1e94ca80-2a61-4aa0-9c94-3273298f0368 None None] MFA Rules not processed for user `6a6060eb4b5047cab84ed8a6602623a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:47.298397 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-1e94ca80-2a61-4aa0-9c94-3273298f0368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:47.375959 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 890/1813] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 659 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:47.379470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaee912-2a33-4411-9650-5fb8970f24fc admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:47.406837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:47.435426 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaee912-2a33-4411-9650-5fb8970f24fc admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:47.449610 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e862c8-2dd6-421c-8a0d-89fb277f0441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:47.450637 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e862c8-2dd6-421c-8a0d-89fb277f0441 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:47.450924 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e862c8-2dd6-421c-8a0d-89fb277f0441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:47.451292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e862c8-2dd6-421c-8a0d-89fb277f0441 admin admin] PATH_INFO: `/v3/projects/b3238cf758bd4c1dae9d9df899ccd4e9/users/03f33472df134c22b16ddb16a2beb1ea/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:47.490357 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e862c8-2dd6-421c-8a0d-89fb277f0441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3238cf758bd4c1dae9d9df899ccd4e9, user_id=03f33472df134c22b16ddb16a2beb1ea, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:47.493079 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e862c8-2dd6-421c-8a0d-89fb277f0441 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:47.532787 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 891/1814] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:47 2022] PUT /identity/v3/projects/b3238cf758bd4c1dae9d9df899ccd4e9/users/03f33472df134c22b16ddb16a2beb1ea/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:47.533991 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e862c8-2dd6-421c-8a0d-89fb277f0441 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:47.629853 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 924/1815] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:47.631315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94ca80-2a61-4aa0-9c94-3273298f0368 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:47.647516 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94ca80-2a61-4aa0-9c94-3273298f0368 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:47.791324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e862c8-2dd6-421c-8a0d-89fb277f0441 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:47.810195 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdde839-2055-4173-8b1e-09ff6c80717f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:47.811215 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdde839-2055-4173-8b1e-09ff6c80717f admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:47.811596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdde839-2055-4173-8b1e-09ff6c80717f admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:47.811596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdde839-2055-4173-8b1e-09ff6c80717f admin admin] PATH_INFO: `/v3/projects/3ad6270e53384a5db8da6b1ac5a060aa/users/926ffe520c224a8ca11f69b256633b8c/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:47.835627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d5405-06f8-4db3-b6fd-4e3b8b5cfc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:47.836475 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d5405-06f8-4db3-b6fd-4e3b8b5cfc65 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:47.836880 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d5405-06f8-4db3-b6fd-4e3b8b5cfc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:47.837276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d5405-06f8-4db3-b6fd-4e3b8b5cfc65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:47.838359 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d5405-06f8-4db3-b6fd-4e3b8b5cfc65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:47.840252 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d5405-06f8-4db3-b6fd-4e3b8b5cfc65 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:47.841609 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdde839-2055-4173-8b1e-09ff6c80717f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ad6270e53384a5db8da6b1ac5a060aa, user_id=926ffe520c224a8ca11f69b256633b8c, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:47.845067 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdde839-2055-4173-8b1e-09ff6c80717f admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:47.866243 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 925/1816] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:47.867346 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d5405-06f8-4db3-b6fd-4e3b8b5cfc65 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:47.892480 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 892/1817] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:47 2022] PUT /identity/v3/projects/3ad6270e53384a5db8da6b1ac5a060aa/users/926ffe520c224a8ca11f69b256633b8c/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:47.892480 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdde839-2055-4173-8b1e-09ff6c80717f admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:47.900962 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d5405-06f8-4db3-b6fd-4e3b8b5cfc65 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:48.084373 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdde839-2055-4173-8b1e-09ff6c80717f admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:48.096750 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24410004-8276-42e3-a75d-9c67e1b1d7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:48.100738 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24410004-8276-42e3-a75d-9c67e1b1d7e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:48.107311 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0c05f-1f6d-4332-90be-e3852fa22876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:48.108640 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0c05f-1f6d-4332-90be-e3852fa22876 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:48.110169 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0c05f-1f6d-4332-90be-e3852fa22876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:48.112419 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0c05f-1f6d-4332-90be-e3852fa22876 admin admin] PATH_INFO: `/v3/projects/b3238cf758bd4c1dae9d9df899ccd4e9/users/03f33472df134c22b16ddb16a2beb1ea/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:48.116541 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24410004-8276-42e3-a75d-9c67e1b1d7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:48.117036 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24410004-8276-42e3-a75d-9c67e1b1d7e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:48.117998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24410004-8276-42e3-a75d-9c67e1b1d7e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:48.119269 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0c05f-1f6d-4332-90be-e3852fa22876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3238cf758bd4c1dae9d9df899ccd4e9, user_id=03f33472df134c22b16ddb16a2beb1ea, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:48.120578 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24410004-8276-42e3-a75d-9c67e1b1d7e1 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:48.124388 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0c05f-1f6d-4332-90be-e3852fa22876 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:48.164591 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 893/1818] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:47 2022] PUT /identity/v3/projects/b3238cf758bd4c1dae9d9df899ccd4e9/users/03f33472df134c22b16ddb16a2beb1ea/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:48.166179 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726678ae-49e2-4e8f-887d-c2ea765ac131 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:48.166477 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726678ae-49e2-4e8f-887d-c2ea765ac131 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:48.166759 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726678ae-49e2-4e8f-887d-c2ea765ac131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:48.193914 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 926/1819] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:17:47 2022] POST /identity/v3/projects => generated 399 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:48.196700 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2587bc8-50ab-4d84-8515-7ba28bf6c8cb None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:48.197092 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2587bc8-50ab-4d84-8515-7ba28bf6c8cb None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:48.198777 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2587bc8-50ab-4d84-8515-7ba28bf6c8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:48.243432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-726678ae-49e2-4e8f-887d-c2ea765ac131 None None] MFA Rules not processed for user `926ffe520c224a8ca11f69b256633b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:48.244666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-726678ae-49e2-4e8f-887d-c2ea765ac131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:48.291206 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-e2587bc8-50ab-4d84-8515-7ba28bf6c8cb None None] MFA Rules not processed for user `03f33472df134c22b16ddb16a2beb1ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:48.292978 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-e2587bc8-50ab-4d84-8515-7ba28bf6c8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:48.308403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:48.411588 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:48.586517 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 927/1820] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:48 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:48.587928 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2587bc8-50ab-4d84-8515-7ba28bf6c8cb None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:48.678935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 894/1821] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:48 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 514 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:48.679898 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726678ae-49e2-4e8f-887d-c2ea765ac131 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:48.884482 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2587bc8-50ab-4d84-8515-7ba28bf6c8cb None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:48.891526 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726678ae-49e2-4e8f-887d-c2ea765ac131 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:48.910059 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3613bea-75ad-42b4-aa65-cd03c50bc03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:48.910059 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3613bea-75ad-42b4-aa65-cd03c50bc03e admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:48.910059 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3613bea-75ad-42b4-aa65-cd03c50bc03e admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:48.910059 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3613bea-75ad-42b4-aa65-cd03c50bc03e admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:48.910679 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3613bea-75ad-42b4-aa65-cd03c50bc03e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:48.910679 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3613bea-75ad-42b4-aa65-cd03c50bc03e admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:48.910814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190f3d1-5358-49cd-a570-80528bf9dc33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:48.918205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190f3d1-5358-49cd-a570-80528bf9dc33 service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:48.922919 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190f3d1-5358-49cd-a570-80528bf9dc33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:48.923469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190f3d1-5358-49cd-a570-80528bf9dc33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:48.970221 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190f3d1-5358-49cd-a570-80528bf9dc33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:48.973168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190f3d1-5358-49cd-a570-80528bf9dc33 service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:49.009329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 928/1822] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:17:48 2022] POST /identity/v3/users => generated 306 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:17:49.010760 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3613bea-75ad-42b4-aa65-cd03c50bc03e admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:49.013643 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 895/1823] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:48 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:49.015969 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190f3d1-5358-49cd-a570-80528bf9dc33 service cinder] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:49.018154 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-e3613bea-75ad-42b4-aa65-cd03c50bc03e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:49.053458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3613bea-75ad-42b4-aa65-cd03c50bc03e admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:49.067702 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25b534-ea06-4f94-83e9-293d2ad11e3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:49.068191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25b534-ea06-4f94-83e9-293d2ad11e3a service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:49.068597 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25b534-ea06-4f94-83e9-293d2ad11e3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:49.069007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25b534-ea06-4f94-83e9-293d2ad11e3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:49.088647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190f3d1-5358-49cd-a570-80528bf9dc33 service cinder] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:49.092568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25b534-ea06-4f94-83e9-293d2ad11e3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:49.094222 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25b534-ea06-4f94-83e9-293d2ad11e3a service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:49.126059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71646201-0dd3-4708-a228-56df5dcf646d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:49.131287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71646201-0dd3-4708-a228-56df5dcf646d admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:49.132146 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 929/1824] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:49 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:49.138349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71646201-0dd3-4708-a228-56df5dcf646d admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:49.138653 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71646201-0dd3-4708-a228-56df5dcf646d admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:49.140976 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71646201-0dd3-4708-a228-56df5dcf646d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:49.148683 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a6dea-e911-4908-900b-0e94166d32b4 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:49.152349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71646201-0dd3-4708-a228-56df5dcf646d admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:49.154516 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a6dea-e911-4908-900b-0e94166d32b4 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:49.154931 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a6dea-e911-4908-900b-0e94166d32b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:49.204471 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 896/1825] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:49.209371 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71646201-0dd3-4708-a228-56df5dcf646d admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:49.236214 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71646201-0dd3-4708-a228-56df5dcf646d admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:49.248137 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef31c1b-b266-4bb0-b832-5d6fe0f48b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:49.249075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef31c1b-b266-4bb0-b832-5d6fe0f48b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:49.249348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef31c1b-b266-4bb0-b832-5d6fe0f48b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:49.249631 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef31c1b-b266-4bb0-b832-5d6fe0f48b80 admin admin] PATH_INFO: `/v3/projects/6bc60a2ae2c240d58ae254fb23d39606/users/63ac4d9d6f1d4fca8a2922a33348353d/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:49.250705 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-096a6dea-e911-4908-900b-0e94166d32b4 None None] MFA Rules not processed for user `0f39694be5f447f9a25dacf7e4c99a4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:49.253535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-096a6dea-e911-4908-900b-0e94166d32b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:49.327586 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef31c1b-b266-4bb0-b832-5d6fe0f48b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc60a2ae2c240d58ae254fb23d39606, user_id=63ac4d9d6f1d4fca8a2922a33348353d, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:49.331130 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef31c1b-b266-4bb0-b832-5d6fe0f48b80 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:49.378546 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 897/1826] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:49 2022] PUT /identity/v3/projects/6bc60a2ae2c240d58ae254fb23d39606/users/63ac4d9d6f1d4fca8a2922a33348353d/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:49.383699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef31c1b-b266-4bb0-b832-5d6fe0f48b80 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:49.475601 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 930/1827] 10.222.0.44 () {58 vars in 1015 bytes} [Tue Jul 12 13:17:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:49.495406 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a6dea-e911-4908-900b-0e94166d32b4 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:49.510742 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a6dea-e911-4908-900b-0e94166d32b4 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:49.636056 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef31c1b-b266-4bb0-b832-5d6fe0f48b80 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:49.654200 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c0fde-406f-42ae-be77-86c2a11de980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:49.657194 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c0fde-406f-42ae-be77-86c2a11de980 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:49.662155 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c0fde-406f-42ae-be77-86c2a11de980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:49.662899 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c0fde-406f-42ae-be77-86c2a11de980 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:49.665948 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c0fde-406f-42ae-be77-86c2a11de980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:49.669066 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c5292-7844-4180-8088-a2fd49921ccb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:49.672336 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c5292-7844-4180-8088-a2fd49921ccb service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:49.673080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c5292-7844-4180-8088-a2fd49921ccb service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:49.675610 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c5292-7844-4180-8088-a2fd49921ccb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:49.677901 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c0fde-406f-42ae-be77-86c2a11de980 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:49.711538 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:49.732019 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 898/1828] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:17:49.733024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c0fde-406f-42ae-be77-86c2a11de980 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:49.742068 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-c74c0fde-406f-42ae-be77-86c2a11de980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:49.854147 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:49.961801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c5292-7844-4180-8088-a2fd49921ccb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:49.963928 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c5292-7844-4180-8088-a2fd49921ccb service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:49.973202 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c0fde-406f-42ae-be77-86c2a11de980 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:49.991597 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 931/1829] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:49 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:17:49.992820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c5292-7844-4180-8088-a2fd49921ccb service cinder] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:50.011303 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf80882-8b7a-41e4-b5c5-37d813de31fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:50.011995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf80882-8b7a-41e4-b5c5-37d813de31fd service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:50.012333 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf80882-8b7a-41e4-b5c5-37d813de31fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:50.014358 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf80882-8b7a-41e4-b5c5-37d813de31fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:50.022461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c5292-7844-4180-8088-a2fd49921ccb service cinder] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:50.033836 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a4d40-8259-41ef-a281-4b46a9f6d14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:50.035925 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a4d40-8259-41ef-a281-4b46a9f6d14b admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:50.037794 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a4d40-8259-41ef-a281-4b46a9f6d14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:50.038660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a4d40-8259-41ef-a281-4b46a9f6d14b admin admin] PATH_INFO: `/v3/projects/6bc60a2ae2c240d58ae254fb23d39606/users/63ac4d9d6f1d4fca8a2922a33348353d/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:50.053365 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a4d40-8259-41ef-a281-4b46a9f6d14b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc60a2ae2c240d58ae254fb23d39606, user_id=63ac4d9d6f1d4fca8a2922a33348353d, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:50.055370 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf80882-8b7a-41e4-b5c5-37d813de31fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:50.057017 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf80882-8b7a-41e4-b5c5-37d813de31fd service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:50.059147 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a4d40-8259-41ef-a281-4b46a9f6d14b admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:50.076614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 932/1830] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:17:49 2022] PUT /identity/v3/projects/6bc60a2ae2c240d58ae254fb23d39606/users/63ac4d9d6f1d4fca8a2922a33348353d/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:50.079225 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a4d40-8259-41ef-a281-4b46a9f6d14b admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:50.099523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 899/1831] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:50.101979 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c15fdf-2167-48c6-9f8b-c5945ac7bcb0 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:50.102763 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c15fdf-2167-48c6-9f8b-c5945ac7bcb0 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:50.105569 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c15fdf-2167-48c6-9f8b-c5945ac7bcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:50.186313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-f9c15fdf-2167-48c6-9f8b-c5945ac7bcb0 None None] MFA Rules not processed for user `63ac4d9d6f1d4fca8a2922a33348353d`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:50.190739 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-f9c15fdf-2167-48c6-9f8b-c5945ac7bcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:50.283108 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a4d40-8259-41ef-a281-4b46a9f6d14b admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:50.297212 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef762a58-2b4b-486c-bf0b-61c9c3def68a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:50.301269 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef762a58-2b4b-486c-bf0b-61c9c3def68a service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:50.302435 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef762a58-2b4b-486c-bf0b-61c9c3def68a service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:50.303402 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef762a58-2b4b-486c-bf0b-61c9c3def68a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:50.479118 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 900/1832] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:50 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:50.540630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef762a58-2b4b-486c-bf0b-61c9c3def68a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:50.542767 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef762a58-2b4b-486c-bf0b-61c9c3def68a service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:50.573213 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 933/1833] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:50 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:50.623345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c15fdf-2167-48c6-9f8b-c5945ac7bcb0 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:50.658658 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c15fdf-2167-48c6-9f8b-c5945ac7bcb0 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:50.705217 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17de65-cfa4-40e6-81f7-ca76c3ad23ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:50.705954 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17de65-cfa4-40e6-81f7-ca76c3ad23ea service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:50.706365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17de65-cfa4-40e6-81f7-ca76c3ad23ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:50.709754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17de65-cfa4-40e6-81f7-ca76c3ad23ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:50.732547 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17de65-cfa4-40e6-81f7-ca76c3ad23ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:50.736307 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17de65-cfa4-40e6-81f7-ca76c3ad23ea service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:50.787923 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 901/1834] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:50 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:51.656306 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef762a58-2b4b-486c-bf0b-61c9c3def68a service cinder] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:51.668489 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef762a58-2b4b-486c-bf0b-61c9c3def68a service cinder] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:51.694575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41071e05-f90c-4c46-9caa-cd50b09cd96c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:51.710191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41071e05-f90c-4c46-9caa-cd50b09cd96c service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:51.710191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41071e05-f90c-4c46-9caa-cd50b09cd96c service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:51.710191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41071e05-f90c-4c46-9caa-cd50b09cd96c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:51.945020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:51.952628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41071e05-f90c-4c46-9caa-cd50b09cd96c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:51.954267 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41071e05-f90c-4c46-9caa-cd50b09cd96c service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:52.002095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 934/1835] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:51 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:53.997103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10865e6-66a7-4bd7-bfd4-af036b49cca7 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:53.997689 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10865e6-66a7-4bd7-bfd4-af036b49cca7 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:53.997689 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10865e6-66a7-4bd7-bfd4-af036b49cca7 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:53.999125 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 902/1836] 10.222.0.17 () {54 vars in 921 bytes} [Tue Jul 12 13:17:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:17:54.098308 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41516788-b02e-4825-a02c-390bf83bfd6c None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:54.102735 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41516788-b02e-4825-a02c-390bf83bfd6c None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:54.102735 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41516788-b02e-4825-a02c-390bf83bfd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:54.129047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea19803-a8f7-40bc-ba07-bfa02e8c448e None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:54.129371 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea19803-a8f7-40bc-ba07-bfa02e8c448e None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:54.129655 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea19803-a8f7-40bc-ba07-bfa02e8c448e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:54.156658 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-41516788-b02e-4825-a02c-390bf83bfd6c None None] MFA Rules not processed for user `48f4be3ee79e42aeb67d87c06803c031`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:54.163778 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-41516788-b02e-4825-a02c-390bf83bfd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:54.180819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-3ea19803-a8f7-40bc-ba07-bfa02e8c448e None None] MFA Rules not processed for user `e52dfce1b06346bfbde6ee33e7f6f249`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:54.202360 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-3ea19803-a8f7-40bc-ba07-bfa02e8c448e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:54.504476 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 935/1837] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:54.580862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 903/1838] 10.222.0.17 () {58 vars in 1018 bytes} [Tue Jul 12 13:17:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:17:54.973984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639f0b4-356d-44d1-b159-9d55205a8bd0 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:54.981737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639f0b4-356d-44d1-b159-9d55205a8bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:54.981737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639f0b4-356d-44d1-b159-9d55205a8bd0 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:54.982746 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 936/1839] 10.222.0.17 () {54 vars in 921 bytes} [Tue Jul 12 13:17:54 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:17:55.064674 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e982ba-7c01-47fc-a6ac-5b30cddbd3d8 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:55.065767 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e982ba-7c01-47fc-a6ac-5b30cddbd3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:55.066254 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e982ba-7c01-47fc-a6ac-5b30cddbd3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:55.119058 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-07e982ba-7c01-47fc-a6ac-5b30cddbd3d8 None None] MFA Rules not processed for user `e52dfce1b06346bfbde6ee33e7f6f249`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:55.123248 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-07e982ba-7c01-47fc-a6ac-5b30cddbd3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:55.147540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 904/1840] 10.222.0.17 () {58 vars in 1018 bytes} [Tue Jul 12 13:17:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:56.470014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639f0b4-356d-44d1-b159-9d55205a8bd0 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:56.522851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639f0b4-356d-44d1-b159-9d55205a8bd0 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:56.536956 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1eb59-a21e-46dd-bd45-047327226787 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:56.539343 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1eb59-a21e-46dd-bd45-047327226787 service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:56.540045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1eb59-a21e-46dd-bd45-047327226787 service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:56.541376 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1eb59-a21e-46dd-bd45-047327226787 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:56.576192 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1eb59-a21e-46dd-bd45-047327226787 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:56.588771 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1eb59-a21e-46dd-bd45-047327226787 service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:56.648305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 937/1841] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:56.977477 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e982ba-7c01-47fc-a6ac-5b30cddbd3d8 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:57.052349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e982ba-7c01-47fc-a6ac-5b30cddbd3d8 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:57.156130 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61090364-da7d-40c0-b274-0b93c7227534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:57.158286 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61090364-da7d-40c0-b274-0b93c7227534 service nova] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:57.158581 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61090364-da7d-40c0-b274-0b93c7227534 service nova] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:57.158863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61090364-da7d-40c0-b274-0b93c7227534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:57.190988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61090364-da7d-40c0-b274-0b93c7227534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:57.192980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61090364-da7d-40c0-b274-0b93c7227534 service nova] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:57.229921 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 905/1842] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:17:58.531043 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1eb59-a21e-46dd-bd45-047327226787 service nova] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:58.725968 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1eb59-a21e-46dd-bd45-047327226787 service nova] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:58.731934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82917a60-1857-4812-988f-3b3d243bed13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:58.732852 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82917a60-1857-4812-988f-3b3d243bed13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:58.748884 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61090364-da7d-40c0-b274-0b93c7227534 service nova] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:58.749730 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82917a60-1857-4812-988f-3b3d243bed13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:58.749730 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82917a60-1857-4812-988f-3b3d243bed13 admin admin] PATH_INFO: `/v3/users/6a6060eb4b5047cab84ed8a6602623a8` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:58.751880 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82917a60-1857-4812-988f-3b3d243bed13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a6060eb4b5047cab84ed8a6602623a8)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:58.755410 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82917a60-1857-4812-988f-3b3d243bed13 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:58.765275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:58.777175 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61090364-da7d-40c0-b274-0b93c7227534 service nova] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:58.797413 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9efb3-89b0-47b1-9e4c-e9d563704192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:58.800686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9efb3-89b0-47b1-9e4c-e9d563704192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:58.802589 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9efb3-89b0-47b1-9e4c-e9d563704192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:58.804351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9efb3-89b0-47b1-9e4c-e9d563704192 admin admin] PATH_INFO: `/v3/users/2e8016b8817d4a479de9620e17fe8b56` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:58.811129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9efb3-89b0-47b1-9e4c-e9d563704192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e8016b8817d4a479de9620e17fe8b56)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:58.817113 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9efb3-89b0-47b1-9e4c-e9d563704192 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:58.986789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-82917a60-1857-4812-988f-3b3d243bed13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a6060eb4b5047cab84ed8a6602623a8'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:58.988704 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-94c9efb3-89b0-47b1-9e4c-e9d563704192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e8016b8817d4a479de9620e17fe8b56'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:58.989724 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-94c9efb3-89b0-47b1-9e4c-e9d563704192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e8016b8817d4a479de9620e17fe8b56'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:59.013416 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-94c9efb3-89b0-47b1-9e4c-e9d563704192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e8016b8817d4a479de9620e17fe8b56'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:59.023724 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-94c9efb3-89b0-47b1-9e4c-e9d563704192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e8016b8817d4a479de9620e17fe8b56'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:59.040733 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-82917a60-1857-4812-988f-3b3d243bed13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a6060eb4b5047cab84ed8a6602623a8'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:59.054349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-94c9efb3-89b0-47b1-9e4c-e9d563704192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e8016b8817d4a479de9620e17fe8b56'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:59.061356 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-82917a60-1857-4812-988f-3b3d243bed13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a6060eb4b5047cab84ed8a6602623a8'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:59.067517 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-82917a60-1857-4812-988f-3b3d243bed13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a6060eb4b5047cab84ed8a6602623a8'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:59.076108 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 906/1843] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:17:58 2022] DELETE /identity/v3/users/2e8016b8817d4a479de9620e17fe8b56 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:59.088012 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9372f4-3aaa-4dd3-9230-2f425e326ebc None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:59.088595 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9372f4-3aaa-4dd3-9230-2f425e326ebc None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:59.090773 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9372f4-3aaa-4dd3-9230-2f425e326ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:59.125260 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-82917a60-1857-4812-988f-3b3d243bed13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a6060eb4b5047cab84ed8a6602623a8'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:17:59.150505 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 938/1844] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:17:58 2022] DELETE /identity/v3/users/6a6060eb4b5047cab84ed8a6602623a8 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:17:59.160055 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-ad9372f4-3aaa-4dd3-9230-2f425e326ebc None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:59.161296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba9c63-1629-437a-ad4f-e2966f141f19 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:59.161639 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba9c63-1629-437a-ad4f-e2966f141f19 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:59.161916 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba9c63-1629-437a-ad4f-e2966f141f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:59.164330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-ad9372f4-3aaa-4dd3-9230-2f425e326ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:59.176832 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:59.213791 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-5eba9c63-1629-437a-ad4f-e2966f141f19 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:17:59.218013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-5eba9c63-1629-437a-ad4f-e2966f141f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:59.393921 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 907/1845] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:59.462031 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 939/1846] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:17:59.653932 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9372f4-3aaa-4dd3-9230-2f425e326ebc None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:59.655752 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-ad9372f4-3aaa-4dd3-9230-2f425e326ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:59.758963 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba9c63-1629-437a-ad4f-e2966f141f19 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:17:59.761185 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-5eba9c63-1629-437a-ad4f-e2966f141f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:17:59.872270 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9372f4-3aaa-4dd3-9230-2f425e326ebc None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:59.882913 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1d23b-5044-4236-966d-9ed7d153a301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:17:59.886026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1d23b-5044-4236-966d-9ed7d153a301 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:17:59.888662 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1d23b-5044-4236-966d-9ed7d153a301 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:17:59.890725 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1d23b-5044-4236-966d-9ed7d153a301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:17:59.938580 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1d23b-5044-4236-966d-9ed7d153a301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:17:59.948469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1d23b-5044-4236-966d-9ed7d153a301 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:17:59.988745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba9c63-1629-437a-ad4f-e2966f141f19 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:17:59.992416 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 908/1847] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:00.002785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229672af-69f6-426c-850f-90c61d3074cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:00.004560 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229672af-69f6-426c-850f-90c61d3074cb service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:00.005207 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229672af-69f6-426c-850f-90c61d3074cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:00.005401 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229672af-69f6-426c-850f-90c61d3074cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:00.064997 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229672af-69f6-426c-850f-90c61d3074cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:00.066518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229672af-69f6-426c-850f-90c61d3074cb service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:00.099921 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 940/1848] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:17:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:01.411792 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1d23b-5044-4236-966d-9ed7d153a301 service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:01.413346 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-9aa1d23b-5044-4236-966d-9ed7d153a301 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:01.430532 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1d23b-5044-4236-966d-9ed7d153a301 service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:01.454450 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ae6ef-1c96-4297-9af2-3b11a8cf89ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:01.455867 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ae6ef-1c96-4297-9af2-3b11a8cf89ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:01.456165 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ae6ef-1c96-4297-9af2-3b11a8cf89ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:01.456536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ae6ef-1c96-4297-9af2-3b11a8cf89ab admin admin] PATH_INFO: `/v3/projects/c0e1d2fc59f94e029a3fddbc009c9424` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:01.457739 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ae6ef-1c96-4297-9af2-3b11a8cf89ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0e1d2fc59f94e029a3fddbc009c9424)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:01.460542 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ae6ef-1c96-4297-9af2-3b11a8cf89ab admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:01.486350 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:01.560853 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-762ae6ef-1c96-4297-9af2-3b11a8cf89ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0e1d2fc59f94e029a3fddbc009c9424', 'request_id': 'req-762ae6ef-1c96-4297-9af2-3b11a8cf89ab'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:01.567875 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-762ae6ef-1c96-4297-9af2-3b11a8cf89ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0e1d2fc59f94e029a3fddbc009c9424', 'request_id': 'req-762ae6ef-1c96-4297-9af2-3b11a8cf89ab'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:01.577408 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-762ae6ef-1c96-4297-9af2-3b11a8cf89ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0e1d2fc59f94e029a3fddbc009c9424', 'request_id': 'req-762ae6ef-1c96-4297-9af2-3b11a8cf89ab'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:01.591539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-762ae6ef-1c96-4297-9af2-3b11a8cf89ab admin admin] The token cache is being invalidate because project c0e1d2fc59f94e029a3fddbc009c9424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:01.592013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-762ae6ef-1c96-4297-9af2-3b11a8cf89ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:01.592713 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-762ae6ef-1c96-4297-9af2-3b11a8cf89ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:01.598911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229672af-69f6-426c-850f-90c61d3074cb service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:01.599487 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 909/1849] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:01 2022] DELETE /identity/v3/projects/c0e1d2fc59f94e029a3fddbc009c9424 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:01.610162 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229672af-69f6-426c-850f-90c61d3074cb service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:01.696861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43726aca-b860-4bca-a560-6ded20c277bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:01.698199 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43726aca-b860-4bca-a560-6ded20c277bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:01.698583 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43726aca-b860-4bca-a560-6ded20c277bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:01.699010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43726aca-b860-4bca-a560-6ded20c277bc admin admin] PATH_INFO: `/v3/users/63ac4d9d6f1d4fca8a2922a33348353d` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:01.700664 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43726aca-b860-4bca-a560-6ded20c277bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=63ac4d9d6f1d4fca8a2922a33348353d)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:01.703072 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43726aca-b860-4bca-a560-6ded20c277bc admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:01.823659 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-43726aca-b860-4bca-a560-6ded20c277bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63ac4d9d6f1d4fca8a2922a33348353d'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:01.828394 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:01.835520 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ae6ef-1c96-4297-9af2-3b11a8cf89ab admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:01.837109 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-762ae6ef-1c96-4297-9af2-3b11a8cf89ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:01.844967 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-43726aca-b860-4bca-a560-6ded20c277bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63ac4d9d6f1d4fca8a2922a33348353d'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:01.861662 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-43726aca-b860-4bca-a560-6ded20c277bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63ac4d9d6f1d4fca8a2922a33348353d'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:01.862512 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-43726aca-b860-4bca-a560-6ded20c277bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63ac4d9d6f1d4fca8a2922a33348353d'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:01.863556 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ae6ef-1c96-4297-9af2-3b11a8cf89ab admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:01.879606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-43726aca-b860-4bca-a560-6ded20c277bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63ac4d9d6f1d4fca8a2922a33348353d'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:01.889010 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f0033-cb16-440a-9f38-6c644a2d8e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:01.889907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f0033-cb16-440a-9f38-6c644a2d8e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:01.890388 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f0033-cb16-440a-9f38-6c644a2d8e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:01.890677 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f0033-cb16-440a-9f38-6c644a2d8e89 admin admin] PATH_INFO: `/v3/projects/d69c49a7880d4cff9e4c7810fdece786` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:01.894133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f0033-cb16-440a-9f38-6c644a2d8e89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d69c49a7880d4cff9e4c7810fdece786)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:01.896093 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f0033-cb16-440a-9f38-6c644a2d8e89 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:01.896522 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 941/1850] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:01 2022] DELETE /identity/v3/users/63ac4d9d6f1d4fca8a2922a33348353d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:18:02.023219 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-722f0033-cb16-440a-9f38-6c644a2d8e89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd69c49a7880d4cff9e4c7810fdece786', 'request_id': 'req-722f0033-cb16-440a-9f38-6c644a2d8e89'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:02.051977 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-722f0033-cb16-440a-9f38-6c644a2d8e89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd69c49a7880d4cff9e4c7810fdece786', 'request_id': 'req-722f0033-cb16-440a-9f38-6c644a2d8e89'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:02.070837 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-722f0033-cb16-440a-9f38-6c644a2d8e89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd69c49a7880d4cff9e4c7810fdece786', 'request_id': 'req-722f0033-cb16-440a-9f38-6c644a2d8e89'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:02.109007 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-722f0033-cb16-440a-9f38-6c644a2d8e89 admin admin] The token cache is being invalidate because project d69c49a7880d4cff9e4c7810fdece786 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:02.109496 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-722f0033-cb16-440a-9f38-6c644a2d8e89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:02.111070 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-722f0033-cb16-440a-9f38-6c644a2d8e89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:02.116255 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 910/1851] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:01 2022] DELETE /identity/v3/projects/d69c49a7880d4cff9e4c7810fdece786 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:18:02.121565 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43726aca-b860-4bca-a560-6ded20c277bc admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:02.124634 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-43726aca-b860-4bca-a560-6ded20c277bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:02.350068 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43726aca-b860-4bca-a560-6ded20c277bc admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:02.445391 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08726c04-72d5-4024-9d60-286e61ce0850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:02.446460 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08726c04-72d5-4024-9d60-286e61ce0850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:02.447645 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08726c04-72d5-4024-9d60-286e61ce0850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:02.448070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08726c04-72d5-4024-9d60-286e61ce0850 admin admin] PATH_INFO: `/v3/users/926ffe520c224a8ca11f69b256633b8c` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:02.450148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08726c04-72d5-4024-9d60-286e61ce0850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=926ffe520c224a8ca11f69b256633b8c)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:02.452484 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08726c04-72d5-4024-9d60-286e61ce0850 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:02.547957 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-08726c04-72d5-4024-9d60-286e61ce0850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '926ffe520c224a8ca11f69b256633b8c'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:02.567065 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f0033-cb16-440a-9f38-6c644a2d8e89 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:02.569479 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-722f0033-cb16-440a-9f38-6c644a2d8e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:02.580325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-08726c04-72d5-4024-9d60-286e61ce0850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '926ffe520c224a8ca11f69b256633b8c'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:02.587301 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f0033-cb16-440a-9f38-6c644a2d8e89 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:02.594152 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-08726c04-72d5-4024-9d60-286e61ce0850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '926ffe520c224a8ca11f69b256633b8c'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:02.595082 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-08726c04-72d5-4024-9d60-286e61ce0850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '926ffe520c224a8ca11f69b256633b8c'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:02.611635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:02.616347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-08726c04-72d5-4024-9d60-286e61ce0850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '926ffe520c224a8ca11f69b256633b8c'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:02.621065 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96721bc-6696-4a39-a3d7-d4cb2c1b03d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:02.621965 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96721bc-6696-4a39-a3d7-d4cb2c1b03d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:02.622294 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96721bc-6696-4a39-a3d7-d4cb2c1b03d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:02.622576 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96721bc-6696-4a39-a3d7-d4cb2c1b03d5 admin admin] PATH_INFO: `/v3/projects/6bc60a2ae2c240d58ae254fb23d39606` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:02.624025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96721bc-6696-4a39-a3d7-d4cb2c1b03d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bc60a2ae2c240d58ae254fb23d39606)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:02.627041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96721bc-6696-4a39-a3d7-d4cb2c1b03d5 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:02.628723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 942/1852] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:02 2022] DELETE /identity/v3/users/926ffe520c224a8ca11f69b256633b8c => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:02.689693 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-f96721bc-6696-4a39-a3d7-d4cb2c1b03d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bc60a2ae2c240d58ae254fb23d39606', 'request_id': 'req-f96721bc-6696-4a39-a3d7-d4cb2c1b03d5'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:02.697777 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-f96721bc-6696-4a39-a3d7-d4cb2c1b03d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bc60a2ae2c240d58ae254fb23d39606', 'request_id': 'req-f96721bc-6696-4a39-a3d7-d4cb2c1b03d5'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:02.709513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-f96721bc-6696-4a39-a3d7-d4cb2c1b03d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bc60a2ae2c240d58ae254fb23d39606', 'request_id': 'req-f96721bc-6696-4a39-a3d7-d4cb2c1b03d5'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:02.726850 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-f96721bc-6696-4a39-a3d7-d4cb2c1b03d5 admin admin] The token cache is being invalidate because project 6bc60a2ae2c240d58ae254fb23d39606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:02.727384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-f96721bc-6696-4a39-a3d7-d4cb2c1b03d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:02.728558 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-f96721bc-6696-4a39-a3d7-d4cb2c1b03d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:02.734179 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 911/1853] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:02 2022] DELETE /identity/v3/projects/6bc60a2ae2c240d58ae254fb23d39606 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:02.738787 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cba2d7-a534-4b56-b862-9e796fc994da None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:02.739164 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cba2d7-a534-4b56-b862-9e796fc994da None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:02.739522 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cba2d7-a534-4b56-b862-9e796fc994da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:02.765188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-61cba2d7-a534-4b56-b862-9e796fc994da None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:02.767588 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-61cba2d7-a534-4b56-b862-9e796fc994da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:02.898459 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 943/1854] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:02.906541 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfeaf0-7acc-4021-94c2-a9a0ce1be259 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:02.906928 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfeaf0-7acc-4021-94c2-a9a0ce1be259 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:02.907280 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfeaf0-7acc-4021-94c2-a9a0ce1be259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:02.927190 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=76,keystone:DELETE=21,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:02.934627 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-04cfeaf0-7acc-4021-94c2-a9a0ce1be259 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:02.937035 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-04cfeaf0-7acc-4021-94c2-a9a0ce1be259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:02.956874 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 912/1855] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:02.958070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cba2d7-a534-4b56-b862-9e796fc994da None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:02.970527 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cba2d7-a534-4b56-b862-9e796fc994da None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:02.975829 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae821bb-1590-40cf-a77b-1f3995ca3a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:02.976477 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae821bb-1590-40cf-a77b-1f3995ca3a1a admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:02.976776 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae821bb-1590-40cf-a77b-1f3995ca3a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:02.977064 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae821bb-1590-40cf-a77b-1f3995ca3a1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:02.978007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae821bb-1590-40cf-a77b-1f3995ca3a1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:18:02.978378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae821bb-1590-40cf-a77b-1f3995ca3a1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:02.980834 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae821bb-1590-40cf-a77b-1f3995ca3a1a admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:03.005553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 944/1856] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:18:03.008708 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfeaf0-7acc-4021-94c2-a9a0ce1be259 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:03.024581 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfeaf0-7acc-4021-94c2-a9a0ce1be259 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:03.030264 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae821bb-1590-40cf-a77b-1f3995ca3a1a admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:03.034227 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-aae821bb-1590-40cf-a77b-1f3995ca3a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:03.038417 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004e906-ef6d-4d6b-84cb-b845ae0df825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:03.039159 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004e906-ef6d-4d6b-84cb-b845ae0df825 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:03.039446 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004e906-ef6d-4d6b-84cb-b845ae0df825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:03.039768 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004e906-ef6d-4d6b-84cb-b845ae0df825 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:03.040420 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004e906-ef6d-4d6b-84cb-b845ae0df825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:03.042476 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004e906-ef6d-4d6b-84cb-b845ae0df825 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:03.084151 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae821bb-1590-40cf-a77b-1f3995ca3a1a admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:03.093342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 913/1857] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:03 2022] POST /identity/v3/projects => generated 379 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:03.094859 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004e906-ef6d-4d6b-84cb-b845ae0df825 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:03.100582 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d82b75-0e67-4667-bcaa-91e674160408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:03.101498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d82b75-0e67-4667-bcaa-91e674160408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:03.101788 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d82b75-0e67-4667-bcaa-91e674160408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:03.102070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d82b75-0e67-4667-bcaa-91e674160408 admin admin] PATH_INFO: `/v3/projects/3ad6270e53384a5db8da6b1ac5a060aa` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:03.105911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d82b75-0e67-4667-bcaa-91e674160408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ad6270e53384a5db8da6b1ac5a060aa)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:03.107874 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d82b75-0e67-4667-bcaa-91e674160408 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:03.179569 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004e906-ef6d-4d6b-84cb-b845ae0df825 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:03.198073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-89d82b75-0e67-4667-bcaa-91e674160408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ad6270e53384a5db8da6b1ac5a060aa', 'request_id': 'req-89d82b75-0e67-4667-bcaa-91e674160408'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:03.208590 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-89d82b75-0e67-4667-bcaa-91e674160408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ad6270e53384a5db8da6b1ac5a060aa', 'request_id': 'req-89d82b75-0e67-4667-bcaa-91e674160408'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:03.227207 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-89d82b75-0e67-4667-bcaa-91e674160408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ad6270e53384a5db8da6b1ac5a060aa', 'request_id': 'req-89d82b75-0e67-4667-bcaa-91e674160408'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:03.239260 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-89d82b75-0e67-4667-bcaa-91e674160408 admin admin] The token cache is being invalidate because project 3ad6270e53384a5db8da6b1ac5a060aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:03.239626 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-89d82b75-0e67-4667-bcaa-91e674160408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:03.240395 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-89d82b75-0e67-4667-bcaa-91e674160408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:03.242074 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 945/1858] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:03 2022] DELETE /identity/v3/projects/3ad6270e53384a5db8da6b1ac5a060aa => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:18:03.247351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c68f49-0aed-4871-9ba4-fba7ff807b34 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:03.247714 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c68f49-0aed-4871-9ba4-fba7ff807b34 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:03.248067 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c68f49-0aed-4871-9ba4-fba7ff807b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:03.258628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9e8bb-0901-4dd7-84f6-9e884a7ce61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:03.259312 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9e8bb-0901-4dd7-84f6-9e884a7ce61d admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:03.259601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9e8bb-0901-4dd7-84f6-9e884a7ce61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:03.259908 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9e8bb-0901-4dd7-84f6-9e884a7ce61d admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:03.260604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9e8bb-0901-4dd7-84f6-9e884a7ce61d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:03.263494 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9e8bb-0901-4dd7-84f6-9e884a7ce61d admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:03.274557 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-95c68f49-0aed-4871-9ba4-fba7ff807b34 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:03.275986 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-95c68f49-0aed-4871-9ba4-fba7ff807b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:03.286246 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 946/1859] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:18:03.287384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 914/1860] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:03 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:18:03.290989 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c68f49-0aed-4871-9ba4-fba7ff807b34 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:03.292620 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-95c68f49-0aed-4871-9ba4-fba7ff807b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:03.293408 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e14943-eece-4a95-b46b-ef401529f58f None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:03.293768 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e14943-eece-4a95-b46b-ef401529f58f None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:03.294137 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e14943-eece-4a95-b46b-ef401529f58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:03.305671 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c68f49-0aed-4871-9ba4-fba7ff807b34 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:03.311422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb739edf-c0be-4ff9-af3d-431eea6302fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:03.312106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb739edf-c0be-4ff9-af3d-431eea6302fd admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:03.312399 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb739edf-c0be-4ff9-af3d-431eea6302fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:03.312684 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb739edf-c0be-4ff9-af3d-431eea6302fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:03.313422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb739edf-c0be-4ff9-af3d-431eea6302fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:03.313886 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-a8e14943-eece-4a95-b46b-ef401529f58f None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:03.315084 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb739edf-c0be-4ff9-af3d-431eea6302fd admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:03.315348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-a8e14943-eece-4a95-b46b-ef401529f58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:03.325113 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 915/1861] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:03.329593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 947/1862] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:18:03.329723 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e14943-eece-4a95-b46b-ef401529f58f None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:03.330591 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb739edf-c0be-4ff9-af3d-431eea6302fd admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:03.340396 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e14943-eece-4a95-b46b-ef401529f58f None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:03.340613 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb739edf-c0be-4ff9-af3d-431eea6302fd admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:03.345403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a570e-c95d-491d-b7d1-2e289111567f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:03.345567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194eeb0-5f2c-4685-80c5-74399361addc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:03.346088 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a570e-c95d-491d-b7d1-2e289111567f admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:03.346217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194eeb0-5f2c-4685-80c5-74399361addc admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:03.346415 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a570e-c95d-491d-b7d1-2e289111567f admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:03.346516 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194eeb0-5f2c-4685-80c5-74399361addc admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:03.346694 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a570e-c95d-491d-b7d1-2e289111567f admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:03.346797 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194eeb0-5f2c-4685-80c5-74399361addc admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:03.347422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194eeb0-5f2c-4685-80c5-74399361addc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:03.347524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a570e-c95d-491d-b7d1-2e289111567f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:18:03.347734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a570e-c95d-491d-b7d1-2e289111567f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:03.349025 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194eeb0-5f2c-4685-80c5-74399361addc admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:03.349330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a570e-c95d-491d-b7d1-2e289111567f admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:03.360990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 948/1863] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:18:03.365070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194eeb0-5f2c-4685-80c5-74399361addc admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:03.365438 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 916/1864] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:18:03.366415 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a570e-c95d-491d-b7d1-2e289111567f admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:03.376984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194eeb0-5f2c-4685-80c5-74399361addc admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:03.377210 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a570e-c95d-491d-b7d1-2e289111567f admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:03.384158 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a4a0b-e9be-47db-9ce1-957d51e5b628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:03.384543 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1eb79-6975-4ed3-8e34-a3893a3ea0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:03.385227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1eb79-6975-4ed3-8e34-a3893a3ea0d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:03.385405 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a4a0b-e9be-47db-9ce1-957d51e5b628 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:03.385623 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1eb79-6975-4ed3-8e34-a3893a3ea0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:03.385720 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a4a0b-e9be-47db-9ce1-957d51e5b628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:03.385801 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1eb79-6975-4ed3-8e34-a3893a3ea0d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:03.386005 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a4a0b-e9be-47db-9ce1-957d51e5b628 admin admin] PATH_INFO: `/v3/projects/446de66ea2a4457ea5325ef60b1c8da8/users/31098a04649649bd815fafe208722a2f/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:03.386565 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1eb79-6975-4ed3-8e34-a3893a3ea0d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:03.389161 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1eb79-6975-4ed3-8e34-a3893a3ea0d9 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:03.402196 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a4a0b-e9be-47db-9ce1-957d51e5b628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=446de66ea2a4457ea5325ef60b1c8da8, user_id=31098a04649649bd815fafe208722a2f, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:03.404926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a4a0b-e9be-47db-9ce1-957d51e5b628 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:03.418759 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 949/1865] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:03 2022] PUT /identity/v3/projects/446de66ea2a4457ea5325ef60b1c8da8/users/31098a04649649bd815fafe208722a2f/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:03.422667 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 917/1866] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:03 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:18:03.427575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a4a0b-e9be-47db-9ce1-957d51e5b628 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:03.430237 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732118e-c9a0-44ae-964a-9228e3c1cbe5 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:03.430580 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732118e-c9a0-44ae-964a-9228e3c1cbe5 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:03.430874 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732118e-c9a0-44ae-964a-9228e3c1cbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:03.444223 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:03.460405 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-c732118e-c9a0-44ae-964a-9228e3c1cbe5 None None] MFA Rules not processed for user `31098a04649649bd815fafe208722a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:03.461670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-c732118e-c9a0-44ae-964a-9228e3c1cbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:03.485549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:03.519918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a4a0b-e9be-47db-9ce1-957d51e5b628 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:03.548927 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 918/1867] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:03.553755 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732118e-c9a0-44ae-964a-9228e3c1cbe5 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:03.617039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63064d55-26f9-4f8b-ad9d-58d5915e1232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:03.617811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63064d55-26f9-4f8b-ad9d-58d5915e1232 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:03.620179 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63064d55-26f9-4f8b-ad9d-58d5915e1232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:03.620477 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63064d55-26f9-4f8b-ad9d-58d5915e1232 admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:03.622005 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63064d55-26f9-4f8b-ad9d-58d5915e1232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:03.623959 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63064d55-26f9-4f8b-ad9d-58d5915e1232 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:03.654864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 950/1868] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:03 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:03.660048 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63064d55-26f9-4f8b-ad9d-58d5915e1232 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:03.679064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732118e-c9a0-44ae-964a-9228e3c1cbe5 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:03.686661 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c4ea2-63fd-4220-84a9-d4c3687704ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:03.687606 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c4ea2-63fd-4220-84a9-d4c3687704ac admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:03.691160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c4ea2-63fd-4220-84a9-d4c3687704ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:03.691686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c4ea2-63fd-4220-84a9-d4c3687704ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:03.691792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63064d55-26f9-4f8b-ad9d-58d5915e1232 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:03.692763 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c4ea2-63fd-4220-84a9-d4c3687704ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:03.694915 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c4ea2-63fd-4220-84a9-d4c3687704ac admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:03.699728 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b276603-0aff-4466-ba06-7e53345a4642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:03.700579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b276603-0aff-4466-ba06-7e53345a4642 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:03.701107 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b276603-0aff-4466-ba06-7e53345a4642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:03.701589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b276603-0aff-4466-ba06-7e53345a4642 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:03.702857 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b276603-0aff-4466-ba06-7e53345a4642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:03.705082 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b276603-0aff-4466-ba06-7e53345a4642 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:03.727510 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 951/1869] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:03.728856 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b276603-0aff-4466-ba06-7e53345a4642 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:03.739563 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b276603-0aff-4466-ba06-7e53345a4642 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:03.743213 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 919/1870] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:03 2022] POST /identity/v3/projects => generated 381 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:03.744312 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c4ea2-63fd-4220-84a9-d4c3687704ac admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:03.802624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f214e-bcb9-4f38-a3cd-8dafe6aba472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:03.803403 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f214e-bcb9-4f38-a3cd-8dafe6aba472 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:03.803758 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f214e-bcb9-4f38-a3cd-8dafe6aba472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:03.804067 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f214e-bcb9-4f38-a3cd-8dafe6aba472 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:03.804801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f214e-bcb9-4f38-a3cd-8dafe6aba472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:03.806435 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f214e-bcb9-4f38-a3cd-8dafe6aba472 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:03.807997 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c4ea2-63fd-4220-84a9-d4c3687704ac admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:03.812695 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ae334-3b5b-4f8d-b435-f7d822657396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:03.813443 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ae334-3b5b-4f8d-b435-f7d822657396 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:03.813729 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ae334-3b5b-4f8d-b435-f7d822657396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:03.814010 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ae334-3b5b-4f8d-b435-f7d822657396 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:03.814872 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ae334-3b5b-4f8d-b435-f7d822657396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:03.816812 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 952/1871] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:18:03.816931 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ae334-3b5b-4f8d-b435-f7d822657396 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:03.821021 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f214e-bcb9-4f38-a3cd-8dafe6aba472 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:03.831702 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f214e-bcb9-4f38-a3cd-8dafe6aba472 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:03.838380 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00247f-7c87-4aae-bc94-44095015d25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:03.839319 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00247f-7c87-4aae-bc94-44095015d25a admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:03.839607 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00247f-7c87-4aae-bc94-44095015d25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:03.840425 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00247f-7c87-4aae-bc94-44095015d25a admin admin] PATH_INFO: `/v3/projects/6a77079b30784a58b9f34bf79273b4e6/users/9cf6ea3732f5465cb68910733650609a/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:03.845963 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 920/1872] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:03 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:03.846919 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ae334-3b5b-4f8d-b435-f7d822657396 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:03.859595 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ae334-3b5b-4f8d-b435-f7d822657396 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:03.860687 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00247f-7c87-4aae-bc94-44095015d25a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a77079b30784a58b9f34bf79273b4e6, user_id=9cf6ea3732f5465cb68910733650609a, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:03.865187 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362925bd-a288-4a29-9f65-d1467376728c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:03.865926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00247f-7c87-4aae-bc94-44095015d25a admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:03.867530 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362925bd-a288-4a29-9f65-d1467376728c admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:03.867825 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362925bd-a288-4a29-9f65-d1467376728c admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:03.868107 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362925bd-a288-4a29-9f65-d1467376728c admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:03.868904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362925bd-a288-4a29-9f65-d1467376728c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:03.870712 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362925bd-a288-4a29-9f65-d1467376728c admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:03.885957 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 921/1873] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:18:03.891179 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362925bd-a288-4a29-9f65-d1467376728c admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:03.900309 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 953/1874] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:03 2022] PUT /identity/v3/projects/6a77079b30784a58b9f34bf79273b4e6/users/9cf6ea3732f5465cb68910733650609a/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:18:03.904307 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06536bab-ecd0-47b8-b0c9-5f35d5942684 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:03.905018 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06536bab-ecd0-47b8-b0c9-5f35d5942684 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:03.905307 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06536bab-ecd0-47b8-b0c9-5f35d5942684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:03.923331 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362925bd-a288-4a29-9f65-d1467376728c admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:03.931433 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:03.946147 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-06536bab-ecd0-47b8-b0c9-5f35d5942684 None None] MFA Rules not processed for user `9cf6ea3732f5465cb68910733650609a`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:03.947484 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-06536bab-ecd0-47b8-b0c9-5f35d5942684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:03.956618 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:03.994656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af4c1b-0ad3-4902-a6ae-106a15043a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:03.995369 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af4c1b-0ad3-4902-a6ae-106a15043a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:03.995626 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af4c1b-0ad3-4902-a6ae-106a15043a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:03.995904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af4c1b-0ad3-4902-a6ae-106a15043a58 admin admin] PATH_INFO: `/v3/projects/3587324be030411f90d891ddebba64d6/users/7cdfb622ef0d4bf0ac646ccd5e4e188f/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:04.012295 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af4c1b-0ad3-4902-a6ae-106a15043a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3587324be030411f90d891ddebba64d6, user_id=7cdfb622ef0d4bf0ac646ccd5e4e188f, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:04.014603 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af4c1b-0ad3-4902-a6ae-106a15043a58 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:04.034722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 922/1875] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:03 2022] PUT /identity/v3/projects/3587324be030411f90d891ddebba64d6/users/7cdfb622ef0d4bf0ac646ccd5e4e188f/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:18:04.035648 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af4c1b-0ad3-4902-a6ae-106a15043a58 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:04.038256 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 954/1876] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:04.047639 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06536bab-ecd0-47b8-b0c9-5f35d5942684 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:04.049548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-06536bab-ecd0-47b8-b0c9-5f35d5942684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:04.119187 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af4c1b-0ad3-4902-a6ae-106a15043a58 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:04.125441 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06536bab-ecd0-47b8-b0c9-5f35d5942684 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:04.126083 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f48e1b-4311-4d34-ba06-b52c2a8db5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:04.127054 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f48e1b-4311-4d34-ba06-b52c2a8db5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:04.127356 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f48e1b-4311-4d34-ba06-b52c2a8db5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:04.127698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f48e1b-4311-4d34-ba06-b52c2a8db5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:04.128823 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f48e1b-4311-4d34-ba06-b52c2a8db5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:04.130786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f48e1b-4311-4d34-ba06-b52c2a8db5b9 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:04.142380 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 923/1877] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:04.146508 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f48e1b-4311-4d34-ba06-b52c2a8db5b9 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:04.159882 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f48e1b-4311-4d34-ba06-b52c2a8db5b9 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:04.166851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ff64b-aaff-48fc-81db-c01405bdd0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:04.167769 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ff64b-aaff-48fc-81db-c01405bdd0c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:04.168122 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ff64b-aaff-48fc-81db-c01405bdd0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:04.169865 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ff64b-aaff-48fc-81db-c01405bdd0c9 admin admin] PATH_INFO: `/v3/projects/3587324be030411f90d891ddebba64d6/users/7cdfb622ef0d4bf0ac646ccd5e4e188f/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:04.172443 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ff64b-aaff-48fc-81db-c01405bdd0c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3587324be030411f90d891ddebba64d6, user_id=7cdfb622ef0d4bf0ac646ccd5e4e188f, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:04.175318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ff64b-aaff-48fc-81db-c01405bdd0c9 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:04.193819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 924/1878] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:04 2022] PUT /identity/v3/projects/3587324be030411f90d891ddebba64d6/users/7cdfb622ef0d4bf0ac646ccd5e4e188f/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:18:04.200463 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfefa59-81d7-4fa3-a20d-355c58fec357 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:04.201232 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfefa59-81d7-4fa3-a20d-355c58fec357 service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:04.201586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfefa59-81d7-4fa3-a20d-355c58fec357 service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:04.201925 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfefa59-81d7-4fa3-a20d-355c58fec357 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:04.204706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ce2dc-fee3-4987-8a7b-1300f95be4fa None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:04.205010 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ce2dc-fee3-4987-8a7b-1300f95be4fa None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:04.205288 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ce2dc-fee3-4987-8a7b-1300f95be4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:04.247169 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-c77ce2dc-fee3-4987-8a7b-1300f95be4fa None None] MFA Rules not processed for user `7cdfb622ef0d4bf0ac646ccd5e4e188f`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:04.248705 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-c77ce2dc-fee3-4987-8a7b-1300f95be4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:04.299683 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfefa59-81d7-4fa3-a20d-355c58fec357 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:04.301172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfefa59-81d7-4fa3-a20d-355c58fec357 service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:04.310942 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 955/1879] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:04.347162 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 925/1880] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:04.360086 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfefa59-81d7-4fa3-a20d-355c58fec357 service cinder] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:04.362810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-ddfefa59-81d7-4fa3-a20d-355c58fec357 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:04.382010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfefa59-81d7-4fa3-a20d-355c58fec357 service cinder] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:04.394382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:04.441130 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9089550-bab9-4180-b993-af5c74f051ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:04.441793 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9089550-bab9-4180-b993-af5c74f051ae service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:04.442077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9089550-bab9-4180-b993-af5c74f051ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:04.442428 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9089550-bab9-4180-b993-af5c74f051ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:04.452901 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9089550-bab9-4180-b993-af5c74f051ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:04.454377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9089550-bab9-4180-b993-af5c74f051ae service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:04.464571 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 956/1881] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:04.838417 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ce2dc-fee3-4987-8a7b-1300f95be4fa None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:04.840402 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-c77ce2dc-fee3-4987-8a7b-1300f95be4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:04.887175 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:04.975744 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ce2dc-fee3-4987-8a7b-1300f95be4fa None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:04.986390 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010014e0-7486-4019-b5ab-54c7444426a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:04.987755 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010014e0-7486-4019-b5ab-54c7444426a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:04.988055 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010014e0-7486-4019-b5ab-54c7444426a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:04.988338 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010014e0-7486-4019-b5ab-54c7444426a1 admin admin] PATH_INFO: `/v3/users/3e93e0354f5842b1a05ea7cbe548436f` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:04.989697 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010014e0-7486-4019-b5ab-54c7444426a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e93e0354f5842b1a05ea7cbe548436f)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:04.991785 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010014e0-7486-4019-b5ab-54c7444426a1 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:05.114166 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-010014e0-7486-4019-b5ab-54c7444426a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e93e0354f5842b1a05ea7cbe548436f'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:05.115598 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-010014e0-7486-4019-b5ab-54c7444426a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e93e0354f5842b1a05ea7cbe548436f'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:05.131305 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-010014e0-7486-4019-b5ab-54c7444426a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e93e0354f5842b1a05ea7cbe548436f'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:05.145863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-010014e0-7486-4019-b5ab-54c7444426a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e93e0354f5842b1a05ea7cbe548436f'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:05.180628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-010014e0-7486-4019-b5ab-54c7444426a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e93e0354f5842b1a05ea7cbe548436f'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:05.206728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 926/1882] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:04 2022] DELETE /identity/v3/users/3e93e0354f5842b1a05ea7cbe548436f => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:05.210153 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ee93c-22f8-4b32-92a1-eec324969e84 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:05.210638 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ee93c-22f8-4b32-92a1-eec324969e84 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:05.210823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ee93c-22f8-4b32-92a1-eec324969e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:05.225500 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010014e0-7486-4019-b5ab-54c7444426a1 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:05.228374 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-010014e0-7486-4019-b5ab-54c7444426a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:05.244284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-3e1ee93c-22f8-4b32-92a1-eec324969e84 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:05.245537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-3e1ee93c-22f8-4b32-92a1-eec324969e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:05.331524 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 957/1883] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:05.343180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010014e0-7486-4019-b5ab-54c7444426a1 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:05.347447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ee93c-22f8-4b32-92a1-eec324969e84 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:05.348633 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61bec3-354c-4e36-94d1-7115a5f6d94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:05.348961 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-3e1ee93c-22f8-4b32-92a1-eec324969e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:05.349640 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61bec3-354c-4e36-94d1-7115a5f6d94a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:05.349913 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61bec3-354c-4e36-94d1-7115a5f6d94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:05.350302 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61bec3-354c-4e36-94d1-7115a5f6d94a admin admin] PATH_INFO: `/v3/users/31098a04649649bd815fafe208722a2f` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:05.351651 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61bec3-354c-4e36-94d1-7115a5f6d94a admin admin] RBAC: Authorizing `identity:delete_user(user_id=31098a04649649bd815fafe208722a2f)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:05.353679 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61bec3-354c-4e36-94d1-7115a5f6d94a admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:05.407961 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:05.418293 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-8f61bec3-354c-4e36-94d1-7115a5f6d94a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31098a04649649bd815fafe208722a2f'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:05.419638 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-8f61bec3-354c-4e36-94d1-7115a5f6d94a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31098a04649649bd815fafe208722a2f'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:05.428117 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-8f61bec3-354c-4e36-94d1-7115a5f6d94a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31098a04649649bd815fafe208722a2f'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:05.429513 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ee93c-22f8-4b32-92a1-eec324969e84 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:05.433303 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ee9f5-cde8-4b08-aa0b-c8ab83298b7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:05.434788 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ee9f5-cde8-4b08-aa0b-c8ab83298b7f service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:05.437722 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ee9f5-cde8-4b08-aa0b-c8ab83298b7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:05.437722 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ee9f5-cde8-4b08-aa0b-c8ab83298b7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:05.442642 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-0e6ee9f5-cde8-4b08-aa0b-c8ab83298b7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:05.442933 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-8f61bec3-354c-4e36-94d1-7115a5f6d94a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31098a04649649bd815fafe208722a2f'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:05.464323 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ee9f5-cde8-4b08-aa0b-c8ab83298b7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:05.469622 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ee9f5-cde8-4b08-aa0b-c8ab83298b7f service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:05.471741 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-8f61bec3-354c-4e36-94d1-7115a5f6d94a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31098a04649649bd815fafe208722a2f'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:05.486216 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 958/1884] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:18:05.504306 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 927/1885] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:05 2022] DELETE /identity/v3/users/31098a04649649bd815fafe208722a2f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:18:05.505057 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30071252-cbb2-4f13-9c4e-9e31d20c1521 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:05.505856 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30071252-cbb2-4f13-9c4e-9e31d20c1521 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:05.505856 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30071252-cbb2-4f13-9c4e-9e31d20c1521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:05.542345 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-30071252-cbb2-4f13-9c4e-9e31d20c1521 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:05.544409 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-30071252-cbb2-4f13-9c4e-9e31d20c1521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:05.618319 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:05.649181 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 959/1886] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:05.678374 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61bec3-354c-4e36-94d1-7115a5f6d94a admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:05.680795 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-8f61bec3-354c-4e36-94d1-7115a5f6d94a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:05.829173 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61bec3-354c-4e36-94d1-7115a5f6d94a admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:05.833040 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e142a-e1c0-421f-a0cc-fba33f772390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:05.833990 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e142a-e1c0-421f-a0cc-fba33f772390 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:05.834312 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e142a-e1c0-421f-a0cc-fba33f772390 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:05.834595 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e142a-e1c0-421f-a0cc-fba33f772390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:05.846515 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e142a-e1c0-421f-a0cc-fba33f772390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:05.848021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e142a-e1c0-421f-a0cc-fba33f772390 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:05.860899 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 928/1887] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:05.980592 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30071252-cbb2-4f13-9c4e-9e31d20c1521 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:05.983788 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-30071252-cbb2-4f13-9c4e-9e31d20c1521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:06.010090 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30071252-cbb2-4f13-9c4e-9e31d20c1521 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:06.030300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e12d93-9e16-4761-8747-bc7459afc35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:06.031190 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e12d93-9e16-4761-8747-bc7459afc35a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:06.031479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e12d93-9e16-4761-8747-bc7459afc35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:06.031753 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e12d93-9e16-4761-8747-bc7459afc35a admin admin] PATH_INFO: `/v3/projects/787c4b9b4e74467fa39b57d0a7b2803b` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:06.034901 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e12d93-9e16-4761-8747-bc7459afc35a admin admin] RBAC: Authorizing `identity:delete_project(project_id=787c4b9b4e74467fa39b57d0a7b2803b)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:06.036930 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e12d93-9e16-4761-8747-bc7459afc35a admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:06.146692 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-e3e12d93-9e16-4761-8747-bc7459afc35a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '787c4b9b4e74467fa39b57d0a7b2803b', 'request_id': 'req-e3e12d93-9e16-4761-8747-bc7459afc35a'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:06.161642 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-e3e12d93-9e16-4761-8747-bc7459afc35a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '787c4b9b4e74467fa39b57d0a7b2803b', 'request_id': 'req-e3e12d93-9e16-4761-8747-bc7459afc35a'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:06.183223 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-e3e12d93-9e16-4761-8747-bc7459afc35a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '787c4b9b4e74467fa39b57d0a7b2803b', 'request_id': 'req-e3e12d93-9e16-4761-8747-bc7459afc35a'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:06.208330 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-e3e12d93-9e16-4761-8747-bc7459afc35a admin admin] The token cache is being invalidate because project 787c4b9b4e74467fa39b57d0a7b2803b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:06.209713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-e3e12d93-9e16-4761-8747-bc7459afc35a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:06.210572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-e3e12d93-9e16-4761-8747-bc7459afc35a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:06.213060 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 960/1888] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:05 2022] DELETE /identity/v3/projects/787c4b9b4e74467fa39b57d0a7b2803b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:06.218001 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e142a-e1c0-421f-a0cc-fba33f772390 service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:06.233891 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e142a-e1c0-421f-a0cc-fba33f772390 service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:06.343867 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d11d9-d68e-419d-9eb2-c2e198d1fd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:06.344884 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d11d9-d68e-419d-9eb2-c2e198d1fd34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:06.345203 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d11d9-d68e-419d-9eb2-c2e198d1fd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:06.345453 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d11d9-d68e-419d-9eb2-c2e198d1fd34 admin admin] PATH_INFO: `/v3/users/08a2b92646a24fc99082ace1847af662` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:06.347525 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d11d9-d68e-419d-9eb2-c2e198d1fd34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08a2b92646a24fc99082ace1847af662)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:06.349268 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d11d9-d68e-419d-9eb2-c2e198d1fd34 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:06.390885 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e12d93-9e16-4761-8747-bc7459afc35a admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:06.395521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-e3e12d93-9e16-4761-8747-bc7459afc35a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:06.425471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e12d93-9e16-4761-8747-bc7459afc35a admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:06.445658 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06bc0a-60b7-4cbb-bc30-6b917a2aed33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:06.446552 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06bc0a-60b7-4cbb-bc30-6b917a2aed33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:06.446847 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06bc0a-60b7-4cbb-bc30-6b917a2aed33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:06.447131 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06bc0a-60b7-4cbb-bc30-6b917a2aed33 admin admin] PATH_INFO: `/v3/projects/446de66ea2a4457ea5325ef60b1c8da8` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:06.449649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06bc0a-60b7-4cbb-bc30-6b917a2aed33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=446de66ea2a4457ea5325ef60b1c8da8)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:06.451664 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06bc0a-60b7-4cbb-bc30-6b917a2aed33 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:06.481403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-3d2d11d9-d68e-419d-9eb2-c2e198d1fd34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08a2b92646a24fc99082ace1847af662'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:06.482816 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-3d2d11d9-d68e-419d-9eb2-c2e198d1fd34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08a2b92646a24fc99082ace1847af662'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:06.506226 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-3d2d11d9-d68e-419d-9eb2-c2e198d1fd34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08a2b92646a24fc99082ace1847af662'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:06.514324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:06.521424 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-3d2d11d9-d68e-419d-9eb2-c2e198d1fd34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08a2b92646a24fc99082ace1847af662'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:06.541794 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-3d2d11d9-d68e-419d-9eb2-c2e198d1fd34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08a2b92646a24fc99082ace1847af662'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:06.551463 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-aa06bc0a-60b7-4cbb-bc30-6b917a2aed33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '446de66ea2a4457ea5325ef60b1c8da8', 'request_id': 'req-aa06bc0a-60b7-4cbb-bc30-6b917a2aed33'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:06.556716 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 929/1889] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:06 2022] DELETE /identity/v3/users/08a2b92646a24fc99082ace1847af662 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:06.576396 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-aa06bc0a-60b7-4cbb-bc30-6b917a2aed33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '446de66ea2a4457ea5325ef60b1c8da8', 'request_id': 'req-aa06bc0a-60b7-4cbb-bc30-6b917a2aed33'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:06.601554 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-aa06bc0a-60b7-4cbb-bc30-6b917a2aed33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '446de66ea2a4457ea5325ef60b1c8da8', 'request_id': 'req-aa06bc0a-60b7-4cbb-bc30-6b917a2aed33'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:06.620415 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-aa06bc0a-60b7-4cbb-bc30-6b917a2aed33 admin admin] The token cache is being invalidate because project 446de66ea2a4457ea5325ef60b1c8da8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:06.620872 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-aa06bc0a-60b7-4cbb-bc30-6b917a2aed33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:06.621906 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-aa06bc0a-60b7-4cbb-bc30-6b917a2aed33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:06.623916 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 961/1890] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:06 2022] DELETE /identity/v3/projects/446de66ea2a4457ea5325ef60b1c8da8 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:06.628466 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d11d9-d68e-419d-9eb2-c2e198d1fd34 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:06.630014 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-3d2d11d9-d68e-419d-9eb2-c2e198d1fd34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:06.735240 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d11d9-d68e-419d-9eb2-c2e198d1fd34 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:06.747086 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15e763-0d3c-452c-b201-6059139349d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:06.748021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15e763-0d3c-452c-b201-6059139349d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:06.748622 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15e763-0d3c-452c-b201-6059139349d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:06.748975 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15e763-0d3c-452c-b201-6059139349d6 admin admin] PATH_INFO: `/v3/users/7cdfb622ef0d4bf0ac646ccd5e4e188f` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:06.755391 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c15e763-0d3c-452c-b201-6059139349d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cdfb622ef0d4bf0ac646ccd5e4e188f)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:06.757649 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c15e763-0d3c-452c-b201-6059139349d6 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:06.845284 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-4c15e763-0d3c-452c-b201-6059139349d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cdfb622ef0d4bf0ac646ccd5e4e188f'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:06.846884 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-4c15e763-0d3c-452c-b201-6059139349d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cdfb622ef0d4bf0ac646ccd5e4e188f'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:06.857378 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-4c15e763-0d3c-452c-b201-6059139349d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cdfb622ef0d4bf0ac646ccd5e4e188f'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:06.868266 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-4c15e763-0d3c-452c-b201-6059139349d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cdfb622ef0d4bf0ac646ccd5e4e188f'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:06.885276 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-4c15e763-0d3c-452c-b201-6059139349d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cdfb622ef0d4bf0ac646ccd5e4e188f'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:06.893485 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 930/1891] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:06 2022] DELETE /identity/v3/users/7cdfb622ef0d4bf0ac646ccd5e4e188f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:06.934420 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06bc0a-60b7-4cbb-bc30-6b917a2aed33 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:06.935981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-aa06bc0a-60b7-4cbb-bc30-6b917a2aed33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:07.042599 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06bc0a-60b7-4cbb-bc30-6b917a2aed33 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:07.049158 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:07.117477 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cb147-8d50-4402-8a67-80d9fc4770d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:07.118415 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cb147-8d50-4402-8a67-80d9fc4770d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:07.118692 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cb147-8d50-4402-8a67-80d9fc4770d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:07.119334 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cb147-8d50-4402-8a67-80d9fc4770d3 admin admin] PATH_INFO: `/v3/projects/dcd2d9e065424837af0c8a653f9bc895` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:07.120188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cb147-8d50-4402-8a67-80d9fc4770d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcd2d9e065424837af0c8a653f9bc895)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:07.122178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cb147-8d50-4402-8a67-80d9fc4770d3 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:07.178101 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-6a7cb147-8d50-4402-8a67-80d9fc4770d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcd2d9e065424837af0c8a653f9bc895', 'request_id': 'req-6a7cb147-8d50-4402-8a67-80d9fc4770d3'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:07.186061 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-6a7cb147-8d50-4402-8a67-80d9fc4770d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcd2d9e065424837af0c8a653f9bc895', 'request_id': 'req-6a7cb147-8d50-4402-8a67-80d9fc4770d3'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:07.195118 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-6a7cb147-8d50-4402-8a67-80d9fc4770d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcd2d9e065424837af0c8a653f9bc895', 'request_id': 'req-6a7cb147-8d50-4402-8a67-80d9fc4770d3'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:07.217022 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-6a7cb147-8d50-4402-8a67-80d9fc4770d3 admin admin] The token cache is being invalidate because project dcd2d9e065424837af0c8a653f9bc895 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:07.218172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-6a7cb147-8d50-4402-8a67-80d9fc4770d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:07.220061 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-6a7cb147-8d50-4402-8a67-80d9fc4770d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:07.233146 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 962/1892] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:06 2022] DELETE /identity/v3/projects/dcd2d9e065424837af0c8a653f9bc895 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:07.233430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab715686-0a58-4d0b-a5e6-f79af4067a39 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:07.233430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab715686-0a58-4d0b-a5e6-f79af4067a39 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:07.233430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab715686-0a58-4d0b-a5e6-f79af4067a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:07.250952 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-ab715686-0a58-4d0b-a5e6-f79af4067a39 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:07.252675 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-ab715686-0a58-4d0b-a5e6-f79af4067a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:07.319698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:07.343152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 931/1893] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:07.347574 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4cf3e-4ad7-40f9-a141-c77c7f4561ed None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:07.347923 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4cf3e-4ad7-40f9-a141-c77c7f4561ed None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:07.348276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4cf3e-4ad7-40f9-a141-c77c7f4561ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:07.381447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-99f4cf3e-4ad7-40f9-a141-c77c7f4561ed None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:07.382969 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-99f4cf3e-4ad7-40f9-a141-c77c7f4561ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:07.391039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 963/1894] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:07.395793 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab715686-0a58-4d0b-a5e6-f79af4067a39 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:07.406888 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab715686-0a58-4d0b-a5e6-f79af4067a39 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:07.412338 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e199e5-c2fe-4392-b766-c2a3b005db67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:07.413027 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e199e5-c2fe-4392-b766-c2a3b005db67 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:07.413318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e199e5-c2fe-4392-b766-c2a3b005db67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:07.413597 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e199e5-c2fe-4392-b766-c2a3b005db67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:07.414511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e199e5-c2fe-4392-b766-c2a3b005db67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:18:07.414899 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e199e5-c2fe-4392-b766-c2a3b005db67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:07.416546 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e199e5-c2fe-4392-b766-c2a3b005db67 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:07.444828 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 932/1895] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:18:07.446051 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4cf3e-4ad7-40f9-a141-c77c7f4561ed None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:07.457246 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4cf3e-4ad7-40f9-a141-c77c7f4561ed None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:07.464193 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da53d96-1aea-47f6-b71a-10087d60e196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:07.464833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da53d96-1aea-47f6-b71a-10087d60e196 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:07.465272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da53d96-1aea-47f6-b71a-10087d60e196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:07.465559 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da53d96-1aea-47f6-b71a-10087d60e196 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:07.466297 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da53d96-1aea-47f6-b71a-10087d60e196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:07.468579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da53d96-1aea-47f6-b71a-10087d60e196 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:07.504757 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 964/1896] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:07 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:07.509762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e199e5-c2fe-4392-b766-c2a3b005db67 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:07.525191 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e199e5-c2fe-4392-b766-c2a3b005db67 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:07.663878 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713554f-ceb2-4df8-a868-fdb3e78fe1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:07.666358 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713554f-ceb2-4df8-a868-fdb3e78fe1a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:07.666676 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713554f-ceb2-4df8-a868-fdb3e78fe1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:07.666968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713554f-ceb2-4df8-a868-fdb3e78fe1a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:07.671231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713554f-ceb2-4df8-a868-fdb3e78fe1a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:07.679585 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713554f-ceb2-4df8-a868-fdb3e78fe1a3 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:07.733339 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 933/1897] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:07 2022] POST /identity/v3/users => generated 294 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:07.737470 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da53d96-1aea-47f6-b71a-10087d60e196 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:07.751088 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da53d96-1aea-47f6-b71a-10087d60e196 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:07.757219 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39183f7c-324b-482a-8c0b-7c18fcfcedef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:07.757921 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39183f7c-324b-482a-8c0b-7c18fcfcedef admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:07.758239 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39183f7c-324b-482a-8c0b-7c18fcfcedef admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:07.758522 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39183f7c-324b-482a-8c0b-7c18fcfcedef admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:07.759526 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39183f7c-324b-482a-8c0b-7c18fcfcedef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:07.761350 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39183f7c-324b-482a-8c0b-7c18fcfcedef admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:07.778740 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 965/1898] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:07.782952 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713554f-ceb2-4df8-a868-fdb3e78fe1a3 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:07.801753 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713554f-ceb2-4df8-a868-fdb3e78fe1a3 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:07.810351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e2ed0-a375-40ec-9e3c-16c4624fc7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:07.811070 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e2ed0-a375-40ec-9e3c-16c4624fc7cb admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:07.811474 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e2ed0-a375-40ec-9e3c-16c4624fc7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:07.811687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e2ed0-a375-40ec-9e3c-16c4624fc7cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:07.812516 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e2ed0-a375-40ec-9e3c-16c4624fc7cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:07.814276 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e2ed0-a375-40ec-9e3c-16c4624fc7cb admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:07.829893 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39183f7c-324b-482a-8c0b-7c18fcfcedef admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:07.831997 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-39183f7c-324b-482a-8c0b-7c18fcfcedef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:07.837306 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 934/1899] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:07.838378 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e2ed0-a375-40ec-9e3c-16c4624fc7cb admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:07.849639 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e2ed0-a375-40ec-9e3c-16c4624fc7cb admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:07.855415 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a5ba0-db2c-4eed-bcc6-1dddacf785b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:07.856437 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a5ba0-db2c-4eed-bcc6-1dddacf785b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:07.856728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a5ba0-db2c-4eed-bcc6-1dddacf785b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:07.857169 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a5ba0-db2c-4eed-bcc6-1dddacf785b8 admin admin] PATH_INFO: `/v3/projects/ec8e163dd1c242f18dad2882dea33118/users/57e324cfb2e3417ab76bd37af385d3d0/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:07.858230 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39183f7c-324b-482a-8c0b-7c18fcfcedef admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:07.865467 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f500a4b-e8e5-4e37-b316-b755cc00354f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:07.866591 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f500a4b-e8e5-4e37-b316-b755cc00354f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:07.867458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f500a4b-e8e5-4e37-b316-b755cc00354f admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:07.867458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f500a4b-e8e5-4e37-b316-b755cc00354f admin admin] PATH_INFO: `/v3/projects/3587324be030411f90d891ddebba64d6` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:07.869295 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f500a4b-e8e5-4e37-b316-b755cc00354f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3587324be030411f90d891ddebba64d6)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:07.873335 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f500a4b-e8e5-4e37-b316-b755cc00354f admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:07.878493 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a5ba0-db2c-4eed-bcc6-1dddacf785b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec8e163dd1c242f18dad2882dea33118, user_id=57e324cfb2e3417ab76bd37af385d3d0, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:07.881269 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a5ba0-db2c-4eed-bcc6-1dddacf785b8 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:07.905487 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 935/1900] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:07 2022] PUT /identity/v3/projects/ec8e163dd1c242f18dad2882dea33118/users/57e324cfb2e3417ab76bd37af385d3d0/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:07.916414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ddd12-6fc2-4941-b485-f03c262d4a36 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:07.916813 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ddd12-6fc2-4941-b485-f03c262d4a36 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:07.916985 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ddd12-6fc2-4941-b485-f03c262d4a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:07.963088 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-4f500a4b-e8e5-4e37-b316-b755cc00354f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3587324be030411f90d891ddebba64d6', 'request_id': 'req-4f500a4b-e8e5-4e37-b316-b755cc00354f'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:07.977487 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-4f500a4b-e8e5-4e37-b316-b755cc00354f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3587324be030411f90d891ddebba64d6', 'request_id': 'req-4f500a4b-e8e5-4e37-b316-b755cc00354f'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:07.982152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-437ddd12-6fc2-4941-b485-f03c262d4a36 None None] MFA Rules not processed for user `57e324cfb2e3417ab76bd37af385d3d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:07.982967 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:07.983089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-437ddd12-6fc2-4941-b485-f03c262d4a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:07.997677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-4f500a4b-e8e5-4e37-b316-b755cc00354f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3587324be030411f90d891ddebba64d6', 'request_id': 'req-4f500a4b-e8e5-4e37-b316-b755cc00354f'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:08.030681 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-4f500a4b-e8e5-4e37-b316-b755cc00354f admin admin] The token cache is being invalidate because project 3587324be030411f90d891ddebba64d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:08.030987 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-4f500a4b-e8e5-4e37-b316-b755cc00354f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:08.032261 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-4f500a4b-e8e5-4e37-b316-b755cc00354f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:08.034970 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 966/1901] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:07 2022] DELETE /identity/v3/projects/3587324be030411f90d891ddebba64d6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:08.040929 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d279c-a82c-450a-97c7-669028bf0a1d None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:08.041217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d279c-a82c-450a-97c7-669028bf0a1d None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:08.041503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d279c-a82c-450a-97c7-669028bf0a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:08.070245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-186d279c-a82c-450a-97c7-669028bf0a1d None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:08.070245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-186d279c-a82c-450a-97c7-669028bf0a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:08.137587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 936/1902] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:08.141993 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ddd12-6fc2-4941-b485-f03c262d4a36 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:08.143729 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-437ddd12-6fc2-4941-b485-f03c262d4a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:08.155920 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 967/1903] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:08.166260 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75434952-f98d-4517-a06a-10c2ac3aa75d None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:08.166603 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75434952-f98d-4517-a06a-10c2ac3aa75d None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:08.167276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75434952-f98d-4517-a06a-10c2ac3aa75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:08.172809 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ddd12-6fc2-4941-b485-f03c262d4a36 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:08.189512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e145a-6ff5-48d3-bc23-a0abb41f3e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:08.190650 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e145a-6ff5-48d3-bc23-a0abb41f3e2b admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:08.191093 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e145a-6ff5-48d3-bc23-a0abb41f3e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:08.191531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e145a-6ff5-48d3-bc23-a0abb41f3e2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:08.192401 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e145a-6ff5-48d3-bc23-a0abb41f3e2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:08.195531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e145a-6ff5-48d3-bc23-a0abb41f3e2b admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:08.195706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-75434952-f98d-4517-a06a-10c2ac3aa75d None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:08.196965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-75434952-f98d-4517-a06a-10c2ac3aa75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:08.210512 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 968/1904] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:08.211437 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75434952-f98d-4517-a06a-10c2ac3aa75d None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:08.225520 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75434952-f98d-4517-a06a-10c2ac3aa75d None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:08.246746 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b940d7-d437-4cf2-af18-09b4781676a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:08.249036 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b940d7-d437-4cf2-af18-09b4781676a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:08.250788 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b940d7-d437-4cf2-af18-09b4781676a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:08.251243 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b940d7-d437-4cf2-af18-09b4781676a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:08.255426 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b940d7-d437-4cf2-af18-09b4781676a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:18:08.256216 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b940d7-d437-4cf2-af18-09b4781676a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:08.262869 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 937/1905] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:08 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:18:08.264928 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e145a-6ff5-48d3-bc23-a0abb41f3e2b admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:08.265410 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b940d7-d437-4cf2-af18-09b4781676a1 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:08.283611 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 969/1906] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:18:08.284597 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b940d7-d437-4cf2-af18-09b4781676a1 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:08.290069 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:08.295457 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b940d7-d437-4cf2-af18-09b4781676a1 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:08.384150 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e145a-6ff5-48d3-bc23-a0abb41f3e2b admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:08.390702 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f817a-a0b1-4d72-b7a4-b0df0739a0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:08.391375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f817a-a0b1-4d72-b7a4-b0df0739a0f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:08.391940 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f817a-a0b1-4d72-b7a4-b0df0739a0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:08.392224 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f817a-a0b1-4d72-b7a4-b0df0739a0f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:08.392978 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f817a-a0b1-4d72-b7a4-b0df0739a0f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:08.395018 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f817a-a0b1-4d72-b7a4-b0df0739a0f3 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:08.406538 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e89b2d-412b-40cc-be46-8f101595756a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:08.407674 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e89b2d-412b-40cc-be46-8f101595756a admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:08.412776 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e89b2d-412b-40cc-be46-8f101595756a admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:08.413251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e89b2d-412b-40cc-be46-8f101595756a admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:08.414256 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e89b2d-412b-40cc-be46-8f101595756a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:08.417566 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e89b2d-412b-40cc-be46-8f101595756a admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:08.432499 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 938/1907] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:08 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:08.435372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f817a-a0b1-4d72-b7a4-b0df0739a0f3 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:08.466466 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f817a-a0b1-4d72-b7a4-b0df0739a0f3 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:08.476431 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712913e-1b73-4e57-aa7e-c260c52371ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:08.477443 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712913e-1b73-4e57-aa7e-c260c52371ca admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:08.477824 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712913e-1b73-4e57-aa7e-c260c52371ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:08.478040 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 970/1908] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:08 2022] POST /identity/v3/projects => generated 371 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:08.480928 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9a725-eb6e-40d5-a948-4ced82ade044 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:08.480928 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9a725-eb6e-40d5-a948-4ced82ade044 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:08.480928 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9a725-eb6e-40d5-a948-4ced82ade044 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:08.481645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712913e-1b73-4e57-aa7e-c260c52371ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:08.482076 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 971/1909] 10.222.0.17 () {54 vars in 921 bytes} [Tue Jul 12 13:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:18:08.482509 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712913e-1b73-4e57-aa7e-c260c52371ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:08.482948 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9a725-eb6e-40d5-a948-4ced82ade044 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:08.484230 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712913e-1b73-4e57-aa7e-c260c52371ca admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:08.505339 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 939/1910] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:08.506987 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712913e-1b73-4e57-aa7e-c260c52371ca admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:08.524210 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712913e-1b73-4e57-aa7e-c260c52371ca admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:08.655284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:08.670716 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c8d5d-2c01-4cd4-89a7-b301f8c8d314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:08.672182 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c8d5d-2c01-4cd4-89a7-b301f8c8d314 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:08.672510 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c8d5d-2c01-4cd4-89a7-b301f8c8d314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:08.672844 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c8d5d-2c01-4cd4-89a7-b301f8c8d314 admin admin] PATH_INFO: `/v3/projects/399c3dd41f92487c8e58a2aac6e3f9b0/users/fa8151aab97946dc9522d30540e548c9/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:08.705842 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9a725-eb6e-40d5-a948-4ced82ade044 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:08.713182 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5395e8-4abc-42eb-a3f6-8c74fb3589f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:08.713970 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5395e8-4abc-42eb-a3f6-8c74fb3589f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:08.715188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5395e8-4abc-42eb-a3f6-8c74fb3589f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:08.715840 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5395e8-4abc-42eb-a3f6-8c74fb3589f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:08.716846 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5395e8-4abc-42eb-a3f6-8c74fb3589f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:08.719617 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5395e8-4abc-42eb-a3f6-8c74fb3589f1 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:08.735791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c8d5d-2c01-4cd4-89a7-b301f8c8d314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=399c3dd41f92487c8e58a2aac6e3f9b0, user_id=fa8151aab97946dc9522d30540e548c9, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:08.747051 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c8d5d-2c01-4cd4-89a7-b301f8c8d314 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:08.768231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 940/1911] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:08 2022] PUT /identity/v3/projects/399c3dd41f92487c8e58a2aac6e3f9b0/users/fa8151aab97946dc9522d30540e548c9/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:08.781707 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 972/1912] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:08 2022] POST /identity/v3/users => generated 286 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:08.783081 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5395e8-4abc-42eb-a3f6-8c74fb3589f1 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:08.785363 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d4658-821a-4da1-afb8-c1ab571273f8 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:08.785587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d4658-821a-4da1-afb8-c1ab571273f8 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:08.785861 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d4658-821a-4da1-afb8-c1ab571273f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:08.798077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5395e8-4abc-42eb-a3f6-8c74fb3589f1 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:08.814412 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-d24d4658-821a-4da1-afb8-c1ab571273f8 None None] MFA Rules not processed for user `e52dfce1b06346bfbde6ee33e7f6f249`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:08.816634 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-d24d4658-821a-4da1-afb8-c1ab571273f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:08.905230 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc1af4-d3f6-455d-8c99-0cf40f2bd7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:08.906224 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc1af4-d3f6-455d-8c99-0cf40f2bd7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:08.906587 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc1af4-d3f6-455d-8c99-0cf40f2bd7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:08.907306 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc1af4-d3f6-455d-8c99-0cf40f2bd7e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:08.907835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc1af4-d3f6-455d-8c99-0cf40f2bd7e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:08.909926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc1af4-d3f6-455d-8c99-0cf40f2bd7e3 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:08.943518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 973/1913] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:08.943518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc1af4-d3f6-455d-8c99-0cf40f2bd7e3 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:08.963279 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:08.966857 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc1af4-d3f6-455d-8c99-0cf40f2bd7e3 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:08.973569 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301ad56-461b-4ba4-9a76-a5c7b66665e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:08.975024 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301ad56-461b-4ba4-9a76-a5c7b66665e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:08.975868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301ad56-461b-4ba4-9a76-a5c7b66665e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:08.976652 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301ad56-461b-4ba4-9a76-a5c7b66665e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:08.977792 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 941/1914] 10.222.0.17 () {58 vars in 1018 bytes} [Tue Jul 12 13:18:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:08.978244 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301ad56-461b-4ba4-9a76-a5c7b66665e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:08.979086 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d4658-821a-4da1-afb8-c1ab571273f8 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:08.980669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301ad56-461b-4ba4-9a76-a5c7b66665e7 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:08.993354 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d4658-821a-4da1-afb8-c1ab571273f8 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:08.998297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ee610-3e37-43d6-8398-2c605e0e23bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:08.999232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ee610-3e37-43d6-8398-2c605e0e23bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:08.999517 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ee610-3e37-43d6-8398-2c605e0e23bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:08.999936 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ee610-3e37-43d6-8398-2c605e0e23bc admin admin] PATH_INFO: `/v3/projects/399c3dd41f92487c8e58a2aac6e3f9b0/users/fa8151aab97946dc9522d30540e548c9/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:09.002258 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ee610-3e37-43d6-8398-2c605e0e23bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=399c3dd41f92487c8e58a2aac6e3f9b0, user_id=fa8151aab97946dc9522d30540e548c9, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:09.004936 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ee610-3e37-43d6-8398-2c605e0e23bc admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:09.005913 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 974/1915] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:09.010066 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301ad56-461b-4ba4-9a76-a5c7b66665e7 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:09.023290 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 942/1916] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:08 2022] PUT /identity/v3/projects/399c3dd41f92487c8e58a2aac6e3f9b0/users/fa8151aab97946dc9522d30540e548c9/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:09.026552 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301ad56-461b-4ba4-9a76-a5c7b66665e7 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:09.034136 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc84927-5a4e-44e6-ae4c-bef3f395e7e9 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:09.034416 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc84927-5a4e-44e6-ae4c-bef3f395e7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:09.034718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc84927-5a4e-44e6-ae4c-bef3f395e7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:09.069879 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-cbc84927-5a4e-44e6-ae4c-bef3f395e7e9 None None] MFA Rules not processed for user `fa8151aab97946dc9522d30540e548c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:09.071975 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-cbc84927-5a4e-44e6-ae4c-bef3f395e7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:09.118853 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755678b6-ccc5-4bf6-96fa-a3dbba9cd352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:09.119741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755678b6-ccc5-4bf6-96fa-a3dbba9cd352 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:09.120036 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755678b6-ccc5-4bf6-96fa-a3dbba9cd352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:09.120317 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755678b6-ccc5-4bf6-96fa-a3dbba9cd352 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:09.121712 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755678b6-ccc5-4bf6-96fa-a3dbba9cd352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:09.125050 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755678b6-ccc5-4bf6-96fa-a3dbba9cd352 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:09.144067 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 975/1917] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:18:09.145240 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755678b6-ccc5-4bf6-96fa-a3dbba9cd352 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:09.147622 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-755678b6-ccc5-4bf6-96fa-a3dbba9cd352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:09.239614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:09.263758 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 943/1918] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:09.264812 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc84927-5a4e-44e6-ae4c-bef3f395e7e9 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:09.276137 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755678b6-ccc5-4bf6-96fa-a3dbba9cd352 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:09.286479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706859c-672b-4e3a-8ede-9203e3398663 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:09.287182 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706859c-672b-4e3a-8ede-9203e3398663 service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:09.287477 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706859c-672b-4e3a-8ede-9203e3398663 service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:09.287757 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706859c-672b-4e3a-8ede-9203e3398663 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:09.296888 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc84927-5a4e-44e6-ae4c-bef3f395e7e9 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:09.300013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706859c-672b-4e3a-8ede-9203e3398663 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:09.302017 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706859c-672b-4e3a-8ede-9203e3398663 service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:09.302518 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e2642-b3ee-46cb-984f-5e48c8df7399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:09.303545 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e2642-b3ee-46cb-984f-5e48c8df7399 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:09.303897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e2642-b3ee-46cb-984f-5e48c8df7399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:09.304501 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e2642-b3ee-46cb-984f-5e48c8df7399 admin admin] PATH_INFO: `/v3/projects/dfa99b6f4fec4f4697096678e19732b4/users/219ef74b5cd745c28e2990925af8de01/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:09.315662 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 976/1919] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:09.316478 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706859c-672b-4e3a-8ede-9203e3398663 service nova] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:09.318032 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-d706859c-672b-4e3a-8ede-9203e3398663 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:09.326433 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e2642-b3ee-46cb-984f-5e48c8df7399 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfa99b6f4fec4f4697096678e19732b4, user_id=219ef74b5cd745c28e2990925af8de01, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:09.329405 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e2642-b3ee-46cb-984f-5e48c8df7399 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:09.368972 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 944/1920] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:09 2022] PUT /identity/v3/projects/dfa99b6f4fec4f4697096678e19732b4/users/219ef74b5cd745c28e2990925af8de01/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:09.380779 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23bf89-b344-49ef-808c-80fc2d22d0c7 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:09.381093 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23bf89-b344-49ef-808c-80fc2d22d0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:09.381381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23bf89-b344-49ef-808c-80fc2d22d0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:09.406686 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706859c-672b-4e3a-8ede-9203e3398663 service nova] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:09.429163 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-ff23bf89-b344-49ef-808c-80fc2d22d0c7 None None] MFA Rules not processed for user `219ef74b5cd745c28e2990925af8de01`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:09.431100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-ff23bf89-b344-49ef-808c-80fc2d22d0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:09.521503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59123c1-47f7-4ea4-b006-6acf0b3e0c76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:09.522884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59123c1-47f7-4ea4-b006-6acf0b3e0c76 service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:09.523054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59123c1-47f7-4ea4-b006-6acf0b3e0c76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:09.523262 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59123c1-47f7-4ea4-b006-6acf0b3e0c76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:09.552522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 945/1921] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:09.575532 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23bf89-b344-49ef-808c-80fc2d22d0c7 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:09.578286 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-ff23bf89-b344-49ef-808c-80fc2d22d0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:09.633664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23bf89-b344-49ef-808c-80fc2d22d0c7 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:09.653850 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52eb8e-7673-485c-9a07-4a018026972e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:09.654515 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52eb8e-7673-485c-9a07-4a018026972e service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:09.654811 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52eb8e-7673-485c-9a07-4a018026972e service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:09.655093 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52eb8e-7673-485c-9a07-4a018026972e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:09.680476 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59123c1-47f7-4ea4-b006-6acf0b3e0c76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:09.684052 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59123c1-47f7-4ea4-b006-6acf0b3e0c76 service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:09.699493 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52eb8e-7673-485c-9a07-4a018026972e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:09.706186 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52eb8e-7673-485c-9a07-4a018026972e service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:09.715230 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 977/1922] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:09.756701 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 946/1923] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:09.770878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59123c1-47f7-4ea4-b006-6acf0b3e0c76 service cinder] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:09.785925 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52eb8e-7673-485c-9a07-4a018026972e service cinder] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:09.864391 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:09.894060 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:09.923379 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59123c1-47f7-4ea4-b006-6acf0b3e0c76 service cinder] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:09.937718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25601639-6d9a-47c4-9ebb-ae4156f9c9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:09.941930 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25601639-6d9a-47c4-9ebb-ae4156f9c9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:09.942243 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25601639-6d9a-47c4-9ebb-ae4156f9c9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:09.942526 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25601639-6d9a-47c4-9ebb-ae4156f9c9a6 admin admin] PATH_INFO: `/v3/users/57e324cfb2e3417ab76bd37af385d3d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:09.944322 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25601639-6d9a-47c4-9ebb-ae4156f9c9a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e324cfb2e3417ab76bd37af385d3d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:09.949798 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25601639-6d9a-47c4-9ebb-ae4156f9c9a6 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:09.956367 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52eb8e-7673-485c-9a07-4a018026972e service cinder] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:09.976574 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f25b6-4913-4fac-a814-9b993eda56b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:09.977646 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f25b6-4913-4fac-a814-9b993eda56b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:09.977935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f25b6-4913-4fac-a814-9b993eda56b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:09.978236 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f25b6-4913-4fac-a814-9b993eda56b3 admin admin] PATH_INFO: `/v3/users/219ef74b5cd745c28e2990925af8de01` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:09.979587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f25b6-4913-4fac-a814-9b993eda56b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=219ef74b5cd745c28e2990925af8de01)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:09.982758 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f25b6-4913-4fac-a814-9b993eda56b3 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:10.075246 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-25601639-6d9a-47c4-9ebb-ae4156f9c9a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e324cfb2e3417ab76bd37af385d3d0'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:10.100121 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-25601639-6d9a-47c4-9ebb-ae4156f9c9a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e324cfb2e3417ab76bd37af385d3d0'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:10.114905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-25601639-6d9a-47c4-9ebb-ae4156f9c9a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e324cfb2e3417ab76bd37af385d3d0'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:10.115860 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-25601639-6d9a-47c4-9ebb-ae4156f9c9a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e324cfb2e3417ab76bd37af385d3d0'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:10.117966 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d64f25b6-4913-4fac-a814-9b993eda56b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '219ef74b5cd745c28e2990925af8de01'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:10.119355 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d64f25b6-4913-4fac-a814-9b993eda56b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '219ef74b5cd745c28e2990925af8de01'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:10.144415 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d64f25b6-4913-4fac-a814-9b993eda56b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '219ef74b5cd745c28e2990925af8de01'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:10.158176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-25601639-6d9a-47c4-9ebb-ae4156f9c9a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e324cfb2e3417ab76bd37af385d3d0'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:10.161928 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d64f25b6-4913-4fac-a814-9b993eda56b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '219ef74b5cd745c28e2990925af8de01'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:10.175575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 978/1924] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:09 2022] DELETE /identity/v3/users/57e324cfb2e3417ab76bd37af385d3d0 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:10.182598 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806994d9-9c53-4d86-b848-f59bcb554869 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:10.184458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806994d9-9c53-4d86-b848-f59bcb554869 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:10.186050 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806994d9-9c53-4d86-b848-f59bcb554869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:10.195671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d64f25b6-4913-4fac-a814-9b993eda56b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '219ef74b5cd745c28e2990925af8de01'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:10.207154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 947/1925] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:09 2022] DELETE /identity/v3/users/219ef74b5cd745c28e2990925af8de01 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:18:10.214075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1879c-4168-4d64-b6f9-822e939129dc None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:10.214688 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1879c-4168-4d64-b6f9-822e939129dc None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:10.215110 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1879c-4168-4d64-b6f9-822e939129dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:10.218067 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-806994d9-9c53-4d86-b848-f59bcb554869 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:10.219404 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-806994d9-9c53-4d86-b848-f59bcb554869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:10.259648 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-90a1879c-4168-4d64-b6f9-822e939129dc None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:10.262577 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-90a1879c-4168-4d64-b6f9-822e939129dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:10.377484 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 948/1926] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:18:10.379251 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1879c-4168-4d64-b6f9-822e939129dc None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:10.381586 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-90a1879c-4168-4d64-b6f9-822e939129dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:10.390231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 979/1927] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:18:10.391732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806994d9-9c53-4d86-b848-f59bcb554869 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:10.395271 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-806994d9-9c53-4d86-b848-f59bcb554869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:10.399013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1879c-4168-4d64-b6f9-822e939129dc None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:10.407372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98674bde-a099-4594-8ded-c3c2539aab70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:10.408509 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98674bde-a099-4594-8ded-c3c2539aab70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:10.408807 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98674bde-a099-4594-8ded-c3c2539aab70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:10.409553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98674bde-a099-4594-8ded-c3c2539aab70 admin admin] PATH_INFO: `/v3/users/b69cc70d75634e068255a1a2207067b2` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:10.410912 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98674bde-a099-4594-8ded-c3c2539aab70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b69cc70d75634e068255a1a2207067b2)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:10.414542 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98674bde-a099-4594-8ded-c3c2539aab70 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:10.500120 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:10.513794 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-98674bde-a099-4594-8ded-c3c2539aab70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b69cc70d75634e068255a1a2207067b2'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:10.516256 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-98674bde-a099-4594-8ded-c3c2539aab70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b69cc70d75634e068255a1a2207067b2'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:10.533627 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-98674bde-a099-4594-8ded-c3c2539aab70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b69cc70d75634e068255a1a2207067b2'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:10.554235 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-98674bde-a099-4594-8ded-c3c2539aab70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b69cc70d75634e068255a1a2207067b2'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:10.581265 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-98674bde-a099-4594-8ded-c3c2539aab70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b69cc70d75634e068255a1a2207067b2'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:10.590056 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 949/1928] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:10 2022] DELETE /identity/v3/users/b69cc70d75634e068255a1a2207067b2 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:10.591170 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98674bde-a099-4594-8ded-c3c2539aab70 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:10.593172 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-98674bde-a099-4594-8ded-c3c2539aab70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:10.596832 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806994d9-9c53-4d86-b848-f59bcb554869 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:10.665319 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:10.729789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124c353-435f-42cc-8e4f-ab7bfa2c8005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:10.730508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124c353-435f-42cc-8e4f-ab7bfa2c8005 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:10.730794 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124c353-435f-42cc-8e4f-ab7bfa2c8005 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:10.731070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124c353-435f-42cc-8e4f-ab7bfa2c8005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:10.734324 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-0124c353-435f-42cc-8e4f-ab7bfa2c8005 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:10.740740 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98674bde-a099-4594-8ded-c3c2539aab70 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:10.753010 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b7de5-fc69-40e0-8f15-6b5c4de49e8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:10.753624 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b7de5-fc69-40e0-8f15-6b5c4de49e8f service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:10.753895 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b7de5-fc69-40e0-8f15-6b5c4de49e8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:10.754205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b7de5-fc69-40e0-8f15-6b5c4de49e8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:10.758795 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-b94b7de5-fc69-40e0-8f15-6b5c4de49e8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:10.863692 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124c353-435f-42cc-8e4f-ab7bfa2c8005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:10.865305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124c353-435f-42cc-8e4f-ab7bfa2c8005 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:10.876204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 980/1929] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:10.877578 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831095e-3206-4f6b-92b5-d4f885a0d9f0 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:10.878354 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831095e-3206-4f6b-92b5-d4f885a0d9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:10.878354 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831095e-3206-4f6b-92b5-d4f885a0d9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:10.879905 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b7de5-fc69-40e0-8f15-6b5c4de49e8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:10.882029 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b7de5-fc69-40e0-8f15-6b5c4de49e8f service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:10.895674 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 950/1930] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:10.897223 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-7831095e-3206-4f6b-92b5-d4f885a0d9f0 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:10.898938 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-7831095e-3206-4f6b-92b5-d4f885a0d9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:10.909833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 981/1931] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:10.939207 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b7de5-fc69-40e0-8f15-6b5c4de49e8f service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:10.940832 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-b94b7de5-fc69-40e0-8f15-6b5c4de49e8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:10.972440 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b7de5-fc69-40e0-8f15-6b5c4de49e8f service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:10.977893 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc2468-f664-49ae-b526-b5aef4b25bf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:10.979844 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc2468-f664-49ae-b526-b5aef4b25bf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:10.980489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc2468-f664-49ae-b526-b5aef4b25bf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:10.980992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc2468-f664-49ae-b526-b5aef4b25bf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:10.999925 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc2468-f664-49ae-b526-b5aef4b25bf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:11.002848 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc2468-f664-49ae-b526-b5aef4b25bf0 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:11.016952 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 951/1932] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:11.487834 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831095e-3206-4f6b-92b5-d4f885a0d9f0 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:11.489317 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-7831095e-3206-4f6b-92b5-d4f885a0d9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:11.508527 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831095e-3206-4f6b-92b5-d4f885a0d9f0 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:11.520119 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc2468-f664-49ae-b526-b5aef4b25bf0 service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:11.529518 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-3bcc2468-f664-49ae-b526-b5aef4b25bf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:11.531327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da307523-565c-4fcc-9650-c8f9ff488c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:11.533871 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da307523-565c-4fcc-9650-c8f9ff488c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:11.537476 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da307523-565c-4fcc-9650-c8f9ff488c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:11.538457 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da307523-565c-4fcc-9650-c8f9ff488c9f admin admin] PATH_INFO: `/v3/projects/dfa99b6f4fec4f4697096678e19732b4` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:11.541547 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da307523-565c-4fcc-9650-c8f9ff488c9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfa99b6f4fec4f4697096678e19732b4)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:11.548072 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da307523-565c-4fcc-9650-c8f9ff488c9f admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:11.568988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc2468-f664-49ae-b526-b5aef4b25bf0 service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:11.590155 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9ffc2-4f4f-45ad-b5cd-a10544099e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:11.594072 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9ffc2-4f4f-45ad-b5cd-a10544099e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:11.597647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9ffc2-4f4f-45ad-b5cd-a10544099e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:11.601069 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9ffc2-4f4f-45ad-b5cd-a10544099e29 admin admin] PATH_INFO: `/v3/projects/ec8e163dd1c242f18dad2882dea33118` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:11.605170 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9ffc2-4f4f-45ad-b5cd-a10544099e29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec8e163dd1c242f18dad2882dea33118)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:11.611559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9ffc2-4f4f-45ad-b5cd-a10544099e29 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:11.697105 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-da307523-565c-4fcc-9650-c8f9ff488c9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfa99b6f4fec4f4697096678e19732b4', 'request_id': 'req-da307523-565c-4fcc-9650-c8f9ff488c9f'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:11.709688 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-da307523-565c-4fcc-9650-c8f9ff488c9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfa99b6f4fec4f4697096678e19732b4', 'request_id': 'req-da307523-565c-4fcc-9650-c8f9ff488c9f'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:11.744662 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:11.745027 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-da307523-565c-4fcc-9650-c8f9ff488c9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfa99b6f4fec4f4697096678e19732b4', 'request_id': 'req-da307523-565c-4fcc-9650-c8f9ff488c9f'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:11.748524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a0a9ffc2-4f4f-45ad-b5cd-a10544099e29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec8e163dd1c242f18dad2882dea33118', 'request_id': 'req-a0a9ffc2-4f4f-45ad-b5cd-a10544099e29'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:11.761236 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a0a9ffc2-4f4f-45ad-b5cd-a10544099e29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec8e163dd1c242f18dad2882dea33118', 'request_id': 'req-a0a9ffc2-4f4f-45ad-b5cd-a10544099e29'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:11.774283 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-da307523-565c-4fcc-9650-c8f9ff488c9f admin admin] The token cache is being invalidate because project dfa99b6f4fec4f4697096678e19732b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:11.774837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-da307523-565c-4fcc-9650-c8f9ff488c9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:11.775735 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-da307523-565c-4fcc-9650-c8f9ff488c9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:11.780992 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 982/1933] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:11 2022] DELETE /identity/v3/projects/dfa99b6f4fec4f4697096678e19732b4 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:11.782755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da307523-565c-4fcc-9650-c8f9ff488c9f admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:11.783099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a0a9ffc2-4f4f-45ad-b5cd-a10544099e29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec8e163dd1c242f18dad2882dea33118', 'request_id': 'req-a0a9ffc2-4f4f-45ad-b5cd-a10544099e29'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:11.785421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-da307523-565c-4fcc-9650-c8f9ff488c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:11.809908 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a0a9ffc2-4f4f-45ad-b5cd-a10544099e29 admin admin] The token cache is being invalidate because project ec8e163dd1c242f18dad2882dea33118 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:11.810254 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a0a9ffc2-4f4f-45ad-b5cd-a10544099e29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:11.811001 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a0a9ffc2-4f4f-45ad-b5cd-a10544099e29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:11.812879 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 952/1934] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:11 2022] DELETE /identity/v3/projects/ec8e163dd1c242f18dad2882dea33118 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:11.817396 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce3c64-d58a-4f3c-9fc1-f6c23a8010dd None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:11.817696 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce3c64-d58a-4f3c-9fc1-f6c23a8010dd None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:11.818152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce3c64-d58a-4f3c-9fc1-f6c23a8010dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:11.864388 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-30ce3c64-d58a-4f3c-9fc1-f6c23a8010dd None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:11.865657 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-30ce3c64-d58a-4f3c-9fc1-f6c23a8010dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:11.874330 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:11.900790 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da307523-565c-4fcc-9650-c8f9ff488c9f admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:12.010908 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 953/1935] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:12.012553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce3c64-d58a-4f3c-9fc1-f6c23a8010dd None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:12.016456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-30ce3c64-d58a-4f3c-9fc1-f6c23a8010dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:12.026725 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260170c-caf9-46d6-9ab6-412aa671066e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:12.028419 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260170c-caf9-46d6-9ab6-412aa671066e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:12.029152 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260170c-caf9-46d6-9ab6-412aa671066e admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:12.030282 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260170c-caf9-46d6-9ab6-412aa671066e admin admin] PATH_INFO: `/v3/projects/40c916ec591f48d2a322041e28a8d067` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:12.032258 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260170c-caf9-46d6-9ab6-412aa671066e admin admin] RBAC: Authorizing `identity:delete_project(project_id=40c916ec591f48d2a322041e28a8d067)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:12.032423 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce3c64-d58a-4f3c-9fc1-f6c23a8010dd None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:12.035033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260170c-caf9-46d6-9ab6-412aa671066e admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:12.039799 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab499349-bdad-4637-b364-eec563940bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:12.040772 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab499349-bdad-4637-b364-eec563940bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:12.041062 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab499349-bdad-4637-b364-eec563940bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:12.042035 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab499349-bdad-4637-b364-eec563940bc3 admin admin] PATH_INFO: `/v3/users/fa8151aab97946dc9522d30540e548c9` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:12.044127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab499349-bdad-4637-b364-eec563940bc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa8151aab97946dc9522d30540e548c9)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:12.047462 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab499349-bdad-4637-b364-eec563940bc3 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:12.134609 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-ab499349-bdad-4637-b364-eec563940bc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa8151aab97946dc9522d30540e548c9'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:12.135637 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-ab499349-bdad-4637-b364-eec563940bc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa8151aab97946dc9522d30540e548c9'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:12.136271 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-1260170c-caf9-46d6-9ab6-412aa671066e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40c916ec591f48d2a322041e28a8d067', 'request_id': 'req-1260170c-caf9-46d6-9ab6-412aa671066e'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:12.144708 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-ab499349-bdad-4637-b364-eec563940bc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa8151aab97946dc9522d30540e548c9'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:12.156399 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-ab499349-bdad-4637-b364-eec563940bc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa8151aab97946dc9522d30540e548c9'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:12.169341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-1260170c-caf9-46d6-9ab6-412aa671066e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40c916ec591f48d2a322041e28a8d067', 'request_id': 'req-1260170c-caf9-46d6-9ab6-412aa671066e'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:12.191040 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-ab499349-bdad-4637-b364-eec563940bc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa8151aab97946dc9522d30540e548c9'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:12.191488 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-1260170c-caf9-46d6-9ab6-412aa671066e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40c916ec591f48d2a322041e28a8d067', 'request_id': 'req-1260170c-caf9-46d6-9ab6-412aa671066e'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:12.205272 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 954/1936] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:12 2022] DELETE /identity/v3/users/fa8151aab97946dc9522d30540e548c9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:12.206755 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27375bf3-c8a8-482b-8e0d-b05c424ff095 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:12.207056 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27375bf3-c8a8-482b-8e0d-b05c424ff095 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:12.207343 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27375bf3-c8a8-482b-8e0d-b05c424ff095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:12.229562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-1260170c-caf9-46d6-9ab6-412aa671066e admin admin] The token cache is being invalidate because project 40c916ec591f48d2a322041e28a8d067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:12.229932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-1260170c-caf9-46d6-9ab6-412aa671066e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:12.231372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-1260170c-caf9-46d6-9ab6-412aa671066e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:12.232612 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-27375bf3-c8a8-482b-8e0d-b05c424ff095 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:12.234877 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-27375bf3-c8a8-482b-8e0d-b05c424ff095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:12.235020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 983/1937] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:11 2022] DELETE /identity/v3/projects/40c916ec591f48d2a322041e28a8d067 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:12.238476 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260170c-caf9-46d6-9ab6-412aa671066e admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:12.242992 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-1260170c-caf9-46d6-9ab6-412aa671066e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:12.319793 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:12.344965 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 955/1938] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:12.350202 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27375bf3-c8a8-482b-8e0d-b05c424ff095 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:12.358939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260170c-caf9-46d6-9ab6-412aa671066e admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:12.366595 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641fcd0-d38d-42fe-ab65-c0ddd65e7e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:12.367882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641fcd0-d38d-42fe-ab65-c0ddd65e7e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:12.368300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641fcd0-d38d-42fe-ab65-c0ddd65e7e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:12.368900 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641fcd0-d38d-42fe-ab65-c0ddd65e7e63 admin admin] PATH_INFO: `/v3/users/03f33472df134c22b16ddb16a2beb1ea` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:12.370868 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27375bf3-c8a8-482b-8e0d-b05c424ff095 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:12.377958 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c32d9-4fd4-4f6c-a024-f5ebe94b33ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:12.378678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c32d9-4fd4-4f6c-a024-f5ebe94b33ec admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:12.378963 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c32d9-4fd4-4f6c-a024-f5ebe94b33ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:12.379247 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c32d9-4fd4-4f6c-a024-f5ebe94b33ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:12.380025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c32d9-4fd4-4f6c-a024-f5ebe94b33ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:18:12.380349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c32d9-4fd4-4f6c-a024-f5ebe94b33ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:12.380456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641fcd0-d38d-42fe-ab65-c0ddd65e7e63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03f33472df134c22b16ddb16a2beb1ea)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:12.382333 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c32d9-4fd4-4f6c-a024-f5ebe94b33ec admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:12.383317 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641fcd0-d38d-42fe-ab65-c0ddd65e7e63 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:12.402479 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 956/1939] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:18:12.404873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c32d9-4fd4-4f6c-a024-f5ebe94b33ec admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:12.416344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c32d9-4fd4-4f6c-a024-f5ebe94b33ec admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:12.423346 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675a14d-0164-447d-a4b3-d2e85b4d9510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:12.424131 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675a14d-0164-447d-a4b3-d2e85b4d9510 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:12.424410 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675a14d-0164-447d-a4b3-d2e85b4d9510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:12.424743 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675a14d-0164-447d-a4b3-d2e85b4d9510 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:12.425515 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675a14d-0164-447d-a4b3-d2e85b4d9510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:12.427551 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675a14d-0164-447d-a4b3-d2e85b4d9510 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:12.436652 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:12.458834 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f641fcd0-d38d-42fe-ab65-c0ddd65e7e63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03f33472df134c22b16ddb16a2beb1ea'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:12.469116 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 957/1940] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:12 2022] POST /identity/v3/projects => generated 369 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:12.473955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675a14d-0164-447d-a4b3-d2e85b4d9510 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:12.486553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f641fcd0-d38d-42fe-ab65-c0ddd65e7e63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03f33472df134c22b16ddb16a2beb1ea'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:12.496720 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f641fcd0-d38d-42fe-ab65-c0ddd65e7e63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03f33472df134c22b16ddb16a2beb1ea'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:12.497845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f641fcd0-d38d-42fe-ab65-c0ddd65e7e63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03f33472df134c22b16ddb16a2beb1ea'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:12.515022 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f641fcd0-d38d-42fe-ab65-c0ddd65e7e63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03f33472df134c22b16ddb16a2beb1ea'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:12.523742 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 984/1941] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:12 2022] DELETE /identity/v3/users/03f33472df134c22b16ddb16a2beb1ea => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:12.566172 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675a14d-0164-447d-a4b3-d2e85b4d9510 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:12.598010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641fcd0-d38d-42fe-ab65-c0ddd65e7e63 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:12.606096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-f641fcd0-d38d-42fe-ab65-c0ddd65e7e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:12.671029 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd316e-1f07-4d72-9bc1-24e505b49da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:12.671948 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd316e-1f07-4d72-9bc1-24e505b49da9 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:12.672302 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd316e-1f07-4d72-9bc1-24e505b49da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:12.672649 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd316e-1f07-4d72-9bc1-24e505b49da9 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:12.673466 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd316e-1f07-4d72-9bc1-24e505b49da9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:12.675615 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd316e-1f07-4d72-9bc1-24e505b49da9 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:12.714852 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 958/1942] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:12 2022] POST /identity/v3/users => generated 285 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:18:12.716384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd316e-1f07-4d72-9bc1-24e505b49da9 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:12.719887 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-3fcd316e-1f07-4d72-9bc1-24e505b49da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:12.740641 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd316e-1f07-4d72-9bc1-24e505b49da9 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:12.751093 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5d37a-68f1-4d40-bb25-a6e2bdd82d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:12.751813 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5d37a-68f1-4d40-bb25-a6e2bdd82d46 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:12.752105 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5d37a-68f1-4d40-bb25-a6e2bdd82d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:12.752386 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5d37a-68f1-4d40-bb25-a6e2bdd82d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:12.754405 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5d37a-68f1-4d40-bb25-a6e2bdd82d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:12.758494 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5d37a-68f1-4d40-bb25-a6e2bdd82d46 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:12.781473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 959/1943] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:12.785438 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5d37a-68f1-4d40-bb25-a6e2bdd82d46 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:12.785642 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641fcd0-d38d-42fe-ab65-c0ddd65e7e63 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:12.794617 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90217f3e-ae5a-4cdf-bf7c-1ca1be5589fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:12.796003 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90217f3e-ae5a-4cdf-bf7c-1ca1be5589fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:12.796298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90217f3e-ae5a-4cdf-bf7c-1ca1be5589fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:12.796579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90217f3e-ae5a-4cdf-bf7c-1ca1be5589fe admin admin] PATH_INFO: `/v3/projects/399c3dd41f92487c8e58a2aac6e3f9b0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:12.798387 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90217f3e-ae5a-4cdf-bf7c-1ca1be5589fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=399c3dd41f92487c8e58a2aac6e3f9b0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:12.799512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5d37a-68f1-4d40-bb25-a6e2bdd82d46 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:12.800412 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90217f3e-ae5a-4cdf-bf7c-1ca1be5589fe admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:12.806798 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434590c-9460-484b-93d4-ab5a60d4e9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:12.807516 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434590c-9460-484b-93d4-ab5a60d4e9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:12.808237 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434590c-9460-484b-93d4-ab5a60d4e9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:12.808237 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434590c-9460-484b-93d4-ab5a60d4e9c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:12.808966 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a434590c-9460-484b-93d4-ab5a60d4e9c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:12.810609 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a434590c-9460-484b-93d4-ab5a60d4e9c7 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:12.825500 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 960/1944] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:18:12.826864 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434590c-9460-484b-93d4-ab5a60d4e9c7 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:12.837832 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434590c-9460-484b-93d4-ab5a60d4e9c7 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:12.844363 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e897c-715c-4d9b-97a5-c1e2dad73ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:12.845391 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e897c-715c-4d9b-97a5-c1e2dad73ae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:12.845709 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e897c-715c-4d9b-97a5-c1e2dad73ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:12.846079 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e897c-715c-4d9b-97a5-c1e2dad73ae9 admin admin] PATH_INFO: `/v3/projects/638dfb23bfc445e392691283776872c7/users/e427cded71b24920b908dc09fb75d5ec/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:12.857727 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-90217f3e-ae5a-4cdf-bf7c-1ca1be5589fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '399c3dd41f92487c8e58a2aac6e3f9b0', 'request_id': 'req-90217f3e-ae5a-4cdf-bf7c-1ca1be5589fe'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:12.865786 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-90217f3e-ae5a-4cdf-bf7c-1ca1be5589fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '399c3dd41f92487c8e58a2aac6e3f9b0', 'request_id': 'req-90217f3e-ae5a-4cdf-bf7c-1ca1be5589fe'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:12.866769 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e897c-715c-4d9b-97a5-c1e2dad73ae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=638dfb23bfc445e392691283776872c7, user_id=e427cded71b24920b908dc09fb75d5ec, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:12.869814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e897c-715c-4d9b-97a5-c1e2dad73ae9 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:12.874942 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-90217f3e-ae5a-4cdf-bf7c-1ca1be5589fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '399c3dd41f92487c8e58a2aac6e3f9b0', 'request_id': 'req-90217f3e-ae5a-4cdf-bf7c-1ca1be5589fe'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:12.888631 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-90217f3e-ae5a-4cdf-bf7c-1ca1be5589fe admin admin] The token cache is being invalidate because project 399c3dd41f92487c8e58a2aac6e3f9b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:12.889026 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-90217f3e-ae5a-4cdf-bf7c-1ca1be5589fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:12.889658 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-90217f3e-ae5a-4cdf-bf7c-1ca1be5589fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:12.891675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 985/1945] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:12 2022] DELETE /identity/v3/projects/399c3dd41f92487c8e58a2aac6e3f9b0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:18:12.893066 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 961/1946] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:12 2022] PUT /identity/v3/projects/638dfb23bfc445e392691283776872c7/users/e427cded71b24920b908dc09fb75d5ec/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:12.896304 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b068fa5-584e-41ab-bd93-271f39849f3f None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:12.896603 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b068fa5-584e-41ab-bd93-271f39849f3f None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:12.896939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b068fa5-584e-41ab-bd93-271f39849f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:12.898303 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2679f-65fe-4527-bb07-49d35f9fde16 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:12.898629 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2679f-65fe-4527-bb07-49d35f9fde16 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:12.898946 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2679f-65fe-4527-bb07-49d35f9fde16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:12.911309 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:12.920468 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-7b068fa5-584e-41ab-bd93-271f39849f3f None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:12.921798 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-7b068fa5-584e-41ab-bd93-271f39849f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:12.927905 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-a3e2679f-65fe-4527-bb07-49d35f9fde16 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:12.927905 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-a3e2679f-65fe-4527-bb07-49d35f9fde16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:12.972493 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:13.015580 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 962/1947] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:13.016393 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2679f-65fe-4527-bb07-49d35f9fde16 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:13.019773 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-a3e2679f-65fe-4527-bb07-49d35f9fde16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:13.030209 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 986/1948] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:18:13.030924 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b068fa5-584e-41ab-bd93-271f39849f3f None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:13.034178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-7b068fa5-584e-41ab-bd93-271f39849f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:13.044901 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2679f-65fe-4527-bb07-49d35f9fde16 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:13.051608 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385db121-d2f5-47bd-9570-959e7a776eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:13.053277 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385db121-d2f5-47bd-9570-959e7a776eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:13.053924 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385db121-d2f5-47bd-9570-959e7a776eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:13.054430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385db121-d2f5-47bd-9570-959e7a776eed admin admin] PATH_INFO: `/v3/projects/b3238cf758bd4c1dae9d9df899ccd4e9` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:13.056638 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385db121-d2f5-47bd-9570-959e7a776eed admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3238cf758bd4c1dae9d9df899ccd4e9)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:13.059813 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385db121-d2f5-47bd-9570-959e7a776eed admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:13.115886 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b068fa5-584e-41ab-bd93-271f39849f3f None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:13.149731 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-385db121-d2f5-47bd-9570-959e7a776eed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3238cf758bd4c1dae9d9df899ccd4e9', 'request_id': 'req-385db121-d2f5-47bd-9570-959e7a776eed'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:13.158418 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-385db121-d2f5-47bd-9570-959e7a776eed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3238cf758bd4c1dae9d9df899ccd4e9', 'request_id': 'req-385db121-d2f5-47bd-9570-959e7a776eed'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:13.170300 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-385db121-d2f5-47bd-9570-959e7a776eed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3238cf758bd4c1dae9d9df899ccd4e9', 'request_id': 'req-385db121-d2f5-47bd-9570-959e7a776eed'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:13.186262 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-385db121-d2f5-47bd-9570-959e7a776eed admin admin] The token cache is being invalidate because project b3238cf758bd4c1dae9d9df899ccd4e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:13.186600 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-385db121-d2f5-47bd-9570-959e7a776eed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:13.187301 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-385db121-d2f5-47bd-9570-959e7a776eed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:13.189243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 963/1949] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:13 2022] DELETE /identity/v3/projects/b3238cf758bd4c1dae9d9df899ccd4e9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:13.190330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68787d8f-1a51-4676-960a-fdeeff7f0727 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:13.190620 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68787d8f-1a51-4676-960a-fdeeff7f0727 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:13.190900 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68787d8f-1a51-4676-960a-fdeeff7f0727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:13.211435 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-68787d8f-1a51-4676-960a-fdeeff7f0727 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:13.212913 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-68787d8f-1a51-4676-960a-fdeeff7f0727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:13.218629 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8355987-7180-4513-b245-5705b0d0e2e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:13.219718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8355987-7180-4513-b245-5705b0d0e2e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:13.219718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8355987-7180-4513-b245-5705b0d0e2e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:13.219954 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8355987-7180-4513-b245-5705b0d0e2e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:13.224710 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a8355987-7180-4513-b245-5705b0d0e2e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:13.301310 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 964/1950] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:13.303814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf6d3d-bdeb-4bd0-ad30-db059a18c339 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:13.304379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf6d3d-bdeb-4bd0-ad30-db059a18c339 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:13.304681 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf6d3d-bdeb-4bd0-ad30-db059a18c339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:13.344923 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-cdcf6d3d-bdeb-4bd0-ad30-db059a18c339 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:13.346945 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-cdcf6d3d-bdeb-4bd0-ad30-db059a18c339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:13.348342 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8355987-7180-4513-b245-5705b0d0e2e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:13.349982 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8355987-7180-4513-b245-5705b0d0e2e5 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:13.366348 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 987/1951] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:13.366508 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 965/1952] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:13.375928 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bdef6-c292-447b-acf0-78f5eaf0002d None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:13.376484 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bdef6-c292-447b-acf0-78f5eaf0002d None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:13.377056 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bdef6-c292-447b-acf0-78f5eaf0002d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:13.379534 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8355987-7180-4513-b245-5705b0d0e2e5 service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:13.401078 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8355987-7180-4513-b245-5705b0d0e2e5 service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:13.410412 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-1c4bdef6-c292-447b-acf0-78f5eaf0002d None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:13.411668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-1c4bdef6-c292-447b-acf0-78f5eaf0002d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:13.421522 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cb925-371a-4a44-95fc-c58986da7441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:13.421522 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cb925-371a-4a44-95fc-c58986da7441 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:13.421522 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cb925-371a-4a44-95fc-c58986da7441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:13.421770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cb925-371a-4a44-95fc-c58986da7441 admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:13.428170 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0cb925-371a-4a44-95fc-c58986da7441 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:18:13.428498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0cb925-371a-4a44-95fc-c58986da7441 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:13.430198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0cb925-371a-4a44-95fc-c58986da7441 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:13.444666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 966/1953] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:18:13.449611 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bdef6-c292-447b-acf0-78f5eaf0002d None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:13.462925 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 988/1954] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:18:13.465550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cb925-371a-4a44-95fc-c58986da7441 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:13.470465 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bdef6-c292-447b-acf0-78f5eaf0002d None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:13.479110 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cb925-371a-4a44-95fc-c58986da7441 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:13.485582 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874dac30-c6bf-4c24-9dbc-615459a08711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:13.485995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf2e18-c4ac-45cc-8f72-c95b3c33fa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:13.486875 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf2e18-c4ac-45cc-8f72-c95b3c33fa0a admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:13.487054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dac30-c6bf-4c24-9dbc-615459a08711 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:13.487152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf2e18-c4ac-45cc-8f72-c95b3c33fa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:13.487341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dac30-c6bf-4c24-9dbc-615459a08711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:13.487447 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf2e18-c4ac-45cc-8f72-c95b3c33fa0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:13.487612 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dac30-c6bf-4c24-9dbc-615459a08711 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:13.488273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874dac30-c6bf-4c24-9dbc-615459a08711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:13.490722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf2e18-c4ac-45cc-8f72-c95b3c33fa0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:18:13.490944 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874dac30-c6bf-4c24-9dbc-615459a08711 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:13.491051 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf2e18-c4ac-45cc-8f72-c95b3c33fa0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:13.493354 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf2e18-c4ac-45cc-8f72-c95b3c33fa0a admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:13.528090 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 967/1955] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:18:13.543770 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf2e18-c4ac-45cc-8f72-c95b3c33fa0a admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:13.556368 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 989/1956] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:13 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:13.561648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874dac30-c6bf-4c24-9dbc-615459a08711 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:13.563973 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:13.577710 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf2e18-c4ac-45cc-8f72-c95b3c33fa0a admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:13.583471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:13.645651 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874dac30-c6bf-4c24-9dbc-615459a08711 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:13.659649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71153176-2841-4074-9968-9f7fa351badb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:13.660264 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71153176-2841-4074-9968-9f7fa351badb admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:13.660551 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71153176-2841-4074-9968-9f7fa351badb admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:13.660984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71153176-2841-4074-9968-9f7fa351badb admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:13.661691 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71153176-2841-4074-9968-9f7fa351badb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:13.663727 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71153176-2841-4074-9968-9f7fa351badb admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:13.696396 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894e267-c58d-40dd-a8d3-661db10cd221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:13.697513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894e267-c58d-40dd-a8d3-661db10cd221 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:13.697955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894e267-c58d-40dd-a8d3-661db10cd221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:13.698440 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894e267-c58d-40dd-a8d3-661db10cd221 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:13.699465 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894e267-c58d-40dd-a8d3-661db10cd221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:13.701583 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894e267-c58d-40dd-a8d3-661db10cd221 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:13.736664 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 990/1957] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:13 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:13.737619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71153176-2841-4074-9968-9f7fa351badb admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:13.751151 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71153176-2841-4074-9968-9f7fa351badb admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:13.757738 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44374f7-fd50-43c5-af38-07387287b5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:13.758512 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44374f7-fd50-43c5-af38-07387287b5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:13.758848 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44374f7-fd50-43c5-af38-07387287b5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:13.759350 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44374f7-fd50-43c5-af38-07387287b5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:13.760419 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44374f7-fd50-43c5-af38-07387287b5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:13.762808 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44374f7-fd50-43c5-af38-07387287b5e8 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:13.780529 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 991/1958] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:13.782185 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44374f7-fd50-43c5-af38-07387287b5e8 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:13.786384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 968/1959] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:13 2022] POST /identity/v3/projects => generated 391 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:13.788378 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894e267-c58d-40dd-a8d3-661db10cd221 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:13.798495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44374f7-fd50-43c5-af38-07387287b5e8 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:13.867181 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46cde2-bf36-4af3-b9d9-e395d4df957a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:13.867927 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46cde2-bf36-4af3-b9d9-e395d4df957a admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:13.868221 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46cde2-bf36-4af3-b9d9-e395d4df957a admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:13.868500 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46cde2-bf36-4af3-b9d9-e395d4df957a admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:13.869356 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46cde2-bf36-4af3-b9d9-e395d4df957a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:13.871761 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46cde2-bf36-4af3-b9d9-e395d4df957a admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:13.888261 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 992/1960] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:13.889493 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46cde2-bf36-4af3-b9d9-e395d4df957a admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:13.901078 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894e267-c58d-40dd-a8d3-661db10cd221 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:13.907516 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68c0aa-06e6-4881-9703-084c7634e5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:13.908582 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68c0aa-06e6-4881-9703-084c7634e5c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:13.909001 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68c0aa-06e6-4881-9703-084c7634e5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:13.909467 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68c0aa-06e6-4881-9703-084c7634e5c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:13.910511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68c0aa-06e6-4881-9703-084c7634e5c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:13.912725 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68c0aa-06e6-4881-9703-084c7634e5c9 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:13.916701 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46cde2-bf36-4af3-b9d9-e395d4df957a admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:13.924150 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4e98c-9383-4df7-9fb3-9dfd3a3e2a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:13.925515 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4e98c-9383-4df7-9fb3-9dfd3a3e2a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:13.925811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4e98c-9383-4df7-9fb3-9dfd3a3e2a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:13.926811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4e98c-9383-4df7-9fb3-9dfd3a3e2a6c admin admin] PATH_INFO: `/v3/projects/7db7f344f1364134a5d8cf11c72b9936/users/cf678b8590fc47c1b2d18872f48931b5/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:13.943531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 969/1961] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:13 2022] POST /identity/v3/users => generated 296 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:13.946874 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4e98c-9383-4df7-9fb3-9dfd3a3e2a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7db7f344f1364134a5d8cf11c72b9936, user_id=cf678b8590fc47c1b2d18872f48931b5, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:13.948578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68c0aa-06e6-4881-9703-084c7634e5c9 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:13.950478 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4e98c-9383-4df7-9fb3-9dfd3a3e2a6c admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:13.966237 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68c0aa-06e6-4881-9703-084c7634e5c9 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:13.976695 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 993/1962] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:13 2022] PUT /identity/v3/projects/7db7f344f1364134a5d8cf11c72b9936/users/cf678b8590fc47c1b2d18872f48931b5/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:13.979826 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1024c-8969-4010-a273-4e792c33e160 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:13.980255 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1024c-8969-4010-a273-4e792c33e160 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:13.980842 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1024c-8969-4010-a273-4e792c33e160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:14.027454 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-97e1024c-8969-4010-a273-4e792c33e160 None None] MFA Rules not processed for user `cf678b8590fc47c1b2d18872f48931b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:14.030129 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-97e1024c-8969-4010-a273-4e792c33e160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:14.035767 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8653f-06c7-4903-9bea-1251867d54b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:14.040376 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8653f-06c7-4903-9bea-1251867d54b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:14.040853 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8653f-06c7-4903-9bea-1251867d54b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:14.041149 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8653f-06c7-4903-9bea-1251867d54b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:14.041961 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8653f-06c7-4903-9bea-1251867d54b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:14.044336 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8653f-06c7-4903-9bea-1251867d54b4 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:14.056569 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 970/1963] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:18:14.060766 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8653f-06c7-4903-9bea-1251867d54b4 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:14.075341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8653f-06c7-4903-9bea-1251867d54b4 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:14.080605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7cf00-e69f-4971-96fc-5656f1d33885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:14.081299 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7cf00-e69f-4971-96fc-5656f1d33885 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:14.081587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7cf00-e69f-4971-96fc-5656f1d33885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:14.081979 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7cf00-e69f-4971-96fc-5656f1d33885 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:14.082744 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7cf00-e69f-4971-96fc-5656f1d33885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:14.084653 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7cf00-e69f-4971-96fc-5656f1d33885 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:14.098040 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 971/1964] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:14.102910 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:14.104799 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7cf00-e69f-4971-96fc-5656f1d33885 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:14.112051 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:14.121198 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7cf00-e69f-4971-96fc-5656f1d33885 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:14.129225 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24bd518-6484-4441-8bc3-26b9af61b679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:14.130633 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bd518-6484-4441-8bc3-26b9af61b679 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:14.130995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bd518-6484-4441-8bc3-26b9af61b679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:14.131378 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bd518-6484-4441-8bc3-26b9af61b679 admin admin] PATH_INFO: `/v3/projects/d9c5074777e4449ab75719c489bfe660/users/57830c4a0f6f4f4498b0867ac7c5557d/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:14.135547 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 994/1965] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:14.137175 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1024c-8969-4010-a273-4e792c33e160 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:14.151647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24bd518-6484-4441-8bc3-26b9af61b679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9c5074777e4449ab75719c489bfe660, user_id=57830c4a0f6f4f4498b0867ac7c5557d, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:14.154017 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1024c-8969-4010-a273-4e792c33e160 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:14.155293 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24bd518-6484-4441-8bc3-26b9af61b679 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:14.161258 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9922a8b-8b07-41e4-bc8b-401ee3b5e20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:14.161897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9922a8b-8b07-41e4-bc8b-401ee3b5e20c admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:14.162227 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9922a8b-8b07-41e4-bc8b-401ee3b5e20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:14.162596 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9922a8b-8b07-41e4-bc8b-401ee3b5e20c admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:14.163392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9922a8b-8b07-41e4-bc8b-401ee3b5e20c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:14.166711 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9922a8b-8b07-41e4-bc8b-401ee3b5e20c admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:14.175896 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 972/1966] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:14 2022] PUT /identity/v3/projects/d9c5074777e4449ab75719c489bfe660/users/57830c4a0f6f4f4498b0867ac7c5557d/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:14.186876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9e831-d832-4d7b-98e4-afb31195ba6c None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:14.187567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9e831-d832-4d7b-98e4-afb31195ba6c None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:14.187997 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9e831-d832-4d7b-98e4-afb31195ba6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:14.208208 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 995/1967] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:14 2022] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:14.212215 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9922a8b-8b07-41e4-bc8b-401ee3b5e20c admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:14.221799 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-71e9e831-d832-4d7b-98e4-afb31195ba6c None None] MFA Rules not processed for user `57830c4a0f6f4f4498b0867ac7c5557d`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:14.223117 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-71e9e831-d832-4d7b-98e4-afb31195ba6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:14.302314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9922a8b-8b07-41e4-bc8b-401ee3b5e20c admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:14.308247 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1289959-7a5b-45e3-9287-2ced27d2a70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:14.308949 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1289959-7a5b-45e3-9287-2ced27d2a70f admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:14.309243 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1289959-7a5b-45e3-9287-2ced27d2a70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:14.309528 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1289959-7a5b-45e3-9287-2ced27d2a70f admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:14.310296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1289959-7a5b-45e3-9287-2ced27d2a70f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:14.312963 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1289959-7a5b-45e3-9287-2ced27d2a70f admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:14.338633 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 996/1968] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:14 2022] POST /identity/v3/users => generated 294 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:18:14.340766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1289959-7a5b-45e3-9287-2ced27d2a70f admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:14.346340 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 973/1969] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:18:14.347851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9e831-d832-4d7b-98e4-afb31195ba6c None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:14.351501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1289959-7a5b-45e3-9287-2ced27d2a70f admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:14.356813 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dc651-0dd4-4ae8-b2fc-5b130f79afb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:14.357706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dc651-0dd4-4ae8-b2fc-5b130f79afb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:14.358225 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dc651-0dd4-4ae8-b2fc-5b130f79afb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:14.358692 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dc651-0dd4-4ae8-b2fc-5b130f79afb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:14.358816 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9e831-d832-4d7b-98e4-afb31195ba6c None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:14.359427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6dc651-0dd4-4ae8-b2fc-5b130f79afb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:14.361034 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6dc651-0dd4-4ae8-b2fc-5b130f79afb6 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:14.365143 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c4d0d-917c-4a73-80b6-ef1a5fe462ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:14.365282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c4d0d-917c-4a73-80b6-ef1a5fe462ef admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:14.365641 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c4d0d-917c-4a73-80b6-ef1a5fe462ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:14.366140 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c4d0d-917c-4a73-80b6-ef1a5fe462ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:14.366803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c4d0d-917c-4a73-80b6-ef1a5fe462ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:14.369253 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c4d0d-917c-4a73-80b6-ef1a5fe462ef admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:14.373971 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 997/1970] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:18:14.377637 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dc651-0dd4-4ae8-b2fc-5b130f79afb6 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:14.389509 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dc651-0dd4-4ae8-b2fc-5b130f79afb6 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:14.394696 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc201cc-7cea-4c57-9c50-d0a33e1ca956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:14.395675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc201cc-7cea-4c57-9c50-d0a33e1ca956 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:14.395675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc201cc-7cea-4c57-9c50-d0a33e1ca956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:14.396036 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc201cc-7cea-4c57-9c50-d0a33e1ca956 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:14.396851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc201cc-7cea-4c57-9c50-d0a33e1ca956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:14.398617 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc201cc-7cea-4c57-9c50-d0a33e1ca956 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:14.413132 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 998/1971] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:18:14.417306 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc201cc-7cea-4c57-9c50-d0a33e1ca956 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:14.419179 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 974/1972] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:14 2022] POST /identity/v3/projects => generated 393 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:18:14.421133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c4d0d-917c-4a73-80b6-ef1a5fe462ef admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:14.431263 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc201cc-7cea-4c57-9c50-d0a33e1ca956 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:14.512178 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c4d0d-917c-4a73-80b6-ef1a5fe462ef admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:14.517557 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb79c02-aa05-46c3-87d7-fd5a21a82873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:14.518409 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb79c02-aa05-46c3-87d7-fd5a21a82873 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:14.518773 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb79c02-aa05-46c3-87d7-fd5a21a82873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:14.519129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb79c02-aa05-46c3-87d7-fd5a21a82873 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:14.519896 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb79c02-aa05-46c3-87d7-fd5a21a82873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:14.522029 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb79c02-aa05-46c3-87d7-fd5a21a82873 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:14.522938 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f458e08-a2b1-4c19-8808-49a5e77dd826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:14.523984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f458e08-a2b1-4c19-8808-49a5e77dd826 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:14.524202 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f458e08-a2b1-4c19-8808-49a5e77dd826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:14.524480 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f458e08-a2b1-4c19-8808-49a5e77dd826 admin admin] PATH_INFO: `/v3/projects/18137af7a70e40bda499745ce1739b13/users/8fc1647012d5494dbfbadb9dd689e86a/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:14.540972 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f458e08-a2b1-4c19-8808-49a5e77dd826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18137af7a70e40bda499745ce1739b13, user_id=8fc1647012d5494dbfbadb9dd689e86a, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:14.544226 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f458e08-a2b1-4c19-8808-49a5e77dd826 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:14.547332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 975/1973] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:14 2022] POST /identity/v3/users => generated 303 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:14.551470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb79c02-aa05-46c3-87d7-fd5a21a82873 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:14.563940 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb79c02-aa05-46c3-87d7-fd5a21a82873 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:14.581250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 999/1974] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:14 2022] PUT /identity/v3/projects/18137af7a70e40bda499745ce1739b13/users/8fc1647012d5494dbfbadb9dd689e86a/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:14.599989 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4eb02-094c-426e-b172-19999cce03cc None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:14.600563 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4eb02-094c-426e-b172-19999cce03cc None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:14.601597 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4eb02-094c-426e-b172-19999cce03cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:14.603977 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:14.636122 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6a0dc-c971-44e2-9cb4-616c240f30cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:14.637385 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6a0dc-c971-44e2-9cb4-616c240f30cb admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:14.637518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-5ce4eb02-094c-426e-b172-19999cce03cc None None] MFA Rules not processed for user `8fc1647012d5494dbfbadb9dd689e86a`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:14.637708 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6a0dc-c971-44e2-9cb4-616c240f30cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:14.637951 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6a0dc-c971-44e2-9cb4-616c240f30cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:14.638765 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-5ce4eb02-094c-426e-b172-19999cce03cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:14.638864 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6a0dc-c971-44e2-9cb4-616c240f30cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:14.640666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6a0dc-c971-44e2-9cb4-616c240f30cb admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:14.649578 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:14.656322 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 976/1975] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:14.657380 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6a0dc-c971-44e2-9cb4-616c240f30cb admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:14.668400 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6a0dc-c971-44e2-9cb4-616c240f30cb admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:14.674302 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512c1e6-647f-4bcf-bcba-be6974bc8af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:14.675188 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512c1e6-647f-4bcf-bcba-be6974bc8af7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:14.675503 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512c1e6-647f-4bcf-bcba-be6974bc8af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:14.675789 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512c1e6-647f-4bcf-bcba-be6974bc8af7 admin admin] PATH_INFO: `/v3/projects/036b123459ff46cba48519e3ded2448b/users/050c4fc30d4845b78734246e59c017c5/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:14.700468 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512c1e6-647f-4bcf-bcba-be6974bc8af7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=036b123459ff46cba48519e3ded2448b, user_id=050c4fc30d4845b78734246e59c017c5, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:14.703512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512c1e6-647f-4bcf-bcba-be6974bc8af7 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:14.742382 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 977/1976] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:14 2022] PUT /identity/v3/projects/036b123459ff46cba48519e3ded2448b/users/050c4fc30d4845b78734246e59c017c5/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:14.746885 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1000/1977] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:14.747009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512c1e6-647f-4bcf-bcba-be6974bc8af7 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:14.756138 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667e0c6-b7a4-40f3-8005-4ab13fd353e0 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:14.758291 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667e0c6-b7a4-40f3-8005-4ab13fd353e0 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:14.758875 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667e0c6-b7a4-40f3-8005-4ab13fd353e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:14.787215 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-f667e0c6-b7a4-40f3-8005-4ab13fd353e0 None None] MFA Rules not processed for user `e427cded71b24920b908dc09fb75d5ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:14.789930 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-f667e0c6-b7a4-40f3-8005-4ab13fd353e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:14.821405 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512c1e6-647f-4bcf-bcba-be6974bc8af7 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:14.827343 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd665885-139f-4e02-bac0-46b408c059b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:14.828040 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd665885-139f-4e02-bac0-46b408c059b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:14.828330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd665885-139f-4e02-bac0-46b408c059b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:14.828642 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd665885-139f-4e02-bac0-46b408c059b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:14.829447 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd665885-139f-4e02-bac0-46b408c059b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:14.831096 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd665885-139f-4e02-bac0-46b408c059b6 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:14.847164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 978/1978] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:18:14.848383 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd665885-139f-4e02-bac0-46b408c059b6 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:14.865119 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd665885-139f-4e02-bac0-46b408c059b6 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:14.873033 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9816dc3-82ba-4c36-b628-bbc3a9e29f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:14.873867 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9816dc3-82ba-4c36-b628-bbc3a9e29f9c admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:14.874289 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9816dc3-82ba-4c36-b628-bbc3a9e29f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:14.874667 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9816dc3-82ba-4c36-b628-bbc3a9e29f9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:14.875460 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9816dc3-82ba-4c36-b628-bbc3a9e29f9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:14.878162 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9816dc3-82ba-4c36-b628-bbc3a9e29f9c admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:14.887593 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1001/1979] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:18:14.888538 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667e0c6-b7a4-40f3-8005-4ab13fd353e0 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:14.915740 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667e0c6-b7a4-40f3-8005-4ab13fd353e0 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:14.931436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 979/1980] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:14 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:14.932271 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9816dc3-82ba-4c36-b628-bbc3a9e29f9c admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:14.935227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-c9816dc3-82ba-4c36-b628-bbc3a9e29f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:14.938829 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5087d6-215c-49ca-a7bb-445010bcdea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:14.941597 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5087d6-215c-49ca-a7bb-445010bcdea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:14.942412 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5087d6-215c-49ca-a7bb-445010bcdea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:14.948531 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5087d6-215c-49ca-a7bb-445010bcdea0 admin admin] PATH_INFO: `/v3/projects/036b123459ff46cba48519e3ded2448b/users/050c4fc30d4845b78734246e59c017c5/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:14.951339 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5087d6-215c-49ca-a7bb-445010bcdea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=036b123459ff46cba48519e3ded2448b, user_id=050c4fc30d4845b78734246e59c017c5, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:14.954267 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5087d6-215c-49ca-a7bb-445010bcdea0 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:14.984461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1002/1981] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:14 2022] PUT /identity/v3/projects/036b123459ff46cba48519e3ded2448b/users/050c4fc30d4845b78734246e59c017c5/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:14.985147 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5087d6-215c-49ca-a7bb-445010bcdea0 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:15.013049 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9816dc3-82ba-4c36-b628-bbc3a9e29f9c admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:15.059565 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:15.080185 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924b34b-490a-47ef-8217-56c3da757cac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:15.080932 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924b34b-490a-47ef-8217-56c3da757cac service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:15.081221 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924b34b-490a-47ef-8217-56c3da757cac service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:15.081526 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924b34b-490a-47ef-8217-56c3da757cac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:15.085559 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5087d6-215c-49ca-a7bb-445010bcdea0 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:15.092436 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3b194-df90-4604-ba8e-2070768c58f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:15.093140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3b194-df90-4604-ba8e-2070768c58f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:15.093433 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3b194-df90-4604-ba8e-2070768c58f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:15.093792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3b194-df90-4604-ba8e-2070768c58f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:15.094576 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3b194-df90-4604-ba8e-2070768c58f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:15.097290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3b194-df90-4604-ba8e-2070768c58f0 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:15.121835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1003/1982] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:14 2022] POST /identity/v3/users => generated 299 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:15.123507 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb855c0-3264-48e2-b98d-1bcbfb16f643 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:15.125130 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb855c0-3264-48e2-b98d-1bcbfb16f643 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:15.125130 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb855c0-3264-48e2-b98d-1bcbfb16f643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:15.157391 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924b34b-490a-47ef-8217-56c3da757cac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:15.159901 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924b34b-490a-47ef-8217-56c3da757cac service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:15.163085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-1cb855c0-3264-48e2-b98d-1bcbfb16f643 None None] MFA Rules not processed for user `050c4fc30d4845b78734246e59c017c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:15.165022 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-1cb855c0-3264-48e2-b98d-1bcbfb16f643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:15.171322 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:15.173003 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 980/1983] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:14 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:15.173855 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924b34b-490a-47ef-8217-56c3da757cac service cinder] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:15.186804 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924b34b-490a-47ef-8217-56c3da757cac service cinder] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:15.192922 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af3cd6-1e4a-4567-b930-049f51fcb7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:15.193928 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af3cd6-1e4a-4567-b930-049f51fcb7fc admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:15.194308 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af3cd6-1e4a-4567-b930-049f51fcb7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:15.194607 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af3cd6-1e4a-4567-b930-049f51fcb7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:15.195265 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af3cd6-1e4a-4567-b930-049f51fcb7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:15.196917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af3cd6-1e4a-4567-b930-049f51fcb7fc admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:15.213891 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 981/1984] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:15.218769 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af3cd6-1e4a-4567-b930-049f51fcb7fc admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:15.234675 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af3cd6-1e4a-4567-b930-049f51fcb7fc admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:15.242890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa76cec-7237-41b5-9f9a-4f861b2de58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:15.244381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa76cec-7237-41b5-9f9a-4f861b2de58d admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:15.244851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa76cec-7237-41b5-9f9a-4f861b2de58d admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:15.245457 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa76cec-7237-41b5-9f9a-4f861b2de58d admin admin] PATH_INFO: `/v3/projects/57e189e943674a4eba945b944f7dc603/users/a86fa517c32d454e874646e3b1a23121/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:15.264870 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1004/1985] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:15.272325 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa76cec-7237-41b5-9f9a-4f861b2de58d admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e189e943674a4eba945b944f7dc603, user_id=a86fa517c32d454e874646e3b1a23121, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:15.279891 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa76cec-7237-41b5-9f9a-4f861b2de58d admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:15.281846 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb855c0-3264-48e2-b98d-1bcbfb16f643 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:15.284241 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-1cb855c0-3264-48e2-b98d-1bcbfb16f643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:15.306467 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb855c0-3264-48e2-b98d-1bcbfb16f643 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:15.309562 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 982/1986] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:15 2022] PUT /identity/v3/projects/57e189e943674a4eba945b944f7dc603/users/a86fa517c32d454e874646e3b1a23121/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:18:15.311147 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa76cec-7237-41b5-9f9a-4f861b2de58d admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:15.405193 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe835f4b-6e97-40e8-be34-ea3198c2d71d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:15.405985 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe835f4b-6e97-40e8-be34-ea3198c2d71d service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:15.406348 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe835f4b-6e97-40e8-be34-ea3198c2d71d service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:15.406596 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe835f4b-6e97-40e8-be34-ea3198c2d71d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:15.446851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa76cec-7237-41b5-9f9a-4f861b2de58d admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:15.459619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd1e25-e89f-4ffb-846a-0ff325c2f3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:15.460751 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd1e25-e89f-4ffb-846a-0ff325c2f3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:15.461581 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd1e25-e89f-4ffb-846a-0ff325c2f3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:15.461814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd1e25-e89f-4ffb-846a-0ff325c2f3b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:15.462604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd1e25-e89f-4ffb-846a-0ff325c2f3b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:15.465479 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd1e25-e89f-4ffb-846a-0ff325c2f3b0 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:15.484535 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 983/1987] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:15.489016 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd1e25-e89f-4ffb-846a-0ff325c2f3b0 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:15.503822 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd1e25-e89f-4ffb-846a-0ff325c2f3b0 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:15.510028 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f985c4-7784-4fdd-8562-c9aa3211aae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:15.512009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f985c4-7784-4fdd-8562-c9aa3211aae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:15.512365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f985c4-7784-4fdd-8562-c9aa3211aae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:15.512702 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe835f4b-6e97-40e8-be34-ea3198c2d71d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:15.512843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f985c4-7784-4fdd-8562-c9aa3211aae4 admin admin] PATH_INFO: `/v3/projects/57e189e943674a4eba945b944f7dc603/users/a86fa517c32d454e874646e3b1a23121/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:15.514596 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe835f4b-6e97-40e8-be34-ea3198c2d71d service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:15.517264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f985c4-7784-4fdd-8562-c9aa3211aae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e189e943674a4eba945b944f7dc603, user_id=a86fa517c32d454e874646e3b1a23121, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:15.520809 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f985c4-7784-4fdd-8562-c9aa3211aae4 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:15.526896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1005/1988] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:15.559345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 984/1989] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:15 2022] PUT /identity/v3/projects/57e189e943674a4eba945b944f7dc603/users/a86fa517c32d454e874646e3b1a23121/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:15.572993 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7caaf-58ca-4186-b4b5-57f03e62751f None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:15.573504 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7caaf-58ca-4186-b4b5-57f03e62751f None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:15.575665 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7caaf-58ca-4186-b4b5-57f03e62751f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:15.606527 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f985c4-7784-4fdd-8562-c9aa3211aae4 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:15.628614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-cee7caaf-58ca-4186-b4b5-57f03e62751f None None] MFA Rules not processed for user `a86fa517c32d454e874646e3b1a23121`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:15.630074 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-cee7caaf-58ca-4186-b4b5-57f03e62751f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:15.691246 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:15.711948 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f985c4-7784-4fdd-8562-c9aa3211aae4 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:15.713262 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:15.720264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eca363-3bb2-4b60-8a2c-8850213c27a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:15.720940 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eca363-3bb2-4b60-8a2c-8850213c27a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:15.721227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eca363-3bb2-4b60-8a2c-8850213c27a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:15.721599 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eca363-3bb2-4b60-8a2c-8850213c27a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:15.762525 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1006/1990] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:15.773271 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7caaf-58ca-4186-b4b5-57f03e62751f None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:15.797130 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7caaf-58ca-4186-b4b5-57f03e62751f None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:15.814462 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714374a6-4f6c-4a12-a0ab-741c7da68cb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:15.814462 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714374a6-4f6c-4a12-a0ab-741c7da68cb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:15.814462 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714374a6-4f6c-4a12-a0ab-741c7da68cb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:15.827582 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714374a6-4f6c-4a12-a0ab-741c7da68cb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:15.827723 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eca363-3bb2-4b60-8a2c-8850213c27a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:15.840172 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eca363-3bb2-4b60-8a2c-8850213c27a5 service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:15.865293 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 985/1991] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:18:15.867729 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714374a6-4f6c-4a12-a0ab-741c7da68cb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:15.869224 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714374a6-4f6c-4a12-a0ab-741c7da68cb1 service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:15.917285 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1007/1992] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:18:16.804999 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299ffe5-35a6-415a-9447-06b338d1c71a None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:16.805580 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299ffe5-35a6-415a-9447-06b338d1c71a None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:16.805580 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299ffe5-35a6-415a-9447-06b338d1c71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:16.831332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-3299ffe5-35a6-415a-9447-06b338d1c71a None None] MFA Rules not processed for user `e427cded71b24920b908dc09fb75d5ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:16.832673 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-3299ffe5-35a6-415a-9447-06b338d1c71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:16.899306 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714374a6-4f6c-4a12-a0ab-741c7da68cb1 service cinder] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:16.913359 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714374a6-4f6c-4a12-a0ab-741c7da68cb1 service cinder] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:16.915463 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 986/1993] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:16 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:18:16.918161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71a8ea-e61e-41c6-92fd-160801c013f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:16.918840 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71a8ea-e61e-41c6-92fd-160801c013f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:16.919131 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71a8ea-e61e-41c6-92fd-160801c013f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:16.919418 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71a8ea-e61e-41c6-92fd-160801c013f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:17.004479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71a8ea-e61e-41c6-92fd-160801c013f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:17.005989 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71a8ea-e61e-41c6-92fd-160801c013f6 service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:17.020192 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1008/1994] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:18:18.339909 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299ffe5-35a6-415a-9447-06b338d1c71a None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:18.341445 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-3299ffe5-35a6-415a-9447-06b338d1c71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:18.487562 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299ffe5-35a6-415a-9447-06b338d1c71a None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:18.496687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb1c03-a859-4fcd-b94b-8d415994957f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:18.497726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb1c03-a859-4fcd-b94b-8d415994957f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:18.498132 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb1c03-a859-4fcd-b94b-8d415994957f admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:18.498590 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb1c03-a859-4fcd-b94b-8d415994957f admin admin] PATH_INFO: `/v3/users/9cf6ea3732f5465cb68910733650609a` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:18.500936 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb1c03-a859-4fcd-b94b-8d415994957f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cf6ea3732f5465cb68910733650609a)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:18.504353 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb1c03-a859-4fcd-b94b-8d415994957f admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:18.599883 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:18.625749 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-4ccb1c03-a859-4fcd-b94b-8d415994957f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cf6ea3732f5465cb68910733650609a'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:18.626987 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-4ccb1c03-a859-4fcd-b94b-8d415994957f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cf6ea3732f5465cb68910733650609a'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:18.665520 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-4ccb1c03-a859-4fcd-b94b-8d415994957f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cf6ea3732f5465cb68910733650609a'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:18.685026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-4ccb1c03-a859-4fcd-b94b-8d415994957f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cf6ea3732f5465cb68910733650609a'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:18.716600 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-4ccb1c03-a859-4fcd-b94b-8d415994957f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cf6ea3732f5465cb68910733650609a'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:18.725670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 987/1995] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:18 2022] DELETE /identity/v3/users/9cf6ea3732f5465cb68910733650609a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:18.730908 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f7330-1913-47b2-8dd4-df7ae1171d39 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:18.731996 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f7330-1913-47b2-8dd4-df7ae1171d39 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:18.732608 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f7330-1913-47b2-8dd4-df7ae1171d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:18.786582 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-6d0f7330-1913-47b2-8dd4-df7ae1171d39 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:18.788996 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-6d0f7330-1913-47b2-8dd4-df7ae1171d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:18.934503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1009/1996] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:18.941122 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb1c03-a859-4fcd-b94b-8d415994957f admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:18.942853 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-4ccb1c03-a859-4fcd-b94b-8d415994957f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:19.068117 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb1c03-a859-4fcd-b94b-8d415994957f admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:19.080208 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf3801-f46d-4a27-97fd-de9f0982d784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:19.081007 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf3801-f46d-4a27-97fd-de9f0982d784 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:19.081366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf3801-f46d-4a27-97fd-de9f0982d784 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:19.081717 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf3801-f46d-4a27-97fd-de9f0982d784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:19.093731 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf3801-f46d-4a27-97fd-de9f0982d784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:19.095345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf3801-f46d-4a27-97fd-de9f0982d784 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:19.118576 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 988/1997] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:19.546900 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f7330-1913-47b2-8dd4-df7ae1171d39 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:19.555736 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-6d0f7330-1913-47b2-8dd4-df7ae1171d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:19.599941 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f7330-1913-47b2-8dd4-df7ae1171d39 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:19.609171 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943a7ad-a0a0-4fd3-97aa-617c800024b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:19.610304 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943a7ad-a0a0-4fd3-97aa-617c800024b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:19.610771 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943a7ad-a0a0-4fd3-97aa-617c800024b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:19.611101 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943a7ad-a0a0-4fd3-97aa-617c800024b4 admin admin] PATH_INFO: `/v3/projects/6a77079b30784a58b9f34bf79273b4e6` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:19.612614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943a7ad-a0a0-4fd3-97aa-617c800024b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a77079b30784a58b9f34bf79273b4e6)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:19.615431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943a7ad-a0a0-4fd3-97aa-617c800024b4 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:19.704612 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-4943a7ad-a0a0-4fd3-97aa-617c800024b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a77079b30784a58b9f34bf79273b4e6', 'request_id': 'req-4943a7ad-a0a0-4fd3-97aa-617c800024b4'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:19.712325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-4943a7ad-a0a0-4fd3-97aa-617c800024b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a77079b30784a58b9f34bf79273b4e6', 'request_id': 'req-4943a7ad-a0a0-4fd3-97aa-617c800024b4'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:19.718017 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:19.727325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-4943a7ad-a0a0-4fd3-97aa-617c800024b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a77079b30784a58b9f34bf79273b4e6', 'request_id': 'req-4943a7ad-a0a0-4fd3-97aa-617c800024b4'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:19.743682 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-4943a7ad-a0a0-4fd3-97aa-617c800024b4 admin admin] The token cache is being invalidate because project 6a77079b30784a58b9f34bf79273b4e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:19.744322 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-4943a7ad-a0a0-4fd3-97aa-617c800024b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:19.744794 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-4943a7ad-a0a0-4fd3-97aa-617c800024b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:19.750156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1010/1998] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:19 2022] DELETE /identity/v3/projects/6a77079b30784a58b9f34bf79273b4e6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:19.756575 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce028d99-9ed1-43b3-9818-b343c96aefba None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:19.757348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce028d99-9ed1-43b3-9818-b343c96aefba None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:19.757454 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce028d99-9ed1-43b3-9818-b343c96aefba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:19.787588 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-ce028d99-9ed1-43b3-9818-b343c96aefba None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:19.788841 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-ce028d99-9ed1-43b3-9818-b343c96aefba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:19.872681 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 989/1999] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:19.882102 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccdaac-81a9-48f3-b474-6b7b39ed002e None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:19.882519 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccdaac-81a9-48f3-b474-6b7b39ed002e None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:19.882882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccdaac-81a9-48f3-b474-6b7b39ed002e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:19.906290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-38ccdaac-81a9-48f3-b474-6b7b39ed002e None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:19.907510 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-38ccdaac-81a9-48f3-b474-6b7b39ed002e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:19.915896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1011/2000] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:19.921157 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce028d99-9ed1-43b3-9818-b343c96aefba None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:19.931762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce028d99-9ed1-43b3-9818-b343c96aefba None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:19.936556 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256293a-6a49-4052-8599-0b45f26f92c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:19.937246 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256293a-6a49-4052-8599-0b45f26f92c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:19.937541 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256293a-6a49-4052-8599-0b45f26f92c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:19.937821 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256293a-6a49-4052-8599-0b45f26f92c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:19.938669 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256293a-6a49-4052-8599-0b45f26f92c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:18:19.938984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256293a-6a49-4052-8599-0b45f26f92c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:19.940628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256293a-6a49-4052-8599-0b45f26f92c6 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:19.954233 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 990/2001] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:18:19.958703 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccdaac-81a9-48f3-b474-6b7b39ed002e None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:19.968712 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccdaac-81a9-48f3-b474-6b7b39ed002e None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:19.973510 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237467d-ad71-4e35-b1dd-7f0b55377827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:19.974227 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237467d-ad71-4e35-b1dd-7f0b55377827 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:19.974519 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237467d-ad71-4e35-b1dd-7f0b55377827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:19.974799 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237467d-ad71-4e35-b1dd-7f0b55377827 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:19.975628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237467d-ad71-4e35-b1dd-7f0b55377827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:19.977811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237467d-ad71-4e35-b1dd-7f0b55377827 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:20.011533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1012/2002] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:19 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:20.016335 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256293a-6a49-4052-8599-0b45f26f92c6 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:20.039399 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256293a-6a49-4052-8599-0b45f26f92c6 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:20.165628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:20.193436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49986b3-21fd-48aa-92af-2668648673e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:20.194166 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49986b3-21fd-48aa-92af-2668648673e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:20.194577 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49986b3-21fd-48aa-92af-2668648673e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:20.194852 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49986b3-21fd-48aa-92af-2668648673e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:20.195555 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49986b3-21fd-48aa-92af-2668648673e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:20.197506 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49986b3-21fd-48aa-92af-2668648673e3 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:20.226856 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 991/2003] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:20 2022] POST /identity/v3/users => generated 282 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:20.232472 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237467d-ad71-4e35-b1dd-7f0b55377827 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:20.243513 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237467d-ad71-4e35-b1dd-7f0b55377827 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:20.254032 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696ca56-04b1-4095-a195-3339701372f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:20.254818 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696ca56-04b1-4095-a195-3339701372f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:20.255110 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696ca56-04b1-4095-a195-3339701372f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:20.255435 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696ca56-04b1-4095-a195-3339701372f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:20.256185 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696ca56-04b1-4095-a195-3339701372f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:20.258389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696ca56-04b1-4095-a195-3339701372f8 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:20.272522 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1013/2004] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:18:20.276535 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49986b3-21fd-48aa-92af-2668648673e3 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:20.301018 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49986b3-21fd-48aa-92af-2668648673e3 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:20.312130 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340deb1d-0840-42ce-b1ee-4fbb6561a83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:20.313306 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340deb1d-0840-42ce-b1ee-4fbb6561a83a admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:20.313877 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340deb1d-0840-42ce-b1ee-4fbb6561a83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:20.314426 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340deb1d-0840-42ce-b1ee-4fbb6561a83a admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:20.315540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340deb1d-0840-42ce-b1ee-4fbb6561a83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:20.318147 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340deb1d-0840-42ce-b1ee-4fbb6561a83a admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:20.333589 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 992/2005] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:20.340104 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696ca56-04b1-4095-a195-3339701372f8 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:20.353434 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696ca56-04b1-4095-a195-3339701372f8 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:20.365080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987e820-d546-4d57-9bc0-73077d066e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:20.366190 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987e820-d546-4d57-9bc0-73077d066e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:20.366507 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987e820-d546-4d57-9bc0-73077d066e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:20.366855 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987e820-d546-4d57-9bc0-73077d066e48 admin admin] PATH_INFO: `/v3/projects/df5f624340ac409eabd0179c7a294bb8/users/f96cb43423aa4b27a38573b96a62870e/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:20.398763 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987e820-d546-4d57-9bc0-73077d066e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df5f624340ac409eabd0179c7a294bb8, user_id=f96cb43423aa4b27a38573b96a62870e, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:20.401708 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987e820-d546-4d57-9bc0-73077d066e48 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:20.427970 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1014/2006] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:20 2022] PUT /identity/v3/projects/df5f624340ac409eabd0179c7a294bb8/users/f96cb43423aa4b27a38573b96a62870e/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:20.443298 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22212e94-6265-4933-b756-820646ee9450 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:20.443650 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22212e94-6265-4933-b756-820646ee9450 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:20.443957 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22212e94-6265-4933-b756-820646ee9450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:20.548279 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-22212e94-6265-4933-b756-820646ee9450 None None] MFA Rules not processed for user `f96cb43423aa4b27a38573b96a62870e`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:20.557703 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-22212e94-6265-4933-b756-820646ee9450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:20.609852 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987e820-d546-4d57-9bc0-73077d066e48 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:20.612539 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-2987e820-d546-4d57-9bc0-73077d066e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:20.684671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 993/2007] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:20 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:20.703339 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22212e94-6265-4933-b756-820646ee9450 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:20.704807 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-22212e94-6265-4933-b756-820646ee9450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:20.715942 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987e820-d546-4d57-9bc0-73077d066e48 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:20.721839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac8b1b-e8b1-4ef3-a1cd-cc05265b4f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:20.723071 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac8b1b-e8b1-4ef3-a1cd-cc05265b4f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:20.723349 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac8b1b-e8b1-4ef3-a1cd-cc05265b4f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:20.723639 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac8b1b-e8b1-4ef3-a1cd-cc05265b4f55 admin admin] PATH_INFO: `/v3/users/57830c4a0f6f4f4498b0867ac7c5557d` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:20.725069 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac8b1b-e8b1-4ef3-a1cd-cc05265b4f55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57830c4a0f6f4f4498b0867ac7c5557d)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:20.727245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac8b1b-e8b1-4ef3-a1cd-cc05265b4f55 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:20.776089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22212e94-6265-4933-b756-820646ee9450 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:20.779399 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49246e25-aaef-449f-8c14-049761a4fb9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:20.780136 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49246e25-aaef-449f-8c14-049761a4fb9d service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:20.780504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49246e25-aaef-449f-8c14-049761a4fb9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:20.780876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49246e25-aaef-449f-8c14-049761a4fb9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:20.786411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-ceac8b1b-e8b1-4ef3-a1cd-cc05265b4f55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57830c4a0f6f4f4498b0867ac7c5557d'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:20.797604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49246e25-aaef-449f-8c14-049761a4fb9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:20.798250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-ceac8b1b-e8b1-4ef3-a1cd-cc05265b4f55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57830c4a0f6f4f4498b0867ac7c5557d'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:20.799122 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49246e25-aaef-449f-8c14-049761a4fb9d service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:20.811750 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 994/2008] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:20 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:18:20.813318 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-ceac8b1b-e8b1-4ef3-a1cd-cc05265b4f55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57830c4a0f6f4f4498b0867ac7c5557d'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:20.814405 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-ceac8b1b-e8b1-4ef3-a1cd-cc05265b4f55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57830c4a0f6f4f4498b0867ac7c5557d'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:20.841005 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-ceac8b1b-e8b1-4ef3-a1cd-cc05265b4f55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57830c4a0f6f4f4498b0867ac7c5557d'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:20.844269 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:20.867634 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1015/2009] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:20 2022] DELETE /identity/v3/users/57830c4a0f6f4f4498b0867ac7c5557d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:20.872898 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a04145-f3cf-41f2-89a8-bbd3ce777a06 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:20.873492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a04145-f3cf-41f2-89a8-bbd3ce777a06 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:20.873801 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a04145-f3cf-41f2-89a8-bbd3ce777a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:20.899351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-92a04145-f3cf-41f2-89a8-bbd3ce777a06 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:20.900712 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-92a04145-f3cf-41f2-89a8-bbd3ce777a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:20.985985 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:21.002000 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 995/2010] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:21.013277 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac8b1b-e8b1-4ef3-a1cd-cc05265b4f55 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:21.014721 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-ceac8b1b-e8b1-4ef3-a1cd-cc05265b4f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:21.092919 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac8b1b-e8b1-4ef3-a1cd-cc05265b4f55 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:21.097482 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4eb2d-1bbe-47a7-8233-84b30667d64f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:21.098351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4eb2d-1bbe-47a7-8233-84b30667d64f service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:21.098683 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4eb2d-1bbe-47a7-8233-84b30667d64f service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:21.099023 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4eb2d-1bbe-47a7-8233-84b30667d64f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:21.112213 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4eb2d-1bbe-47a7-8233-84b30667d64f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:21.114241 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4eb2d-1bbe-47a7-8233-84b30667d64f service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:21.126850 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1016/2011] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:21.479860 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a04145-f3cf-41f2-89a8-bbd3ce777a06 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:21.482513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-92a04145-f3cf-41f2-89a8-bbd3ce777a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:21.498390 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a04145-f3cf-41f2-89a8-bbd3ce777a06 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:21.509453 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5807c5-243c-41de-be4c-d825c7bab028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:21.512089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5807c5-243c-41de-be4c-d825c7bab028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:21.512999 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5807c5-243c-41de-be4c-d825c7bab028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:21.513871 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5807c5-243c-41de-be4c-d825c7bab028 admin admin] PATH_INFO: `/v3/projects/d9c5074777e4449ab75719c489bfe660` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:21.516408 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5807c5-243c-41de-be4c-d825c7bab028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9c5074777e4449ab75719c489bfe660)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:21.521020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5807c5-243c-41de-be4c-d825c7bab028 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:21.621361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-7d5807c5-243c-41de-be4c-d825c7bab028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9c5074777e4449ab75719c489bfe660', 'request_id': 'req-7d5807c5-243c-41de-be4c-d825c7bab028'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:21.650649 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-7d5807c5-243c-41de-be4c-d825c7bab028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9c5074777e4449ab75719c489bfe660', 'request_id': 'req-7d5807c5-243c-41de-be4c-d825c7bab028'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:21.707390 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-7d5807c5-243c-41de-be4c-d825c7bab028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9c5074777e4449ab75719c489bfe660', 'request_id': 'req-7d5807c5-243c-41de-be4c-d825c7bab028'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:21.793099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-7d5807c5-243c-41de-be4c-d825c7bab028 admin admin] The token cache is being invalidate because project d9c5074777e4449ab75719c489bfe660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:21.793767 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-7d5807c5-243c-41de-be4c-d825c7bab028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:21.805375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-7d5807c5-243c-41de-be4c-d825c7bab028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:21.817071 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 996/2012] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:21 2022] DELETE /identity/v3/projects/d9c5074777e4449ab75719c489bfe660 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:21.827325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4eb2d-1bbe-47a7-8233-84b30667d64f service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:21.834994 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4eb2d-1bbe-47a7-8233-84b30667d64f service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:21.969746 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc871a-6731-478c-97ee-966be6f9a64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:21.973218 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc871a-6731-478c-97ee-966be6f9a64b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:21.975376 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc871a-6731-478c-97ee-966be6f9a64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:21.975673 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc871a-6731-478c-97ee-966be6f9a64b admin admin] PATH_INFO: `/v3/users/050c4fc30d4845b78734246e59c017c5` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:21.979579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc871a-6731-478c-97ee-966be6f9a64b admin admin] RBAC: Authorizing `identity:delete_user(user_id=050c4fc30d4845b78734246e59c017c5)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:21.988924 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc871a-6731-478c-97ee-966be6f9a64b admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:22.076913 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5807c5-243c-41de-be4c-d825c7bab028 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:22.078516 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-7d5807c5-243c-41de-be4c-d825c7bab028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:22.092273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-25cc871a-6731-478c-97ee-966be6f9a64b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '050c4fc30d4845b78734246e59c017c5'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:22.107984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-25cc871a-6731-478c-97ee-966be6f9a64b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '050c4fc30d4845b78734246e59c017c5'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:22.126422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-25cc871a-6731-478c-97ee-966be6f9a64b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '050c4fc30d4845b78734246e59c017c5'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:22.127325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-25cc871a-6731-478c-97ee-966be6f9a64b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '050c4fc30d4845b78734246e59c017c5'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:22.161668 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-25cc871a-6731-478c-97ee-966be6f9a64b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '050c4fc30d4845b78734246e59c017c5'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:22.171052 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1017/2013] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:21 2022] DELETE /identity/v3/users/050c4fc30d4845b78734246e59c017c5 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:22.172295 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5807c5-243c-41de-be4c-d825c7bab028 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:22.230743 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec46011-b4c2-4357-a2ad-e9c7033f65fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:22.231589 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec46011-b4c2-4357-a2ad-e9c7033f65fa service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:22.231980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec46011-b4c2-4357-a2ad-e9c7033f65fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:22.232397 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec46011-b4c2-4357-a2ad-e9c7033f65fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:22.234618 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-eec46011-b4c2-4357-a2ad-e9c7033f65fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:22.336141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:22.344410 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec46011-b4c2-4357-a2ad-e9c7033f65fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:22.346231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec46011-b4c2-4357-a2ad-e9c7033f65fa service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:22.363285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 997/2014] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:18:22.703022 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc871a-6731-478c-97ee-966be6f9a64b admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:22.704735 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-25cc871a-6731-478c-97ee-966be6f9a64b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:22.753571 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:22.808123 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc871a-6731-478c-97ee-966be6f9a64b admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:22.815591 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb62bbe-ad11-4272-a5fb-f10efbebeb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:22.816770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb62bbe-ad11-4272-a5fb-f10efbebeb8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:22.817219 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb62bbe-ad11-4272-a5fb-f10efbebeb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:22.818574 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb62bbe-ad11-4272-a5fb-f10efbebeb8a admin admin] PATH_INFO: `/v3/projects/036b123459ff46cba48519e3ded2448b` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:22.820226 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb62bbe-ad11-4272-a5fb-f10efbebeb8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=036b123459ff46cba48519e3ded2448b)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:22.823630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb62bbe-ad11-4272-a5fb-f10efbebeb8a admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:22.896111 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5bb62bbe-ad11-4272-a5fb-f10efbebeb8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '036b123459ff46cba48519e3ded2448b', 'request_id': 'req-5bb62bbe-ad11-4272-a5fb-f10efbebeb8a'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:22.915035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5bb62bbe-ad11-4272-a5fb-f10efbebeb8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '036b123459ff46cba48519e3ded2448b', 'request_id': 'req-5bb62bbe-ad11-4272-a5fb-f10efbebeb8a'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:22.941152 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5bb62bbe-ad11-4272-a5fb-f10efbebeb8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '036b123459ff46cba48519e3ded2448b', 'request_id': 'req-5bb62bbe-ad11-4272-a5fb-f10efbebeb8a'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:22.956211 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5bb62bbe-ad11-4272-a5fb-f10efbebeb8a admin admin] The token cache is being invalidate because project 036b123459ff46cba48519e3ded2448b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:22.956539 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5bb62bbe-ad11-4272-a5fb-f10efbebeb8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:22.957244 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5bb62bbe-ad11-4272-a5fb-f10efbebeb8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:22.959221 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1018/2015] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:22 2022] DELETE /identity/v3/projects/036b123459ff46cba48519e3ded2448b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:22.969628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f3253-7a82-4bf6-909c-953f1075e810 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:22.970223 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f3253-7a82-4bf6-909c-953f1075e810 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:22.970223 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f3253-7a82-4bf6-909c-953f1075e810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:23.009228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-fc6f3253-7a82-4bf6-909c-953f1075e810 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:23.012209 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-fc6f3253-7a82-4bf6-909c-953f1075e810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:23.141456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 998/2016] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:23.151494 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464165d6-d9dc-4a62-a718-73d2175a99e8 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:23.152010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464165d6-d9dc-4a62-a718-73d2175a99e8 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:23.152392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464165d6-d9dc-4a62-a718-73d2175a99e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:23.176144 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-464165d6-d9dc-4a62-a718-73d2175a99e8 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:23.177492 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-464165d6-d9dc-4a62-a718-73d2175a99e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:23.192958 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1019/2017] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:23.197506 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f3253-7a82-4bf6-909c-953f1075e810 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:23.214320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f3253-7a82-4bf6-909c-953f1075e810 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:23.220507 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85169b70-7973-4f13-a542-a316a9a957de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:23.222007 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85169b70-7973-4f13-a542-a316a9a957de admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:23.222459 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85169b70-7973-4f13-a542-a316a9a957de admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:23.222847 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85169b70-7973-4f13-a542-a316a9a957de admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:23.223719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85169b70-7973-4f13-a542-a316a9a957de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:18:23.224138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85169b70-7973-4f13-a542-a316a9a957de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:23.226073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85169b70-7973-4f13-a542-a316a9a957de admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:23.243442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 999/2018] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:18:23.249428 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464165d6-d9dc-4a62-a718-73d2175a99e8 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:23.261110 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464165d6-d9dc-4a62-a718-73d2175a99e8 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:23.271538 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b1464-056b-4dfa-8239-cb053b216ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:23.273085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b1464-056b-4dfa-8239-cb053b216ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:23.273570 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b1464-056b-4dfa-8239-cb053b216ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:23.277052 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b1464-056b-4dfa-8239-cb053b216ad0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:23.278595 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b1464-056b-4dfa-8239-cb053b216ad0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:23.280954 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b1464-056b-4dfa-8239-cb053b216ad0 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:23.321706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1020/2019] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:23 2022] POST /identity/v3/projects => generated 365 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:23.325994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85169b70-7973-4f13-a542-a316a9a957de admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:23.346715 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85169b70-7973-4f13-a542-a316a9a957de admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:23.441210 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55401d8-0b5b-41ad-a522-b7abfbbe76f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:23.441894 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55401d8-0b5b-41ad-a522-b7abfbbe76f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:23.442217 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55401d8-0b5b-41ad-a522-b7abfbbe76f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:23.442497 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55401d8-0b5b-41ad-a522-b7abfbbe76f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:23.443188 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55401d8-0b5b-41ad-a522-b7abfbbe76f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:23.445078 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55401d8-0b5b-41ad-a522-b7abfbbe76f6 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:23.470334 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1000/2020] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:23 2022] POST /identity/v3/users => generated 283 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:23.472496 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b1464-056b-4dfa-8239-cb053b216ad0 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:23.486385 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b1464-056b-4dfa-8239-cb053b216ad0 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:23.491177 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6baa0-54ef-4387-824d-330942daee56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:23.491866 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6baa0-54ef-4387-824d-330942daee56 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:23.492156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6baa0-54ef-4387-824d-330942daee56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:23.492435 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6baa0-54ef-4387-824d-330942daee56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:23.493583 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6baa0-54ef-4387-824d-330942daee56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:23.496668 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6baa0-54ef-4387-824d-330942daee56 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:23.509393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1021/2021] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:23.511103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55401d8-0b5b-41ad-a522-b7abfbbe76f6 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:23.530240 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55401d8-0b5b-41ad-a522-b7abfbbe76f6 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:23.530989 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6510fc-047b-4ba5-9f12-0c3254ad76f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:23.531807 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6510fc-047b-4ba5-9f12-0c3254ad76f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:23.532193 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6510fc-047b-4ba5-9f12-0c3254ad76f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:23.532563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6510fc-047b-4ba5-9f12-0c3254ad76f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:23.533397 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6510fc-047b-4ba5-9f12-0c3254ad76f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:23.535317 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6510fc-047b-4ba5-9f12-0c3254ad76f2 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:23.552568 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1001/2022] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:23.555693 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6baa0-54ef-4387-824d-330942daee56 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:23.566489 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6baa0-54ef-4387-824d-330942daee56 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:23.571571 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f51de-3718-4546-9b6d-c6cea1b95c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:23.572479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f51de-3718-4546-9b6d-c6cea1b95c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:23.572766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f51de-3718-4546-9b6d-c6cea1b95c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:23.573175 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f51de-3718-4546-9b6d-c6cea1b95c73 admin admin] PATH_INFO: `/v3/projects/13d12861437a42c989c1c892b80eefe4/users/a40cb088939448d48b3a29a7eb504e89/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:23.590796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f51de-3718-4546-9b6d-c6cea1b95c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d12861437a42c989c1c892b80eefe4, user_id=a40cb088939448d48b3a29a7eb504e89, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:23.594343 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f51de-3718-4546-9b6d-c6cea1b95c73 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:23.620603 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1022/2023] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:23 2022] PUT /identity/v3/projects/13d12861437a42c989c1c892b80eefe4/users/a40cb088939448d48b3a29a7eb504e89/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:18:23.630607 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f14b88-d0ea-4808-a401-822ba6739a2f None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:23.630906 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f14b88-d0ea-4808-a401-822ba6739a2f None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:23.631186 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f14b88-d0ea-4808-a401-822ba6739a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:23.663223 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-f4f14b88-d0ea-4808-a401-822ba6739a2f None None] MFA Rules not processed for user `a40cb088939448d48b3a29a7eb504e89`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:23.665026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-f4f14b88-d0ea-4808-a401-822ba6739a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:23.731185 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:23.751327 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1002/2024] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:23 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:23.755900 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f51de-3718-4546-9b6d-c6cea1b95c73 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:23.811198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:23.828716 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f51de-3718-4546-9b6d-c6cea1b95c73 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:23.834263 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc33ce5-54bc-42d8-ae25-5e39dea76639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:23.834934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc33ce5-54bc-42d8-ae25-5e39dea76639 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:23.835239 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc33ce5-54bc-42d8-ae25-5e39dea76639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:23.835524 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc33ce5-54bc-42d8-ae25-5e39dea76639 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:23.836508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc33ce5-54bc-42d8-ae25-5e39dea76639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:23.838889 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc33ce5-54bc-42d8-ae25-5e39dea76639 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:23.873357 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1023/2025] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:23 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:23.877554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f14b88-d0ea-4808-a401-822ba6739a2f None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:23.890841 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f14b88-d0ea-4808-a401-822ba6739a2f None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:23.955667 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4aada-b3f1-4a8a-9cb1-2091ffc5ec29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:23.956455 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4aada-b3f1-4a8a-9cb1-2091ffc5ec29 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:23.956820 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4aada-b3f1-4a8a-9cb1-2091ffc5ec29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:23.957182 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4aada-b3f1-4a8a-9cb1-2091ffc5ec29 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:23.958175 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4aada-b3f1-4a8a-9cb1-2091ffc5ec29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:23.960244 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4aada-b3f1-4a8a-9cb1-2091ffc5ec29 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:23.982782 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1003/2026] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:23 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:18:23.987039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc33ce5-54bc-42d8-ae25-5e39dea76639 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:23.999067 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc33ce5-54bc-42d8-ae25-5e39dea76639 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:24.004334 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8c6d0-7963-4560-a946-9bd49d31c896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:24.005040 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8c6d0-7963-4560-a946-9bd49d31c896 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:24.005350 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8c6d0-7963-4560-a946-9bd49d31c896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:24.005711 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8c6d0-7963-4560-a946-9bd49d31c896 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:24.006608 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8c6d0-7963-4560-a946-9bd49d31c896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:24.008538 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8c6d0-7963-4560-a946-9bd49d31c896 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:24.020437 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1024/2027] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:24.025004 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4aada-b3f1-4a8a-9cb1-2091ffc5ec29 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:24.036911 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4aada-b3f1-4a8a-9cb1-2091ffc5ec29 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:24.041804 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660102f-a607-408a-9a86-3311e0188d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:24.042824 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660102f-a607-408a-9a86-3311e0188d81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:24.043113 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660102f-a607-408a-9a86-3311e0188d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:24.043395 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660102f-a607-408a-9a86-3311e0188d81 admin admin] PATH_INFO: `/v3/projects/8119fcfa18c74b6eb4821f57ef593e06/users/63da09cec389407b81199034b74896ed/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:24.069260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660102f-a607-408a-9a86-3311e0188d81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8119fcfa18c74b6eb4821f57ef593e06, user_id=63da09cec389407b81199034b74896ed, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:24.075369 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660102f-a607-408a-9a86-3311e0188d81 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:24.091208 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1004/2028] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:24 2022] PUT /identity/v3/projects/8119fcfa18c74b6eb4821f57ef593e06/users/63da09cec389407b81199034b74896ed/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:24.095312 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8c6d0-7963-4560-a946-9bd49d31c896 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:24.106186 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8c6d0-7963-4560-a946-9bd49d31c896 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:24.163969 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b960a6-49d5-4aa0-8642-924dea813dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:24.164654 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b960a6-49d5-4aa0-8642-924dea813dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:24.164938 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b960a6-49d5-4aa0-8642-924dea813dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:24.165217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b960a6-49d5-4aa0-8642-924dea813dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:24.165948 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b960a6-49d5-4aa0-8642-924dea813dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:24.167639 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b960a6-49d5-4aa0-8642-924dea813dd0 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:24.179670 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1025/2029] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:18:24.185932 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660102f-a607-408a-9a86-3311e0188d81 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:24.196569 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660102f-a607-408a-9a86-3311e0188d81 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:24.202445 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42791a94-146b-4139-876f-cb52459ee194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:24.203355 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42791a94-146b-4139-876f-cb52459ee194 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:24.203645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42791a94-146b-4139-876f-cb52459ee194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:24.203897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42791a94-146b-4139-876f-cb52459ee194 admin admin] PATH_INFO: `/v3/projects/8119fcfa18c74b6eb4821f57ef593e06/users/63da09cec389407b81199034b74896ed/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:24.206082 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42791a94-146b-4139-876f-cb52459ee194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8119fcfa18c74b6eb4821f57ef593e06, user_id=63da09cec389407b81199034b74896ed, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:24.208692 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42791a94-146b-4139-876f-cb52459ee194 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:24.220096 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1005/2030] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:24 2022] PUT /identity/v3/projects/8119fcfa18c74b6eb4821f57ef593e06/users/63da09cec389407b81199034b74896ed/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:24.230265 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf93b7-c646-4277-a02d-31584345fbe6 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:24.230560 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf93b7-c646-4277-a02d-31584345fbe6 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:24.230843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf93b7-c646-4277-a02d-31584345fbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:24.258853 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-0caf93b7-c646-4277-a02d-31584345fbe6 None None] MFA Rules not processed for user `63da09cec389407b81199034b74896ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:24.260504 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-0caf93b7-c646-4277-a02d-31584345fbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:24.345842 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1026/2031] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:24 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:18:24.363859 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42791a94-146b-4139-876f-cb52459ee194 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:24.366003 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-42791a94-146b-4139-876f-cb52459ee194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:24.492732 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42791a94-146b-4139-876f-cb52459ee194 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:24.499155 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8888dec-6474-4267-8075-250cdbb9267a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:24.500106 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8888dec-6474-4267-8075-250cdbb9267a service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:24.501310 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8888dec-6474-4267-8075-250cdbb9267a service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:24.501694 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8888dec-6474-4267-8075-250cdbb9267a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:24.518016 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8888dec-6474-4267-8075-250cdbb9267a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:24.519710 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8888dec-6474-4267-8075-250cdbb9267a service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:24.563580 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1006/2032] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:24 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:18:24.663654 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf93b7-c646-4277-a02d-31584345fbe6 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:24.678325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf93b7-c646-4277-a02d-31584345fbe6 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:24.686732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27b5be-807f-4790-b237-14d6fdc06462 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:24.687857 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27b5be-807f-4790-b237-14d6fdc06462 service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:24.688689 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27b5be-807f-4790-b237-14d6fdc06462 service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:24.689724 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27b5be-807f-4790-b237-14d6fdc06462 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:24.746795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:24.772164 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27b5be-807f-4790-b237-14d6fdc06462 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:24.773477 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27b5be-807f-4790-b237-14d6fdc06462 service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:24.794222 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1027/2033] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:24 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:25.388774 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8888dec-6474-4267-8075-250cdbb9267a service cinder] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:25.390837 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-e8888dec-6474-4267-8075-250cdbb9267a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:25.485107 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:25.511041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8888dec-6474-4267-8075-250cdbb9267a service cinder] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:25.517105 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e9887-4f4b-4013-9e81-004660c68b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:25.518020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e9887-4f4b-4013-9e81-004660c68b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:25.518342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e9887-4f4b-4013-9e81-004660c68b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:25.518803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e9887-4f4b-4013-9e81-004660c68b1d admin admin] PATH_INFO: `/v3/users/cf678b8590fc47c1b2d18872f48931b5` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:25.520229 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e9887-4f4b-4013-9e81-004660c68b1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf678b8590fc47c1b2d18872f48931b5)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:25.522428 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e9887-4f4b-4013-9e81-004660c68b1d admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:25.602435 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-559e9887-4f4b-4013-9e81-004660c68b1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf678b8590fc47c1b2d18872f48931b5'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:25.603104 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-559e9887-4f4b-4013-9e81-004660c68b1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf678b8590fc47c1b2d18872f48931b5'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:25.616488 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-559e9887-4f4b-4013-9e81-004660c68b1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf678b8590fc47c1b2d18872f48931b5'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:25.626846 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-559e9887-4f4b-4013-9e81-004660c68b1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf678b8590fc47c1b2d18872f48931b5'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:25.646067 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-559e9887-4f4b-4013-9e81-004660c68b1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf678b8590fc47c1b2d18872f48931b5'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:25.658059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1007/2034] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:25 2022] DELETE /identity/v3/users/cf678b8590fc47c1b2d18872f48931b5 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:25.660442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dba6f7-1199-4bc6-9eee-70d18eb77f47 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:25.660913 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dba6f7-1199-4bc6-9eee-70d18eb77f47 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:25.660990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dba6f7-1199-4bc6-9eee-70d18eb77f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:25.691400 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-70dba6f7-1199-4bc6-9eee-70d18eb77f47 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:25.700524 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-70dba6f7-1199-4bc6-9eee-70d18eb77f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:25.838058 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1028/2035] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:25.849845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e9887-4f4b-4013-9e81-004660c68b1d admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:25.851323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-559e9887-4f4b-4013-9e81-004660c68b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:25.934859 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e9887-4f4b-4013-9e81-004660c68b1d admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:25.942481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c36baa-799b-453a-932a-e3c332271927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:25.943165 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c36baa-799b-453a-932a-e3c332271927 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:25.943482 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c36baa-799b-453a-932a-e3c332271927 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:25.944390 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c36baa-799b-453a-932a-e3c332271927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:25.955096 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c36baa-799b-453a-932a-e3c332271927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:25.956744 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c36baa-799b-453a-932a-e3c332271927 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:25.973319 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1008/2036] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:26.396826 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dba6f7-1199-4bc6-9eee-70d18eb77f47 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:26.398932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-70dba6f7-1199-4bc6-9eee-70d18eb77f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:26.422793 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dba6f7-1199-4bc6-9eee-70d18eb77f47 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:26.429054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01074acc-1f24-41d6-a339-4bb2aca93b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:26.429951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01074acc-1f24-41d6-a339-4bb2aca93b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:26.430281 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01074acc-1f24-41d6-a339-4bb2aca93b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:26.430564 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01074acc-1f24-41d6-a339-4bb2aca93b3b admin admin] PATH_INFO: `/v3/projects/7db7f344f1364134a5d8cf11c72b9936` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:26.432155 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01074acc-1f24-41d6-a339-4bb2aca93b3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7db7f344f1364134a5d8cf11c72b9936)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:26.434966 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01074acc-1f24-41d6-a339-4bb2aca93b3b admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:26.524084 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-01074acc-1f24-41d6-a339-4bb2aca93b3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7db7f344f1364134a5d8cf11c72b9936', 'request_id': 'req-01074acc-1f24-41d6-a339-4bb2aca93b3b'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:26.544036 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-01074acc-1f24-41d6-a339-4bb2aca93b3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7db7f344f1364134a5d8cf11c72b9936', 'request_id': 'req-01074acc-1f24-41d6-a339-4bb2aca93b3b'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:26.560697 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-01074acc-1f24-41d6-a339-4bb2aca93b3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7db7f344f1364134a5d8cf11c72b9936', 'request_id': 'req-01074acc-1f24-41d6-a339-4bb2aca93b3b'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:26.578024 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-01074acc-1f24-41d6-a339-4bb2aca93b3b admin admin] The token cache is being invalidate because project 7db7f344f1364134a5d8cf11c72b9936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:26.578427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-01074acc-1f24-41d6-a339-4bb2aca93b3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:26.579364 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-01074acc-1f24-41d6-a339-4bb2aca93b3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:26.581338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1029/2037] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:26 2022] DELETE /identity/v3/projects/7db7f344f1364134a5d8cf11c72b9936 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:26.586903 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c36baa-799b-453a-932a-e3c332271927 service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:26.599322 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c36baa-799b-453a-932a-e3c332271927 service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:26.686500 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a94a61-061a-4395-ba15-a188434a41d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:26.687721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a94a61-061a-4395-ba15-a188434a41d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:26.688015 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a94a61-061a-4395-ba15-a188434a41d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:26.689986 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a94a61-061a-4395-ba15-a188434a41d4 admin admin] PATH_INFO: `/v3/users/8fc1647012d5494dbfbadb9dd689e86a` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:26.689986 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a94a61-061a-4395-ba15-a188434a41d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fc1647012d5494dbfbadb9dd689e86a)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:26.691750 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a94a61-061a-4395-ba15-a188434a41d4 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:26.697811 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:26.753511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-23a94a61-061a-4395-ba15-a188434a41d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fc1647012d5494dbfbadb9dd689e86a'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:26.754240 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-23a94a61-061a-4395-ba15-a188434a41d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fc1647012d5494dbfbadb9dd689e86a'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:26.764678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-23a94a61-061a-4395-ba15-a188434a41d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fc1647012d5494dbfbadb9dd689e86a'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:26.775314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-23a94a61-061a-4395-ba15-a188434a41d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fc1647012d5494dbfbadb9dd689e86a'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:26.789610 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-23a94a61-061a-4395-ba15-a188434a41d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fc1647012d5494dbfbadb9dd689e86a'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:26.798189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1009/2038] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:26 2022] DELETE /identity/v3/users/8fc1647012d5494dbfbadb9dd689e86a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:27.122268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01074acc-1f24-41d6-a339-4bb2aca93b3b admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:27.124086 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-01074acc-1f24-41d6-a339-4bb2aca93b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:27.147198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01074acc-1f24-41d6-a339-4bb2aca93b3b admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:27.269156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811e269-4c41-4314-a279-6b526886b89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:27.270065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811e269-4c41-4314-a279-6b526886b89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:27.270383 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811e269-4c41-4314-a279-6b526886b89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:27.270663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811e269-4c41-4314-a279-6b526886b89b admin admin] PATH_INFO: `/v3/projects/18137af7a70e40bda499745ce1739b13` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:27.274601 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811e269-4c41-4314-a279-6b526886b89b admin admin] RBAC: Authorizing `identity:delete_project(project_id=18137af7a70e40bda499745ce1739b13)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:27.278785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811e269-4c41-4314-a279-6b526886b89b admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:27.302425 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:27.367907 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-c811e269-4c41-4314-a279-6b526886b89b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18137af7a70e40bda499745ce1739b13', 'request_id': 'req-c811e269-4c41-4314-a279-6b526886b89b'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:27.375086 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-c811e269-4c41-4314-a279-6b526886b89b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18137af7a70e40bda499745ce1739b13', 'request_id': 'req-c811e269-4c41-4314-a279-6b526886b89b'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:27.389535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-c811e269-4c41-4314-a279-6b526886b89b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18137af7a70e40bda499745ce1739b13', 'request_id': 'req-c811e269-4c41-4314-a279-6b526886b89b'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:27.408774 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-c811e269-4c41-4314-a279-6b526886b89b admin admin] The token cache is being invalidate because project 18137af7a70e40bda499745ce1739b13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:27.409156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-c811e269-4c41-4314-a279-6b526886b89b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:27.409897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-c811e269-4c41-4314-a279-6b526886b89b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:27.412707 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1030/2039] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:27 2022] DELETE /identity/v3/projects/18137af7a70e40bda499745ce1739b13 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:27.418837 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a94a61-061a-4395-ba15-a188434a41d4 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:27.421462 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-23a94a61-061a-4395-ba15-a188434a41d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:27.438070 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a94a61-061a-4395-ba15-a188434a41d4 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:27.505601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00981d52-95e1-49cc-8dfb-137ce42c6714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:27.506525 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00981d52-95e1-49cc-8dfb-137ce42c6714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:27.507070 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00981d52-95e1-49cc-8dfb-137ce42c6714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:27.507359 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00981d52-95e1-49cc-8dfb-137ce42c6714 admin admin] PATH_INFO: `/v3/users/a86fa517c32d454e874646e3b1a23121` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:27.508593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00981d52-95e1-49cc-8dfb-137ce42c6714 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a86fa517c32d454e874646e3b1a23121)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:27.510601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00981d52-95e1-49cc-8dfb-137ce42c6714 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:27.567204 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-00981d52-95e1-49cc-8dfb-137ce42c6714 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a86fa517c32d454e874646e3b1a23121'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:27.567871 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-00981d52-95e1-49cc-8dfb-137ce42c6714 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a86fa517c32d454e874646e3b1a23121'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:27.577090 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-00981d52-95e1-49cc-8dfb-137ce42c6714 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a86fa517c32d454e874646e3b1a23121'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:27.584349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-00981d52-95e1-49cc-8dfb-137ce42c6714 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a86fa517c32d454e874646e3b1a23121'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:27.597537 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-00981d52-95e1-49cc-8dfb-137ce42c6714 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a86fa517c32d454e874646e3b1a23121'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:27.605783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1010/2040] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:27 2022] DELETE /identity/v3/users/a86fa517c32d454e874646e3b1a23121 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:18:28.282296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811e269-4c41-4314-a279-6b526886b89b admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:28.283820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-c811e269-4c41-4314-a279-6b526886b89b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:28.304618 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811e269-4c41-4314-a279-6b526886b89b admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:28.479221 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53184f3-4030-4b3a-9402-53901935cd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:28.480760 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53184f3-4030-4b3a-9402-53901935cd53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:28.481250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53184f3-4030-4b3a-9402-53901935cd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:28.481683 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53184f3-4030-4b3a-9402-53901935cd53 admin admin] PATH_INFO: `/v3/projects/57e189e943674a4eba945b944f7dc603` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:28.488797 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53184f3-4030-4b3a-9402-53901935cd53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57e189e943674a4eba945b944f7dc603)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:28.490994 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53184f3-4030-4b3a-9402-53901935cd53 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:28.607192 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-d53184f3-4030-4b3a-9402-53901935cd53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57e189e943674a4eba945b944f7dc603', 'request_id': 'req-d53184f3-4030-4b3a-9402-53901935cd53'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:28.616263 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-d53184f3-4030-4b3a-9402-53901935cd53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57e189e943674a4eba945b944f7dc603', 'request_id': 'req-d53184f3-4030-4b3a-9402-53901935cd53'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:28.633505 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-d53184f3-4030-4b3a-9402-53901935cd53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57e189e943674a4eba945b944f7dc603', 'request_id': 'req-d53184f3-4030-4b3a-9402-53901935cd53'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:28.653975 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-d53184f3-4030-4b3a-9402-53901935cd53 admin admin] The token cache is being invalidate because project 57e189e943674a4eba945b944f7dc603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:28.654755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-d53184f3-4030-4b3a-9402-53901935cd53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:28.655638 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-d53184f3-4030-4b3a-9402-53901935cd53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:28.658045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1031/2041] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:28 2022] DELETE /identity/v3/projects/57e189e943674a4eba945b944f7dc603 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:28.664083 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc20a02-a560-4701-b25c-dc4173c4dfa3 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:28.664973 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc20a02-a560-4701-b25c-dc4173c4dfa3 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:28.665451 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc20a02-a560-4701-b25c-dc4173c4dfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:28.679792 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:28.703032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-7fc20a02-a560-4701-b25c-dc4173c4dfa3 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:28.708505 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-7fc20a02-a560-4701-b25c-dc4173c4dfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:28.843111 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1011/2042] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:28.845213 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39606f1-5986-412b-a964-2c4b9b463a53 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:28.845510 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39606f1-5986-412b-a964-2c4b9b463a53 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:28.848071 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39606f1-5986-412b-a964-2c4b9b463a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:28.898756 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-d39606f1-5986-412b-a964-2c4b9b463a53 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:28.900828 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-d39606f1-5986-412b-a964-2c4b9b463a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:28.931616 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1032/2043] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:28.936463 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc20a02-a560-4701-b25c-dc4173c4dfa3 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:28.952715 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc20a02-a560-4701-b25c-dc4173c4dfa3 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:28.980369 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c3c1f-ec78-416d-860e-d12c7468ca00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:28.981332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c3c1f-ec78-416d-860e-d12c7468ca00 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:28.981877 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c3c1f-ec78-416d-860e-d12c7468ca00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:28.982281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c3c1f-ec78-416d-860e-d12c7468ca00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:28.983831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c3c1f-ec78-416d-860e-d12c7468ca00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:18:28.984252 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c3c1f-ec78-416d-860e-d12c7468ca00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:28.986010 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c3c1f-ec78-416d-860e-d12c7468ca00 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:29.039138 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1012/2044] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:18:29.039277 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39606f1-5986-412b-a964-2c4b9b463a53 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:29.053705 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39606f1-5986-412b-a964-2c4b9b463a53 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:29.062104 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca00a0b-b634-48cd-95e6-d409425aa44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:29.062990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca00a0b-b634-48cd-95e6-d409425aa44c admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:29.063510 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca00a0b-b634-48cd-95e6-d409425aa44c admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:29.063946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca00a0b-b634-48cd-95e6-d409425aa44c admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:29.064775 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca00a0b-b634-48cd-95e6-d409425aa44c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:29.067551 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca00a0b-b634-48cd-95e6-d409425aa44c admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:29.095347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:29.112677 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c3c1f-ec78-416d-860e-d12c7468ca00 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:29.114379 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1033/2045] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:29 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:29.130436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c3c1f-ec78-416d-860e-d12c7468ca00 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:29.268695 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083472e-75a9-465f-a15b-1bf2345ed8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:29.269825 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083472e-75a9-465f-a15b-1bf2345ed8ad admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:29.270263 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083472e-75a9-465f-a15b-1bf2345ed8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:29.270603 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083472e-75a9-465f-a15b-1bf2345ed8ad admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:29.271527 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083472e-75a9-465f-a15b-1bf2345ed8ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:29.274221 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083472e-75a9-465f-a15b-1bf2345ed8ad admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:29.312998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1013/2046] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:29 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:18:29.314598 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca00a0b-b634-48cd-95e6-d409425aa44c admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:29.326572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca00a0b-b634-48cd-95e6-d409425aa44c admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:29.331338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c413211-5441-4a8a-bd0a-f21e00a05768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:29.332063 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c413211-5441-4a8a-bd0a-f21e00a05768 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:29.332359 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c413211-5441-4a8a-bd0a-f21e00a05768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:29.332661 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c413211-5441-4a8a-bd0a-f21e00a05768 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:29.333399 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c413211-5441-4a8a-bd0a-f21e00a05768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:29.335209 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c413211-5441-4a8a-bd0a-f21e00a05768 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:29.347376 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1034/2047] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:18:29.354714 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083472e-75a9-465f-a15b-1bf2345ed8ad admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:29.365367 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083472e-75a9-465f-a15b-1bf2345ed8ad admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:29.370261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca9bc9-b494-4cf4-ac5f-d741b208cc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:29.371696 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca9bc9-b494-4cf4-ac5f-d741b208cc27 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:29.371696 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca9bc9-b494-4cf4-ac5f-d741b208cc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:29.371696 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca9bc9-b494-4cf4-ac5f-d741b208cc27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:29.372195 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca9bc9-b494-4cf4-ac5f-d741b208cc27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:29.373794 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca9bc9-b494-4cf4-ac5f-d741b208cc27 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:29.384917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1014/2048] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:29.390683 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c413211-5441-4a8a-bd0a-f21e00a05768 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:29.400964 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c413211-5441-4a8a-bd0a-f21e00a05768 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:29.409313 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ab9db-b3f7-4385-9cef-058c26b8a5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:29.410248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ab9db-b3f7-4385-9cef-058c26b8a5d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:29.410536 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ab9db-b3f7-4385-9cef-058c26b8a5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:29.410918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ab9db-b3f7-4385-9cef-058c26b8a5d1 admin admin] PATH_INFO: `/v3/projects/602ae0d1ab934a63b783575fba66fad3/users/9f7607d0c1bc490b875dec60e117ff70/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:29.430315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ab9db-b3f7-4385-9cef-058c26b8a5d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=602ae0d1ab934a63b783575fba66fad3, user_id=9f7607d0c1bc490b875dec60e117ff70, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:29.433686 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ab9db-b3f7-4385-9cef-058c26b8a5d1 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:29.447794 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1035/2049] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:29 2022] PUT /identity/v3/projects/602ae0d1ab934a63b783575fba66fad3/users/9f7607d0c1bc490b875dec60e117ff70/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:29.460760 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05254288-d513-4b20-97f3-a9c47dc2f60b None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:29.461049 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05254288-d513-4b20-97f3-a9c47dc2f60b None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:29.461343 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05254288-d513-4b20-97f3-a9c47dc2f60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:29.493542 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-05254288-d513-4b20-97f3-a9c47dc2f60b None None] MFA Rules not processed for user `9f7607d0c1bc490b875dec60e117ff70`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:29.494869 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-05254288-d513-4b20-97f3-a9c47dc2f60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:29.561374 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:29.566414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1015/2050] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:29.571413 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ab9db-b3f7-4385-9cef-058c26b8a5d1 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:29.648095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ab9db-b3f7-4385-9cef-058c26b8a5d1 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:29.653550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce763c-55e4-4dc9-a76d-3de489081b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:29.654192 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce763c-55e4-4dc9-a76d-3de489081b0b admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:29.654536 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce763c-55e4-4dc9-a76d-3de489081b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:29.654823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce763c-55e4-4dc9-a76d-3de489081b0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:29.655527 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce763c-55e4-4dc9-a76d-3de489081b0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:29.657462 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce763c-55e4-4dc9-a76d-3de489081b0b admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:29.694160 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1036/2051] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:29 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:18:29.698166 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05254288-d513-4b20-97f3-a9c47dc2f60b None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:29.711503 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05254288-d513-4b20-97f3-a9c47dc2f60b None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:29.800770 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541d8fa-91e3-4a4f-8d7d-054a11afdc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:29.801825 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541d8fa-91e3-4a4f-8d7d-054a11afdc14 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:29.802167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541d8fa-91e3-4a4f-8d7d-054a11afdc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:29.802454 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541d8fa-91e3-4a4f-8d7d-054a11afdc14 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:29.803164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541d8fa-91e3-4a4f-8d7d-054a11afdc14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:29.806620 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541d8fa-91e3-4a4f-8d7d-054a11afdc14 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:29.851882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce763c-55e4-4dc9-a76d-3de489081b0b admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:29.862733 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1016/2052] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:29 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:29.875320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce763c-55e4-4dc9-a76d-3de489081b0b admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:29.884815 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36222fc6-2c04-41c0-9e50-43b05be469dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:29.886971 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36222fc6-2c04-41c0-9e50-43b05be469dd admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:29.887513 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36222fc6-2c04-41c0-9e50-43b05be469dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:29.888039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36222fc6-2c04-41c0-9e50-43b05be469dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:29.890384 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36222fc6-2c04-41c0-9e50-43b05be469dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:29.893973 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36222fc6-2c04-41c0-9e50-43b05be469dd admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:29.918331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1037/2053] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:29.923020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541d8fa-91e3-4a4f-8d7d-054a11afdc14 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:29.939997 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541d8fa-91e3-4a4f-8d7d-054a11afdc14 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:29.947934 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee7d44-be9a-475e-ae4a-931f9e4ef3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:29.949318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee7d44-be9a-475e-ae4a-931f9e4ef3d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:29.949803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee7d44-be9a-475e-ae4a-931f9e4ef3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:29.950305 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee7d44-be9a-475e-ae4a-931f9e4ef3d8 admin admin] PATH_INFO: `/v3/projects/3079d9bbedbf4351b9d800123e657637/users/9268b5121ab24a9d994e1978cab13045/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:29.972054 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee7d44-be9a-475e-ae4a-931f9e4ef3d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3079d9bbedbf4351b9d800123e657637, user_id=9268b5121ab24a9d994e1978cab13045, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:29.974803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee7d44-be9a-475e-ae4a-931f9e4ef3d8 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:29.999128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1017/2054] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:29 2022] PUT /identity/v3/projects/3079d9bbedbf4351b9d800123e657637/users/9268b5121ab24a9d994e1978cab13045/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:30.015627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36222fc6-2c04-41c0-9e50-43b05be469dd admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:30.027611 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36222fc6-2c04-41c0-9e50-43b05be469dd admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:30.152778 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd789ce9-b106-4709-8849-5dfe8c7b6c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:30.153701 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd789ce9-b106-4709-8849-5dfe8c7b6c55 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:30.153910 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd789ce9-b106-4709-8849-5dfe8c7b6c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:30.154211 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd789ce9-b106-4709-8849-5dfe8c7b6c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:30.154970 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd789ce9-b106-4709-8849-5dfe8c7b6c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:30.156630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd789ce9-b106-4709-8849-5dfe8c7b6c55 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:30.170373 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1038/2055] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:30.174715 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee7d44-be9a-475e-ae4a-931f9e4ef3d8 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:30.191540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee7d44-be9a-475e-ae4a-931f9e4ef3d8 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:30.199763 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa783dd-2d78-4e13-ad61-b62a551b01cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:30.200684 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa783dd-2d78-4e13-ad61-b62a551b01cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:30.200972 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa783dd-2d78-4e13-ad61-b62a551b01cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:30.201252 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa783dd-2d78-4e13-ad61-b62a551b01cf admin admin] PATH_INFO: `/v3/projects/3079d9bbedbf4351b9d800123e657637/users/9268b5121ab24a9d994e1978cab13045/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:30.203404 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa783dd-2d78-4e13-ad61-b62a551b01cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3079d9bbedbf4351b9d800123e657637, user_id=9268b5121ab24a9d994e1978cab13045, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:30.206388 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa783dd-2d78-4e13-ad61-b62a551b01cf admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:30.236914 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981206d-4ea5-4720-be41-65408ad7d826 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:30.237237 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981206d-4ea5-4720-be41-65408ad7d826 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:30.237503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981206d-4ea5-4720-be41-65408ad7d826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:30.238899 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1018/2056] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:30 2022] PUT /identity/v3/projects/3079d9bbedbf4351b9d800123e657637/users/9268b5121ab24a9d994e1978cab13045/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:18:30.303920 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-a981206d-4ea5-4720-be41-65408ad7d826 None None] MFA Rules not processed for user `9268b5121ab24a9d994e1978cab13045`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:30.305251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a981206d-4ea5-4720-be41-65408ad7d826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:30.330409 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:30.398288 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1039/2057] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:30.409707 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa783dd-2d78-4e13-ad61-b62a551b01cf admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:30.411551 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-caa783dd-2d78-4e13-ad61-b62a551b01cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:30.487875 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa783dd-2d78-4e13-ad61-b62a551b01cf admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:30.493673 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd1cb8-d4ce-4359-8cbc-902bb060a7f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:30.494457 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd1cb8-d4ce-4359-8cbc-902bb060a7f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:30.494811 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd1cb8-d4ce-4359-8cbc-902bb060a7f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:30.495194 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd1cb8-d4ce-4359-8cbc-902bb060a7f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:30.509632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd1cb8-d4ce-4359-8cbc-902bb060a7f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:30.511284 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd1cb8-d4ce-4359-8cbc-902bb060a7f0 service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:30.525046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1019/2058] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:30.794951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981206d-4ea5-4720-be41-65408ad7d826 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:30.804538 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd1cb8-d4ce-4359-8cbc-902bb060a7f0 service cinder] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:30.805250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981206d-4ea5-4720-be41-65408ad7d826 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:30.806028 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-03cd1cb8-d4ce-4359-8cbc-902bb060a7f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:30.810546 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7a68c-994e-4574-9416-67e0923185d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:30.811308 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7a68c-994e-4574-9416-67e0923185d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:30.811661 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7a68c-994e-4574-9416-67e0923185d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:30.814161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7a68c-994e-4574-9416-67e0923185d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:30.876838 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:30.880923 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7a68c-994e-4574-9416-67e0923185d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:30.882769 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7a68c-994e-4574-9416-67e0923185d4 service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:30.885397 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd1cb8-d4ce-4359-8cbc-902bb060a7f0 service cinder] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:30.891559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7401d22-a0b0-470b-9d31-8f27fd83662b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:30.892666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7401d22-a0b0-470b-9d31-8f27fd83662b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:30.893037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7401d22-a0b0-470b-9d31-8f27fd83662b admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:30.893447 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7401d22-a0b0-470b-9d31-8f27fd83662b admin admin] PATH_INFO: `/v3/users/a40cb088939448d48b3a29a7eb504e89` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:30.893892 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1040/2059] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:30.895557 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7401d22-a0b0-470b-9d31-8f27fd83662b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a40cb088939448d48b3a29a7eb504e89)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:30.899251 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7401d22-a0b0-470b-9d31-8f27fd83662b admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:30.990981 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a7401d22-a0b0-470b-9d31-8f27fd83662b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a40cb088939448d48b3a29a7eb504e89'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:30.991877 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a7401d22-a0b0-470b-9d31-8f27fd83662b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a40cb088939448d48b3a29a7eb504e89'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:31.006155 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a7401d22-a0b0-470b-9d31-8f27fd83662b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a40cb088939448d48b3a29a7eb504e89'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:31.021511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a7401d22-a0b0-470b-9d31-8f27fd83662b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a40cb088939448d48b3a29a7eb504e89'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:31.039291 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a7401d22-a0b0-470b-9d31-8f27fd83662b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a40cb088939448d48b3a29a7eb504e89'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:31.053015 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1020/2060] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:30 2022] DELETE /identity/v3/users/a40cb088939448d48b3a29a7eb504e89 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:18:31.057497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122a97f-950d-4ebe-9214-ae3eab2cb1e6 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:31.058347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122a97f-950d-4ebe-9214-ae3eab2cb1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:31.058628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122a97f-950d-4ebe-9214-ae3eab2cb1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:31.077849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-7122a97f-950d-4ebe-9214-ae3eab2cb1e6 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:31.081193 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-7122a97f-950d-4ebe-9214-ae3eab2cb1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:31.180709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1041/2061] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:31.188273 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7401d22-a0b0-470b-9d31-8f27fd83662b admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:31.199481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-a7401d22-a0b0-470b-9d31-8f27fd83662b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:31.296214 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7401d22-a0b0-470b-9d31-8f27fd83662b admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:31.300251 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238eea4-0241-4109-9340-84114ab098ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:31.300838 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238eea4-0241-4109-9340-84114ab098ae service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:31.301160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238eea4-0241-4109-9340-84114ab098ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:31.301393 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238eea4-0241-4109-9340-84114ab098ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:31.314435 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238eea4-0241-4109-9340-84114ab098ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:31.315946 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238eea4-0241-4109-9340-84114ab098ae service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:31.327082 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1021/2062] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:18:31.748611 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122a97f-950d-4ebe-9214-ae3eab2cb1e6 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:31.750328 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-7122a97f-950d-4ebe-9214-ae3eab2cb1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:31.764479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122a97f-950d-4ebe-9214-ae3eab2cb1e6 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:31.770650 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c1167-b51f-48f0-b9dd-ca30d7b94812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:31.771658 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c1167-b51f-48f0-b9dd-ca30d7b94812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:31.773454 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c1167-b51f-48f0-b9dd-ca30d7b94812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:31.773454 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c1167-b51f-48f0-b9dd-ca30d7b94812 admin admin] PATH_INFO: `/v3/projects/13d12861437a42c989c1c892b80eefe4` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:31.773813 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c1167-b51f-48f0-b9dd-ca30d7b94812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13d12861437a42c989c1c892b80eefe4)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:31.775958 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c1167-b51f-48f0-b9dd-ca30d7b94812 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:31.855586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-a08c1167-b51f-48f0-b9dd-ca30d7b94812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13d12861437a42c989c1c892b80eefe4', 'request_id': 'req-a08c1167-b51f-48f0-b9dd-ca30d7b94812'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:31.861229 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:31.869473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-a08c1167-b51f-48f0-b9dd-ca30d7b94812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13d12861437a42c989c1c892b80eefe4', 'request_id': 'req-a08c1167-b51f-48f0-b9dd-ca30d7b94812'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:31.882891 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-a08c1167-b51f-48f0-b9dd-ca30d7b94812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13d12861437a42c989c1c892b80eefe4', 'request_id': 'req-a08c1167-b51f-48f0-b9dd-ca30d7b94812'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:31.909188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-a08c1167-b51f-48f0-b9dd-ca30d7b94812 admin admin] The token cache is being invalidate because project 13d12861437a42c989c1c892b80eefe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:31.909745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-a08c1167-b51f-48f0-b9dd-ca30d7b94812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:31.910468 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-a08c1167-b51f-48f0-b9dd-ca30d7b94812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:31.912058 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1042/2063] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:31 2022] DELETE /identity/v3/projects/13d12861437a42c989c1c892b80eefe4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:31.916214 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238eea4-0241-4109-9340-84114ab098ae service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:31.928225 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238eea4-0241-4109-9340-84114ab098ae service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:32.010076 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8092669-d389-41a2-a0b8-7e0e8d674948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:32.012768 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8092669-d389-41a2-a0b8-7e0e8d674948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:32.012768 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8092669-d389-41a2-a0b8-7e0e8d674948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:32.012768 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8092669-d389-41a2-a0b8-7e0e8d674948 admin admin] PATH_INFO: `/v3/users/63da09cec389407b81199034b74896ed` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:32.014466 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8092669-d389-41a2-a0b8-7e0e8d674948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63da09cec389407b81199034b74896ed)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:32.016645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8092669-d389-41a2-a0b8-7e0e8d674948 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:32.043551 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:32.074375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a8092669-d389-41a2-a0b8-7e0e8d674948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63da09cec389407b81199034b74896ed'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:32.075053 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a8092669-d389-41a2-a0b8-7e0e8d674948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63da09cec389407b81199034b74896ed'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:32.082141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a8092669-d389-41a2-a0b8-7e0e8d674948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63da09cec389407b81199034b74896ed'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:32.089331 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a8092669-d389-41a2-a0b8-7e0e8d674948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63da09cec389407b81199034b74896ed'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:32.100876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a8092669-d389-41a2-a0b8-7e0e8d674948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63da09cec389407b81199034b74896ed'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:32.107504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1022/2064] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:31 2022] DELETE /identity/v3/users/63da09cec389407b81199034b74896ed => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:18:32.434466 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c1167-b51f-48f0-b9dd-ca30d7b94812 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:32.436338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a08c1167-b51f-48f0-b9dd-ca30d7b94812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:32.462963 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c1167-b51f-48f0-b9dd-ca30d7b94812 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:32.590203 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e7088-5f46-42fa-ab4c-caf9bf08fdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:32.591210 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e7088-5f46-42fa-ab4c-caf9bf08fdc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:32.591563 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e7088-5f46-42fa-ab4c-caf9bf08fdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:32.591850 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e7088-5f46-42fa-ab4c-caf9bf08fdc6 admin admin] PATH_INFO: `/v3/projects/8119fcfa18c74b6eb4821f57ef593e06` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:32.594511 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e7088-5f46-42fa-ab4c-caf9bf08fdc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8119fcfa18c74b6eb4821f57ef593e06)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:32.597188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e7088-5f46-42fa-ab4c-caf9bf08fdc6 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:32.668908 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-6f5e7088-5f46-42fa-ab4c-caf9bf08fdc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8119fcfa18c74b6eb4821f57ef593e06', 'request_id': 'req-6f5e7088-5f46-42fa-ab4c-caf9bf08fdc6'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:32.676876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-6f5e7088-5f46-42fa-ab4c-caf9bf08fdc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8119fcfa18c74b6eb4821f57ef593e06', 'request_id': 'req-6f5e7088-5f46-42fa-ab4c-caf9bf08fdc6'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:32.695089 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-6f5e7088-5f46-42fa-ab4c-caf9bf08fdc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8119fcfa18c74b6eb4821f57ef593e06', 'request_id': 'req-6f5e7088-5f46-42fa-ab4c-caf9bf08fdc6'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:32.713241 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-6f5e7088-5f46-42fa-ab4c-caf9bf08fdc6 admin admin] The token cache is being invalidate because project 8119fcfa18c74b6eb4821f57ef593e06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:32.713763 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-6f5e7088-5f46-42fa-ab4c-caf9bf08fdc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:32.714544 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-6f5e7088-5f46-42fa-ab4c-caf9bf08fdc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:32.716239 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1043/2065] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:32 2022] DELETE /identity/v3/projects/8119fcfa18c74b6eb4821f57ef593e06 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:32.721045 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146ae00-3042-48db-a504-1a9eec5bc2ec None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:32.721339 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146ae00-3042-48db-a504-1a9eec5bc2ec None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:32.721625 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146ae00-3042-48db-a504-1a9eec5bc2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:32.743574 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-5146ae00-3042-48db-a504-1a9eec5bc2ec None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:32.744721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-5146ae00-3042-48db-a504-1a9eec5bc2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:32.841130 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1023/2066] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:32.849030 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae971d71-88b0-4e33-af10-9a169ae4283f None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:32.849582 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae971d71-88b0-4e33-af10-9a169ae4283f None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:32.849582 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae971d71-88b0-4e33-af10-9a169ae4283f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:32.876889 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-ae971d71-88b0-4e33-af10-9a169ae4283f None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:32.878260 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-ae971d71-88b0-4e33-af10-9a169ae4283f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:32.886698 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1044/2067] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:32.891176 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146ae00-3042-48db-a504-1a9eec5bc2ec None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:32.901531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146ae00-3042-48db-a504-1a9eec5bc2ec None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:32.906563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10458b36-4726-40b4-9fda-093b020a3b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:32.907350 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10458b36-4726-40b4-9fda-093b020a3b79 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:32.907710 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10458b36-4726-40b4-9fda-093b020a3b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:32.908198 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10458b36-4726-40b4-9fda-093b020a3b79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:32.909759 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10458b36-4726-40b4-9fda-093b020a3b79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:18:32.910384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10458b36-4726-40b4-9fda-093b020a3b79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:32.913636 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10458b36-4726-40b4-9fda-093b020a3b79 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:32.931324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1024/2068] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:18:32.935979 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae971d71-88b0-4e33-af10-9a169ae4283f None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:32.945783 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae971d71-88b0-4e33-af10-9a169ae4283f None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:32.960233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62fd30-02da-438b-9aaa-a9075d658af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:32.960926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62fd30-02da-438b-9aaa-a9075d658af7 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:32.961208 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62fd30-02da-438b-9aaa-a9075d658af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:32.961510 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62fd30-02da-438b-9aaa-a9075d658af7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:32.962229 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62fd30-02da-438b-9aaa-a9075d658af7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:32.964315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62fd30-02da-438b-9aaa-a9075d658af7 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:32.993879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1045/2069] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:32 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:32.999381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10458b36-4726-40b4-9fda-093b020a3b79 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:33.010240 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10458b36-4726-40b4-9fda-093b020a3b79 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:33.081372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8831a-0c02-4efb-94ae-601ca7500547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:33.082234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8831a-0c02-4efb-94ae-601ca7500547 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:33.082584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8831a-0c02-4efb-94ae-601ca7500547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:33.082859 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8831a-0c02-4efb-94ae-601ca7500547 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:33.083716 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8831a-0c02-4efb-94ae-601ca7500547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:33.085741 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8831a-0c02-4efb-94ae-601ca7500547 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:33.109841 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1025/2070] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:32 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:18:33.114062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62fd30-02da-438b-9aaa-a9075d658af7 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:33.128065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62fd30-02da-438b-9aaa-a9075d658af7 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:33.133807 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4e5f1-83d7-482e-9b3d-9f3dece21bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:33.134759 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4e5f1-83d7-482e-9b3d-9f3dece21bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:33.135174 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4e5f1-83d7-482e-9b3d-9f3dece21bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:33.135461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4e5f1-83d7-482e-9b3d-9f3dece21bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:33.136307 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4e5f1-83d7-482e-9b3d-9f3dece21bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:33.140079 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4e5f1-83d7-482e-9b3d-9f3dece21bc5 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:33.151894 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1046/2071] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:33.155962 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8831a-0c02-4efb-94ae-601ca7500547 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:33.169320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8831a-0c02-4efb-94ae-601ca7500547 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:33.177124 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0d2f8-ec56-4a02-979c-0655d7e8f432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:33.177816 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0d2f8-ec56-4a02-979c-0655d7e8f432 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:33.178103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0d2f8-ec56-4a02-979c-0655d7e8f432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:33.178419 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0d2f8-ec56-4a02-979c-0655d7e8f432 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:33.179172 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0d2f8-ec56-4a02-979c-0655d7e8f432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:33.180842 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0d2f8-ec56-4a02-979c-0655d7e8f432 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:33.193231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1026/2072] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:33.198074 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4e5f1-83d7-482e-9b3d-9f3dece21bc5 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:33.213665 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4e5f1-83d7-482e-9b3d-9f3dece21bc5 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:33.218719 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3124a-450a-440f-b477-3d58697588da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:33.219634 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3124a-450a-440f-b477-3d58697588da admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:33.219921 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3124a-450a-440f-b477-3d58697588da admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:33.220198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3124a-450a-440f-b477-3d58697588da admin admin] PATH_INFO: `/v3/projects/f889e67bb469430ca951ad24249d73e9/users/7a6e943aa2f74c76b55fabd46efef40e/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:33.237314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3124a-450a-440f-b477-3d58697588da admin admin] RBAC: Authorizing `identity:create_grant(project_id=f889e67bb469430ca951ad24249d73e9, user_id=7a6e943aa2f74c76b55fabd46efef40e, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:33.240358 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3124a-450a-440f-b477-3d58697588da admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:33.257210 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1047/2073] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:33 2022] PUT /identity/v3/projects/f889e67bb469430ca951ad24249d73e9/users/7a6e943aa2f74c76b55fabd46efef40e/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:33.268705 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c6b14-3cfb-4da1-ae50-a97f28c316aa None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:33.269177 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c6b14-3cfb-4da1-ae50-a97f28c316aa None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:33.269534 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c6b14-3cfb-4da1-ae50-a97f28c316aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:33.276119 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:33.305333 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-142c6b14-3cfb-4da1-ae50-a97f28c316aa None None] MFA Rules not processed for user `7a6e943aa2f74c76b55fabd46efef40e`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:33.306746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-142c6b14-3cfb-4da1-ae50-a97f28c316aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:33.394074 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1027/2074] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:33.398939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3124a-450a-440f-b477-3d58697588da admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:33.409998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:33.474361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3124a-450a-440f-b477-3d58697588da admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:33.479435 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495e811-8dd4-41d1-a075-6def731a9172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:33.480123 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495e811-8dd4-41d1-a075-6def731a9172 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:33.480399 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495e811-8dd4-41d1-a075-6def731a9172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:33.480674 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495e811-8dd4-41d1-a075-6def731a9172 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:33.481567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495e811-8dd4-41d1-a075-6def731a9172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:33.484125 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495e811-8dd4-41d1-a075-6def731a9172 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:33.517553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1048/2075] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:33 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:33.524768 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c6b14-3cfb-4da1-ae50-a97f28c316aa None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:33.539102 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c6b14-3cfb-4da1-ae50-a97f28c316aa None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:33.603946 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd502cf-95ae-4ada-834b-3f0731064d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:33.606715 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd502cf-95ae-4ada-834b-3f0731064d54 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:33.606715 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd502cf-95ae-4ada-834b-3f0731064d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:33.606715 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd502cf-95ae-4ada-834b-3f0731064d54 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:33.606715 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd502cf-95ae-4ada-834b-3f0731064d54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:33.608535 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd502cf-95ae-4ada-834b-3f0731064d54 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:33.635051 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1028/2076] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:33 2022] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:33.636435 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495e811-8dd4-41d1-a075-6def731a9172 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:33.648686 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495e811-8dd4-41d1-a075-6def731a9172 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:33.653701 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a3b30-823a-4814-9674-acce9a6883be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:33.654518 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a3b30-823a-4814-9674-acce9a6883be admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:33.654866 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a3b30-823a-4814-9674-acce9a6883be admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:33.655206 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a3b30-823a-4814-9674-acce9a6883be admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:33.657339 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a3b30-823a-4814-9674-acce9a6883be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:33.657727 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a3b30-823a-4814-9674-acce9a6883be admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:33.691337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1049/2077] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:33.694587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd502cf-95ae-4ada-834b-3f0731064d54 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:33.697504 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a3b30-823a-4814-9674-acce9a6883be admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:33.700198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-7c4a3b30-823a-4814-9674-acce9a6883be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:33.707888 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd502cf-95ae-4ada-834b-3f0731064d54 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:33.717278 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b49dc-c1a6-4aec-9152-ab541752f716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:33.718848 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b49dc-c1a6-4aec-9152-ab541752f716 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:33.719570 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b49dc-c1a6-4aec-9152-ab541752f716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:33.720035 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b49dc-c1a6-4aec-9152-ab541752f716 admin admin] PATH_INFO: `/v3/projects/7b707e29c8e64cb8a483e112b0175445/users/28e381bb09e04b448eb7adc4227031c7/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:33.721060 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a3b30-823a-4814-9674-acce9a6883be admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:33.728123 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b05f5d-c097-410a-9227-488ec69621ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:33.730586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b05f5d-c097-410a-9227-488ec69621ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:33.731410 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b05f5d-c097-410a-9227-488ec69621ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:33.731710 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b05f5d-c097-410a-9227-488ec69621ab admin admin] PATH_INFO: `/v3/users/9f7607d0c1bc490b875dec60e117ff70` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:33.733316 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b05f5d-c097-410a-9227-488ec69621ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f7607d0c1bc490b875dec60e117ff70)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:33.736513 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b05f5d-c097-410a-9227-488ec69621ab admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:33.742435 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b49dc-c1a6-4aec-9152-ab541752f716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b707e29c8e64cb8a483e112b0175445, user_id=28e381bb09e04b448eb7adc4227031c7, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:33.745740 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b49dc-c1a6-4aec-9152-ab541752f716 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:33.766273 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1029/2078] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:33 2022] PUT /identity/v3/projects/7b707e29c8e64cb8a483e112b0175445/users/28e381bb09e04b448eb7adc4227031c7/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:33.767708 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b49dc-c1a6-4aec-9152-ab541752f716 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:33.818672 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-01b05f5d-c097-410a-9227-488ec69621ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f7607d0c1bc490b875dec60e117ff70'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:33.831084 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-01b05f5d-c097-410a-9227-488ec69621ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f7607d0c1bc490b875dec60e117ff70'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:33.842587 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-01b05f5d-c097-410a-9227-488ec69621ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f7607d0c1bc490b875dec60e117ff70'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:33.843667 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:33.844969 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-01b05f5d-c097-410a-9227-488ec69621ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f7607d0c1bc490b875dec60e117ff70'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:33.848269 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b49dc-c1a6-4aec-9152-ab541752f716 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:33.856906 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f6f72-ba4d-4ba1-8aa0-96b46b4b9537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:33.858145 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f6f72-ba4d-4ba1-8aa0-96b46b4b9537 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:33.858682 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f6f72-ba4d-4ba1-8aa0-96b46b4b9537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:33.859168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f6f72-ba4d-4ba1-8aa0-96b46b4b9537 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:33.860212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f6f72-ba4d-4ba1-8aa0-96b46b4b9537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:33.867226 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f6f72-ba4d-4ba1-8aa0-96b46b4b9537 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:33.883017 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1030/2079] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:33.887164 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-01b05f5d-c097-410a-9227-488ec69621ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f7607d0c1bc490b875dec60e117ff70'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:33.887675 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f6f72-ba4d-4ba1-8aa0-96b46b4b9537 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:33.889708 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-676f6f72-ba4d-4ba1-8aa0-96b46b4b9537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:33.907446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1050/2080] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:33 2022] DELETE /identity/v3/users/9f7607d0c1bc490b875dec60e117ff70 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:33.912262 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675690e-c319-4d19-97ac-1a2d1ba33f54 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:33.912554 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675690e-c319-4d19-97ac-1a2d1ba33f54 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:33.913046 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675690e-c319-4d19-97ac-1a2d1ba33f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:33.928312 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f6f72-ba4d-4ba1-8aa0-96b46b4b9537 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:33.947605 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-5675690e-c319-4d19-97ac-1a2d1ba33f54 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:33.950908 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-5675690e-c319-4d19-97ac-1a2d1ba33f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:34.036792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:34.062963 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fad81b-f900-4821-85ec-617a2c9bac9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:34.063966 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fad81b-f900-4821-85ec-617a2c9bac9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:34.064304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fad81b-f900-4821-85ec-617a2c9bac9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:34.064778 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fad81b-f900-4821-85ec-617a2c9bac9a admin admin] PATH_INFO: `/v3/projects/7b707e29c8e64cb8a483e112b0175445/users/28e381bb09e04b448eb7adc4227031c7/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:34.067013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fad81b-f900-4821-85ec-617a2c9bac9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b707e29c8e64cb8a483e112b0175445, user_id=28e381bb09e04b448eb7adc4227031c7, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:34.071151 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fad81b-f900-4821-85ec-617a2c9bac9a admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:34.078509 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1051/2081] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:18:34.089451 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675690e-c319-4d19-97ac-1a2d1ba33f54 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:34.093119 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-5675690e-c319-4d19-97ac-1a2d1ba33f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:34.107128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1031/2082] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:33 2022] PUT /identity/v3/projects/7b707e29c8e64cb8a483e112b0175445/users/28e381bb09e04b448eb7adc4227031c7/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:34.122791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f6a81-4f22-4899-b96c-ff3a2b55405e None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:34.123340 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f6a81-4f22-4899-b96c-ff3a2b55405e None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:34.123737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f6a81-4f22-4899-b96c-ff3a2b55405e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:34.222845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-0c9f6a81-4f22-4899-b96c-ff3a2b55405e None None] MFA Rules not processed for user `28e381bb09e04b448eb7adc4227031c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:34.224199 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-0c9f6a81-4f22-4899-b96c-ff3a2b55405e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:34.286785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675690e-c319-4d19-97ac-1a2d1ba33f54 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:34.367308 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1032/2083] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:34.368994 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5aa060-bc93-47fa-9932-e7bdef701ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:34.369844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5aa060-bc93-47fa-9932-e7bdef701ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:34.370835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5aa060-bc93-47fa-9932-e7bdef701ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:34.371295 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5aa060-bc93-47fa-9932-e7bdef701ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:34.380640 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f6a81-4f22-4899-b96c-ff3a2b55405e None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:34.388299 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-0c9f6a81-4f22-4899-b96c-ff3a2b55405e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:34.472677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5aa060-bc93-47fa-9932-e7bdef701ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:34.475855 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5aa060-bc93-47fa-9932-e7bdef701ea1 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:34.481721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f6a81-4f22-4899-b96c-ff3a2b55405e None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:34.489351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a22538-c8d4-4f5d-a84a-e4dea3106eed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:34.490385 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a22538-c8d4-4f5d-a84a-e4dea3106eed service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:34.490804 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a22538-c8d4-4f5d-a84a-e4dea3106eed service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:34.491719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a22538-c8d4-4f5d-a84a-e4dea3106eed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:34.494161 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-b1a22538-c8d4-4f5d-a84a-e4dea3106eed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:34.495478 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1052/2084] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:34.533047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:34.583294 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a22538-c8d4-4f5d-a84a-e4dea3106eed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:34.585152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a22538-c8d4-4f5d-a84a-e4dea3106eed service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:34.599020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1033/2085] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:35.116757 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5aa060-bc93-47fa-9932-e7bdef701ea1 service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:35.117347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-6b5aa060-bc93-47fa-9932-e7bdef701ea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:35.146015 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5aa060-bc93-47fa-9932-e7bdef701ea1 service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:35.162477 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2651a-5a25-456c-8a2c-2b753e59ced4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:35.163974 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2651a-5a25-456c-8a2c-2b753e59ced4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:35.164269 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2651a-5a25-456c-8a2c-2b753e59ced4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:35.164545 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2651a-5a25-456c-8a2c-2b753e59ced4 admin admin] PATH_INFO: `/v3/projects/602ae0d1ab934a63b783575fba66fad3` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:35.165857 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2651a-5a25-456c-8a2c-2b753e59ced4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=602ae0d1ab934a63b783575fba66fad3)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:35.169348 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2651a-5a25-456c-8a2c-2b753e59ced4 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:35.267207 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-87c2651a-5a25-456c-8a2c-2b753e59ced4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '602ae0d1ab934a63b783575fba66fad3', 'request_id': 'req-87c2651a-5a25-456c-8a2c-2b753e59ced4'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:35.274882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-87c2651a-5a25-456c-8a2c-2b753e59ced4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '602ae0d1ab934a63b783575fba66fad3', 'request_id': 'req-87c2651a-5a25-456c-8a2c-2b753e59ced4'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:35.277996 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:35.305394 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-87c2651a-5a25-456c-8a2c-2b753e59ced4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '602ae0d1ab934a63b783575fba66fad3', 'request_id': 'req-87c2651a-5a25-456c-8a2c-2b753e59ced4'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:35.327336 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-87c2651a-5a25-456c-8a2c-2b753e59ced4 admin admin] The token cache is being invalidate because project 602ae0d1ab934a63b783575fba66fad3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:35.328073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-87c2651a-5a25-456c-8a2c-2b753e59ced4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:35.329037 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-87c2651a-5a25-456c-8a2c-2b753e59ced4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:35.331631 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1053/2086] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:35 2022] DELETE /identity/v3/projects/602ae0d1ab934a63b783575fba66fad3 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:35.336400 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a22538-c8d4-4f5d-a84a-e4dea3106eed service cinder] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:35.349437 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a22538-c8d4-4f5d-a84a-e4dea3106eed service cinder] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:35.436834 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26714392-c028-4bbc-b1f2-7d05e3ea232b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:35.438230 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26714392-c028-4bbc-b1f2-7d05e3ea232b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:35.439034 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26714392-c028-4bbc-b1f2-7d05e3ea232b admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:35.439403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26714392-c028-4bbc-b1f2-7d05e3ea232b admin admin] PATH_INFO: `/v3/users/9268b5121ab24a9d994e1978cab13045` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:35.440900 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26714392-c028-4bbc-b1f2-7d05e3ea232b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9268b5121ab24a9d994e1978cab13045)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:35.443042 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26714392-c028-4bbc-b1f2-7d05e3ea232b admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:35.509393 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-26714392-c028-4bbc-b1f2-7d05e3ea232b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9268b5121ab24a9d994e1978cab13045'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:35.510130 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-26714392-c028-4bbc-b1f2-7d05e3ea232b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9268b5121ab24a9d994e1978cab13045'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:35.520607 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-26714392-c028-4bbc-b1f2-7d05e3ea232b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9268b5121ab24a9d994e1978cab13045'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:35.529724 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-26714392-c028-4bbc-b1f2-7d05e3ea232b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9268b5121ab24a9d994e1978cab13045'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:35.546177 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-26714392-c028-4bbc-b1f2-7d05e3ea232b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9268b5121ab24a9d994e1978cab13045'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:35.556186 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1034/2087] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:35 2022] DELETE /identity/v3/users/9268b5121ab24a9d994e1978cab13045 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:36.234006 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2651a-5a25-456c-8a2c-2b753e59ced4 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:36.235620 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-87c2651a-5a25-456c-8a2c-2b753e59ced4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:36.261712 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2651a-5a25-456c-8a2c-2b753e59ced4 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:36.394169 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88e7d7-a49a-4e48-82d1-fb3987028d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:36.395343 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88e7d7-a49a-4e48-82d1-fb3987028d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:36.395474 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88e7d7-a49a-4e48-82d1-fb3987028d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:36.395666 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88e7d7-a49a-4e48-82d1-fb3987028d9d admin admin] PATH_INFO: `/v3/projects/3079d9bbedbf4351b9d800123e657637` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:36.399937 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88e7d7-a49a-4e48-82d1-fb3987028d9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3079d9bbedbf4351b9d800123e657637)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:36.402095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88e7d7-a49a-4e48-82d1-fb3987028d9d admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:36.507092 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-9d88e7d7-a49a-4e48-82d1-fb3987028d9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3079d9bbedbf4351b9d800123e657637', 'request_id': 'req-9d88e7d7-a49a-4e48-82d1-fb3987028d9d'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:36.516963 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-9d88e7d7-a49a-4e48-82d1-fb3987028d9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3079d9bbedbf4351b9d800123e657637', 'request_id': 'req-9d88e7d7-a49a-4e48-82d1-fb3987028d9d'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:36.563304 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-9d88e7d7-a49a-4e48-82d1-fb3987028d9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3079d9bbedbf4351b9d800123e657637', 'request_id': 'req-9d88e7d7-a49a-4e48-82d1-fb3987028d9d'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:36.598870 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-9d88e7d7-a49a-4e48-82d1-fb3987028d9d admin admin] The token cache is being invalidate because project 3079d9bbedbf4351b9d800123e657637 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:36.599229 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-9d88e7d7-a49a-4e48-82d1-fb3987028d9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:36.600131 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-9d88e7d7-a49a-4e48-82d1-fb3987028d9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:36.603732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1054/2088] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:36 2022] DELETE /identity/v3/projects/3079d9bbedbf4351b9d800123e657637 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:36.608484 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613eab85-b0a5-4111-8c6c-10417cd84798 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:36.609051 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613eab85-b0a5-4111-8c6c-10417cd84798 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:36.609051 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613eab85-b0a5-4111-8c6c-10417cd84798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:36.646628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-613eab85-b0a5-4111-8c6c-10417cd84798 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:36.653224 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-613eab85-b0a5-4111-8c6c-10417cd84798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:36.751051 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:36.796711 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1035/2089] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:36.809574 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49fbdd-5ff0-4512-bf29-8ef69e13fffd None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:36.810607 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49fbdd-5ff0-4512-bf29-8ef69e13fffd None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:36.811087 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49fbdd-5ff0-4512-bf29-8ef69e13fffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:36.862650 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-fa49fbdd-5ff0-4512-bf29-8ef69e13fffd None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:36.866785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-fa49fbdd-5ff0-4512-bf29-8ef69e13fffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:36.884398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613eab85-b0a5-4111-8c6c-10417cd84798 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:36.892012 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1055/2090] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:36.900390 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613eab85-b0a5-4111-8c6c-10417cd84798 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:36.926188 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab0feb-f1fb-49a9-ab07-ecac76c02ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:36.927189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab0feb-f1fb-49a9-ab07-ecac76c02ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:36.927643 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab0feb-f1fb-49a9-ab07-ecac76c02ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:36.928097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab0feb-f1fb-49a9-ab07-ecac76c02ee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:36.929500 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab0feb-f1fb-49a9-ab07-ecac76c02ee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:18:36.930055 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab0feb-f1fb-49a9-ab07-ecac76c02ee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:36.932002 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab0feb-f1fb-49a9-ab07-ecac76c02ee1 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:36.966839 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1036/2091] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:18:36.971476 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49fbdd-5ff0-4512-bf29-8ef69e13fffd None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:36.986821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49fbdd-5ff0-4512-bf29-8ef69e13fffd None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:37.006103 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c3c0e-9343-4a06-9e63-ec08143d2175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:37.007135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c3c0e-9343-4a06-9e63-ec08143d2175 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:37.007460 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c3c0e-9343-4a06-9e63-ec08143d2175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:37.007717 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c3c0e-9343-4a06-9e63-ec08143d2175 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:37.008429 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c3c0e-9343-4a06-9e63-ec08143d2175 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:37.010471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c3c0e-9343-4a06-9e63-ec08143d2175 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:37.077408 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1056/2092] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:36 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:37.077768 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab0feb-f1fb-49a9-ab07-ecac76c02ee1 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:37.096990 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab0feb-f1fb-49a9-ab07-ecac76c02ee1 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:37.172166 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0e7ce-2349-4acd-85b2-9c2977aca3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:37.173442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0e7ce-2349-4acd-85b2-9c2977aca3cc admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:37.173984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0e7ce-2349-4acd-85b2-9c2977aca3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:37.174570 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0e7ce-2349-4acd-85b2-9c2977aca3cc admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:37.175646 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0e7ce-2349-4acd-85b2-9c2977aca3cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:37.178006 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0e7ce-2349-4acd-85b2-9c2977aca3cc admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:37.215693 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1037/2093] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:37 2022] POST /identity/v3/users => generated 294 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:37.220261 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c3c0e-9343-4a06-9e63-ec08143d2175 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:37.240843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c3c0e-9343-4a06-9e63-ec08143d2175 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:37.249904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303dfc5f-2a86-4782-9fa7-3468753b25c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:37.256247 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303dfc5f-2a86-4782-9fa7-3468753b25c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:37.256603 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303dfc5f-2a86-4782-9fa7-3468753b25c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:37.257304 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303dfc5f-2a86-4782-9fa7-3468753b25c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:37.258914 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303dfc5f-2a86-4782-9fa7-3468753b25c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:37.262375 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303dfc5f-2a86-4782-9fa7-3468753b25c6 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:37.278309 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1057/2094] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:37.285908 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0e7ce-2349-4acd-85b2-9c2977aca3cc admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:37.304263 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0e7ce-2349-4acd-85b2-9c2977aca3cc admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:37.310528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d86bab-f6ea-4d77-93e6-ce92dd838225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:37.311405 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d86bab-f6ea-4d77-93e6-ce92dd838225 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:37.311702 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d86bab-f6ea-4d77-93e6-ce92dd838225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:37.311979 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d86bab-f6ea-4d77-93e6-ce92dd838225 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:37.312734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d86bab-f6ea-4d77-93e6-ce92dd838225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:37.314534 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d86bab-f6ea-4d77-93e6-ce92dd838225 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:37.329002 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1038/2095] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:37.333040 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303dfc5f-2a86-4782-9fa7-3468753b25c6 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:37.348627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303dfc5f-2a86-4782-9fa7-3468753b25c6 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:37.353589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210120e-ac48-464f-b197-473264a8284f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:37.355071 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210120e-ac48-464f-b197-473264a8284f admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:37.355359 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210120e-ac48-464f-b197-473264a8284f admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:37.355636 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210120e-ac48-464f-b197-473264a8284f admin admin] PATH_INFO: `/v3/projects/1ec2b8f22d4246d59bae505a54875a06/users/f9d88069de2f40d788134f74860d6d5f/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:37.377142 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210120e-ac48-464f-b197-473264a8284f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ec2b8f22d4246d59bae505a54875a06, user_id=f9d88069de2f40d788134f74860d6d5f, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:37.380116 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210120e-ac48-464f-b197-473264a8284f admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:37.390868 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d86bab-f6ea-4d77-93e6-ce92dd838225 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:37.392691 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-87d86bab-f6ea-4d77-93e6-ce92dd838225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:37.399568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1058/2096] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:37 2022] PUT /identity/v3/projects/1ec2b8f22d4246d59bae505a54875a06/users/f9d88069de2f40d788134f74860d6d5f/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:37.407090 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d86bab-f6ea-4d77-93e6-ce92dd838225 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:37.409787 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4dc1d-65a9-43af-99b0-14e7f3d3a65c None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:37.410083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4dc1d-65a9-43af-99b0-14e7f3d3a65c None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:37.410400 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4dc1d-65a9-43af-99b0-14e7f3d3a65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:37.430259 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:37.442396 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-f2e4dc1d-65a9-43af-99b0-14e7f3d3a65c None None] MFA Rules not processed for user `f9d88069de2f40d788134f74860d6d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:37.444093 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-f2e4dc1d-65a9-43af-99b0-14e7f3d3a65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:37.478307 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0286fd-9b24-4230-a4ab-70b3449ee1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:37.479784 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0286fd-9b24-4230-a4ab-70b3449ee1aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:37.480070 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0286fd-9b24-4230-a4ab-70b3449ee1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:37.480351 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0286fd-9b24-4230-a4ab-70b3449ee1aa admin admin] PATH_INFO: `/v3/users/ca43e59f48fd49e18e1359e9d26c5bab` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:37.481732 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0286fd-9b24-4230-a4ab-70b3449ee1aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca43e59f48fd49e18e1359e9d26c5bab)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:37.485313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0286fd-9b24-4230-a4ab-70b3449ee1aa admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:37.525152 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1059/2097] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:18:37.529644 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4dc1d-65a9-43af-99b0-14e7f3d3a65c None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:37.540117 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-2f0286fd-9b24-4230-a4ab-70b3449ee1aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca43e59f48fd49e18e1359e9d26c5bab'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:37.540774 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-2f0286fd-9b24-4230-a4ab-70b3449ee1aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca43e59f48fd49e18e1359e9d26c5bab'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:37.540888 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4dc1d-65a9-43af-99b0-14e7f3d3a65c None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:37.546232 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cbae8-c9ca-468f-9525-041f45a978b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:37.546956 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cbae8-c9ca-468f-9525-041f45a978b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:37.547222 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cbae8-c9ca-468f-9525-041f45a978b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:37.547486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cbae8-c9ca-468f-9525-041f45a978b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:37.548180 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cbae8-c9ca-468f-9525-041f45a978b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:37.548960 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-2f0286fd-9b24-4230-a4ab-70b3449ee1aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca43e59f48fd49e18e1359e9d26c5bab'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:37.550248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cbae8-c9ca-468f-9525-041f45a978b0 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:37.550380 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:37.559115 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-2f0286fd-9b24-4230-a4ab-70b3449ee1aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca43e59f48fd49e18e1359e9d26c5bab'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:37.579288 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-2f0286fd-9b24-4230-a4ab-70b3449ee1aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca43e59f48fd49e18e1359e9d26c5bab'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:37.585845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1060/2098] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:37 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:18:37.587951 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1039/2099] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:37 2022] DELETE /identity/v3/users/ca43e59f48fd49e18e1359e9d26c5bab => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:18:37.591429 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cbae8-c9ca-468f-9525-041f45a978b0 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:37.593138 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-f33cbae8-c9ca-468f-9525-041f45a978b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:37.698653 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cbae8-c9ca-468f-9525-041f45a978b0 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:37.766530 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d21a82-fb70-44fe-8fee-97fa48174d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:37.767219 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d21a82-fb70-44fe-8fee-97fa48174d3e admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:37.767649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d21a82-fb70-44fe-8fee-97fa48174d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:37.767934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d21a82-fb70-44fe-8fee-97fa48174d3e admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:37.768638 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d21a82-fb70-44fe-8fee-97fa48174d3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:37.770761 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d21a82-fb70-44fe-8fee-97fa48174d3e admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:37.801244 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1061/2100] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:37 2022] POST /identity/v3/users => generated 300 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:18:37.805345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0286fd-9b24-4230-a4ab-70b3449ee1aa admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:37.816370 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0286fd-9b24-4230-a4ab-70b3449ee1aa admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:37.821397 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71af03-20ae-4657-88ee-f25e684ea25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:37.822204 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71af03-20ae-4657-88ee-f25e684ea25f admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:37.822542 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d21a82-fb70-44fe-8fee-97fa48174d3e admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:37.822656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71af03-20ae-4657-88ee-f25e684ea25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:37.822905 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71af03-20ae-4657-88ee-f25e684ea25f admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:37.823730 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71af03-20ae-4657-88ee-f25e684ea25f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:37.824786 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-22d21a82-fb70-44fe-8fee-97fa48174d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:37.825520 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71af03-20ae-4657-88ee-f25e684ea25f admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:37.843289 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1040/2101] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:37.844112 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d21a82-fb70-44fe-8fee-97fa48174d3e admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:37.847695 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71af03-20ae-4657-88ee-f25e684ea25f admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:37.851959 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facca21-7f8d-4888-a758-6468f17f6968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:37.852862 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facca21-7f8d-4888-a758-6468f17f6968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:37.853119 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facca21-7f8d-4888-a758-6468f17f6968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:37.853592 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facca21-7f8d-4888-a758-6468f17f6968 admin admin] PATH_INFO: `/v3/projects/6fadf6e704294a3985a169f60772a1da` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:37.855299 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facca21-7f8d-4888-a758-6468f17f6968 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fadf6e704294a3985a169f60772a1da)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:37.857734 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facca21-7f8d-4888-a758-6468f17f6968 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:37.862936 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71af03-20ae-4657-88ee-f25e684ea25f admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:37.866770 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:37.869589 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8bc60-0f36-4328-9321-d6846cb9833c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:37.870842 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8bc60-0f36-4328-9321-d6846cb9833c admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:37.871202 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8bc60-0f36-4328-9321-d6846cb9833c admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:37.871568 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8bc60-0f36-4328-9321-d6846cb9833c admin admin] PATH_INFO: `/v3/projects/078694ba526446dbaf7d1a5b8b34d9ea/users/e5efa599f08f4bf6924dde74ca7464e2/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:37.891411 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8bc60-0f36-4328-9321-d6846cb9833c admin admin] RBAC: Authorizing `identity:create_grant(project_id=078694ba526446dbaf7d1a5b8b34d9ea, user_id=e5efa599f08f4bf6924dde74ca7464e2, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:37.894468 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8bc60-0f36-4328-9321-d6846cb9833c admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:37.910400 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1041/2102] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:37 2022] PUT /identity/v3/projects/078694ba526446dbaf7d1a5b8b34d9ea/users/e5efa599f08f4bf6924dde74ca7464e2/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:18:37.913815 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8bc60-0f36-4328-9321-d6846cb9833c admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:37.919393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-3facca21-7f8d-4888-a758-6468f17f6968 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fadf6e704294a3985a169f60772a1da', 'request_id': 'req-3facca21-7f8d-4888-a758-6468f17f6968'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:37.929224 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-3facca21-7f8d-4888-a758-6468f17f6968 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fadf6e704294a3985a169f60772a1da', 'request_id': 'req-3facca21-7f8d-4888-a758-6468f17f6968'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:37.939293 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-3facca21-7f8d-4888-a758-6468f17f6968 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fadf6e704294a3985a169f60772a1da', 'request_id': 'req-3facca21-7f8d-4888-a758-6468f17f6968'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:37.956738 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-3facca21-7f8d-4888-a758-6468f17f6968 admin admin] The token cache is being invalidate because project 6fadf6e704294a3985a169f60772a1da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:37.957047 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-3facca21-7f8d-4888-a758-6468f17f6968 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:37.957910 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-3facca21-7f8d-4888-a758-6468f17f6968 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:37.960089 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1062/2103] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:37 2022] DELETE /identity/v3/projects/6fadf6e704294a3985a169f60772a1da => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:18:37.967105 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c316c6e-4956-47c5-aa43-dbcf3aa34237 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:37.968065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c316c6e-4956-47c5-aa43-dbcf3aa34237 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:37.968856 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c316c6e-4956-47c5-aa43-dbcf3aa34237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:37.995268 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8bc60-0f36-4328-9321-d6846cb9833c admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:37.996540 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-8c316c6e-4956-47c5-aa43-dbcf3aa34237 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:37.999536 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-8c316c6e-4956-47c5-aa43-dbcf3aa34237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:38.005862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf0d65-0f93-410b-8c38-7c374f73e00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:38.006563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf0d65-0f93-410b-8c38-7c374f73e00f admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:38.007109 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf0d65-0f93-410b-8c38-7c374f73e00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:38.007385 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf0d65-0f93-410b-8c38-7c374f73e00f admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:38.008142 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf0d65-0f93-410b-8c38-7c374f73e00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:38.009879 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf0d65-0f93-410b-8c38-7c374f73e00f admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:38.016752 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1063/2104] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:18:38.021893 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1042/2105] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:18:38.027463 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb08f3e-d12b-423a-b03f-5367388d5446 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:38.027668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf0d65-0f93-410b-8c38-7c374f73e00f admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:38.027769 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb08f3e-d12b-423a-b03f-5367388d5446 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:38.028028 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb08f3e-d12b-423a-b03f-5367388d5446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:38.029499 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-f7bf0d65-0f93-410b-8c38-7c374f73e00f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:38.043620 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf0d65-0f93-410b-8c38-7c374f73e00f admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:38.049119 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-edb08f3e-d12b-423a-b03f-5367388d5446 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:38.049251 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3a977-7111-4a44-9413-b7b2a24e51d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:38.050022 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3a977-7111-4a44-9413-b7b2a24e51d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:38.050377 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3a977-7111-4a44-9413-b7b2a24e51d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:38.050503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-edb08f3e-d12b-423a-b03f-5367388d5446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:38.050689 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3a977-7111-4a44-9413-b7b2a24e51d6 admin admin] PATH_INFO: `/v3/projects/078694ba526446dbaf7d1a5b8b34d9ea/users/e5efa599f08f4bf6924dde74ca7464e2/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:38.052954 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3a977-7111-4a44-9413-b7b2a24e51d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=078694ba526446dbaf7d1a5b8b34d9ea, user_id=e5efa599f08f4bf6924dde74ca7464e2, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:38.057453 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3a977-7111-4a44-9413-b7b2a24e51d6 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:38.059877 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1064/2106] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:38.064186 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb08f3e-d12b-423a-b03f-5367388d5446 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:38.075295 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1043/2107] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:38 2022] PUT /identity/v3/projects/078694ba526446dbaf7d1a5b8b34d9ea/users/e5efa599f08f4bf6924dde74ca7464e2/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:38.075445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb08f3e-d12b-423a-b03f-5367388d5446 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:38.085752 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54b7a1-1028-40c7-a59a-766b18008d06 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:38.086140 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54b7a1-1028-40c7-a59a-766b18008d06 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:38.086495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54b7a1-1028-40c7-a59a-766b18008d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:38.116323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-1a54b7a1-1028-40c7-a59a-766b18008d06 None None] MFA Rules not processed for user `e5efa599f08f4bf6924dde74ca7464e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:38.118173 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-1a54b7a1-1028-40c7-a59a-766b18008d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:38.231665 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8badc-49e9-4076-abdf-11dca090e8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:38.232803 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8badc-49e9-4076-abdf-11dca090e8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:38.233281 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8badc-49e9-4076-abdf-11dca090e8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:38.233889 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8badc-49e9-4076-abdf-11dca090e8e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:38.235377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8badc-49e9-4076-abdf-11dca090e8e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:18:38.236057 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8badc-49e9-4076-abdf-11dca090e8e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:38.238347 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1044/2108] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:18:38.238638 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8badc-49e9-4076-abdf-11dca090e8e3 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:38.252008 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54b7a1-1028-40c7-a59a-766b18008d06 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:38.254277 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-1a54b7a1-1028-40c7-a59a-766b18008d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:38.259435 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1065/2109] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:18:38.261032 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8badc-49e9-4076-abdf-11dca090e8e3 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:38.272468 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:38.279006 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8badc-49e9-4076-abdf-11dca090e8e3 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:38.288878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08c9b2-22ae-4459-98c0-849a7604ef4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:38.289565 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08c9b2-22ae-4459-98c0-849a7604ef4f admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:38.289771 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08c9b2-22ae-4459-98c0-849a7604ef4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:38.290167 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08c9b2-22ae-4459-98c0-849a7604ef4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:38.292381 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08c9b2-22ae-4459-98c0-849a7604ef4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:38.294494 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08c9b2-22ae-4459-98c0-849a7604ef4f admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:38.335870 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1066/2110] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:38 2022] POST /identity/v3/projects => generated 389 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:18:38.342921 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08c9b2-22ae-4459-98c0-849a7604ef4f admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:38.353391 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54b7a1-1028-40c7-a59a-766b18008d06 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:38.444309 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2b62e-8dff-49d7-b251-0d1642a80e2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:38.445892 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2b62e-8dff-49d7-b251-0d1642a80e2f service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:38.445892 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2b62e-8dff-49d7-b251-0d1642a80e2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:38.445892 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2b62e-8dff-49d7-b251-0d1642a80e2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:38.447368 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:38.468917 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08c9b2-22ae-4459-98c0-849a7604ef4f admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:38.480844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505f5b1-5764-4b59-8a7c-fc18c6b99767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:38.481606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505f5b1-5764-4b59-8a7c-fc18c6b99767 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:38.482441 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505f5b1-5764-4b59-8a7c-fc18c6b99767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:38.482748 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505f5b1-5764-4b59-8a7c-fc18c6b99767 admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:38.483797 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505f5b1-5764-4b59-8a7c-fc18c6b99767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:38.486004 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505f5b1-5764-4b59-8a7c-fc18c6b99767 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:38.532738 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1067/2111] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:38 2022] POST /identity/v3/users => generated 295 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:18:38.537380 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2b62e-8dff-49d7-b251-0d1642a80e2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:38.538551 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505f5b1-5764-4b59-8a7c-fc18c6b99767 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:38.538886 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2b62e-8dff-49d7-b251-0d1642a80e2f service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:38.555901 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505f5b1-5764-4b59-8a7c-fc18c6b99767 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:38.558744 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1045/2112] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:18:38.567859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50d63b-66e5-4b21-8231-3fcf931a23ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:38.568624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50d63b-66e5-4b21-8231-3fcf931a23ba admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:38.568909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50d63b-66e5-4b21-8231-3fcf931a23ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:38.569183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50d63b-66e5-4b21-8231-3fcf931a23ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:38.570016 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50d63b-66e5-4b21-8231-3fcf931a23ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:38.571774 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50d63b-66e5-4b21-8231-3fcf931a23ba admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:38.586207 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1068/2113] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:38.587829 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2b62e-8dff-49d7-b251-0d1642a80e2f service cinder] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:38.609687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2b62e-8dff-49d7-b251-0d1642a80e2f service cinder] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:38.614828 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df0cfd-d0cc-4f53-8fd3-330f8f7c8a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:38.615538 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df0cfd-d0cc-4f53-8fd3-330f8f7c8a55 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:38.615860 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df0cfd-d0cc-4f53-8fd3-330f8f7c8a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:38.616087 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df0cfd-d0cc-4f53-8fd3-330f8f7c8a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:38.618105 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df0cfd-d0cc-4f53-8fd3-330f8f7c8a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:38.618527 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df0cfd-d0cc-4f53-8fd3-330f8f7c8a55 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:38.629113 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1046/2114] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:18:38.641229 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50d63b-66e5-4b21-8231-3fcf931a23ba admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:38.652953 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50d63b-66e5-4b21-8231-3fcf931a23ba admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:38.657709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3aaaf-9753-4723-8e03-c6af40d0783c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:38.658636 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3aaaf-9753-4723-8e03-c6af40d0783c admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:38.658919 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3aaaf-9753-4723-8e03-c6af40d0783c admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:38.659198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3aaaf-9753-4723-8e03-c6af40d0783c admin admin] PATH_INFO: `/v3/projects/dfb63660feb942a3ba917a389f7a2b3f/users/4b2049d18bab4b0794d47cea6c7bf323/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:38.675458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3aaaf-9753-4723-8e03-c6af40d0783c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfb63660feb942a3ba917a389f7a2b3f, user_id=4b2049d18bab4b0794d47cea6c7bf323, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:38.678093 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3aaaf-9753-4723-8e03-c6af40d0783c admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:38.694661 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1069/2115] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:38 2022] PUT /identity/v3/projects/dfb63660feb942a3ba917a389f7a2b3f/users/4b2049d18bab4b0794d47cea6c7bf323/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:18:38.699829 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0491de-4f7f-4296-8988-e0e4a6f4002f None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:38.700123 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0491de-4f7f-4296-8988-e0e4a6f4002f None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:38.700406 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0491de-4f7f-4296-8988-e0e4a6f4002f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:38.718427 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-ba0491de-4f7f-4296-8988-e0e4a6f4002f None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:38.719667 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-ba0491de-4f7f-4296-8988-e0e4a6f4002f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:38.775327 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:38.785116 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1047/2116] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:38.794900 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3aaaf-9753-4723-8e03-c6af40d0783c admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:38.796657 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a3c3aaaf-9753-4723-8e03-c6af40d0783c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:38.857763 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3aaaf-9753-4723-8e03-c6af40d0783c admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:38.861784 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6bea1-cb16-443a-b645-fcc0ea9bb2ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:38.862690 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6bea1-cb16-443a-b645-fcc0ea9bb2ab service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:38.863015 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6bea1-cb16-443a-b645-fcc0ea9bb2ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:38.863268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6bea1-cb16-443a-b645-fcc0ea9bb2ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:38.874091 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6bea1-cb16-443a-b645-fcc0ea9bb2ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:38.875920 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6bea1-cb16-443a-b645-fcc0ea9bb2ab service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:38.887425 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1070/2117] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:39.174530 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0491de-4f7f-4296-8988-e0e4a6f4002f None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:39.186846 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0491de-4f7f-4296-8988-e0e4a6f4002f None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:39.192986 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65747365-9734-4cc8-8be4-46a7ad9c6273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:39.193966 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65747365-9734-4cc8-8be4-46a7ad9c6273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:39.194327 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65747365-9734-4cc8-8be4-46a7ad9c6273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:39.194619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65747365-9734-4cc8-8be4-46a7ad9c6273 admin admin] PATH_INFO: `/v3/users/f9d88069de2f40d788134f74860d6d5f` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:39.196039 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65747365-9734-4cc8-8be4-46a7ad9c6273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9d88069de2f40d788134f74860d6d5f)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:39.199599 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65747365-9734-4cc8-8be4-46a7ad9c6273 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:39.267378 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-65747365-9734-4cc8-8be4-46a7ad9c6273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9d88069de2f40d788134f74860d6d5f'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:39.268087 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-65747365-9734-4cc8-8be4-46a7ad9c6273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9d88069de2f40d788134f74860d6d5f'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:39.279335 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-65747365-9734-4cc8-8be4-46a7ad9c6273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9d88069de2f40d788134f74860d6d5f'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:39.297491 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-65747365-9734-4cc8-8be4-46a7ad9c6273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9d88069de2f40d788134f74860d6d5f'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:39.312617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-65747365-9734-4cc8-8be4-46a7ad9c6273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9d88069de2f40d788134f74860d6d5f'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:39.319318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1048/2118] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:39 2022] DELETE /identity/v3/users/f9d88069de2f40d788134f74860d6d5f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:39.324497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a231792-7e99-45ab-b400-66b6069d8f37 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:39.324999 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a231792-7e99-45ab-b400-66b6069d8f37 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:39.325110 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a231792-7e99-45ab-b400-66b6069d8f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:39.342732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-5a231792-7e99-45ab-b400-66b6069d8f37 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:39.344047 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-5a231792-7e99-45ab-b400-66b6069d8f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:39.422247 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1071/2119] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:39.432265 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65747365-9734-4cc8-8be4-46a7ad9c6273 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:39.434369 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-65747365-9734-4cc8-8be4-46a7ad9c6273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:39.508055 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65747365-9734-4cc8-8be4-46a7ad9c6273 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:39.512965 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3151d-c59e-4a27-beae-9442d40f28e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:39.513648 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3151d-c59e-4a27-beae-9442d40f28e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:39.513936 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3151d-c59e-4a27-beae-9442d40f28e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:39.514252 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3151d-c59e-4a27-beae-9442d40f28e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:39.524870 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3151d-c59e-4a27-beae-9442d40f28e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:39.526447 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3151d-c59e-4a27-beae-9442d40f28e7 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:39.538212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1049/2120] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:39.728246 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a231792-7e99-45ab-b400-66b6069d8f37 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:39.732831 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-5a231792-7e99-45ab-b400-66b6069d8f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:39.842681 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a231792-7e99-45ab-b400-66b6069d8f37 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:39.848135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06fb99-8300-4fe1-add1-f8ec976a58ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:39.849045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06fb99-8300-4fe1-add1-f8ec976a58ce service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:39.849446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06fb99-8300-4fe1-add1-f8ec976a58ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:39.849911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06fb99-8300-4fe1-add1-f8ec976a58ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:39.852969 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-9b06fb99-8300-4fe1-add1-f8ec976a58ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:39.862075 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:39.967620 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06fb99-8300-4fe1-add1-f8ec976a58ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:39.978710 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06fb99-8300-4fe1-add1-f8ec976a58ce service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:39.993623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1072/2121] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:40.017324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3151d-c59e-4a27-beae-9442d40f28e7 service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:40.018836 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-d3f3151d-c59e-4a27-beae-9442d40f28e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:40.052671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3151d-c59e-4a27-beae-9442d40f28e7 service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:40.058900 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b944106-f327-4dc7-98d1-513ef7d44c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:40.059843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b944106-f327-4dc7-98d1-513ef7d44c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:40.060121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b944106-f327-4dc7-98d1-513ef7d44c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:40.060401 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b944106-f327-4dc7-98d1-513ef7d44c91 admin admin] PATH_INFO: `/v3/projects/1ec2b8f22d4246d59bae505a54875a06` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:40.061815 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b944106-f327-4dc7-98d1-513ef7d44c91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ec2b8f22d4246d59bae505a54875a06)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:40.064136 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b944106-f327-4dc7-98d1-513ef7d44c91 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:40.133089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-6b944106-f327-4dc7-98d1-513ef7d44c91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ec2b8f22d4246d59bae505a54875a06', 'request_id': 'req-6b944106-f327-4dc7-98d1-513ef7d44c91'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:40.142020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-6b944106-f327-4dc7-98d1-513ef7d44c91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ec2b8f22d4246d59bae505a54875a06', 'request_id': 'req-6b944106-f327-4dc7-98d1-513ef7d44c91'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:40.155954 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-6b944106-f327-4dc7-98d1-513ef7d44c91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ec2b8f22d4246d59bae505a54875a06', 'request_id': 'req-6b944106-f327-4dc7-98d1-513ef7d44c91'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:40.169647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:40.193020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-6b944106-f327-4dc7-98d1-513ef7d44c91 admin admin] The token cache is being invalidate because project 1ec2b8f22d4246d59bae505a54875a06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:40.193682 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-6b944106-f327-4dc7-98d1-513ef7d44c91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:40.194541 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-6b944106-f327-4dc7-98d1-513ef7d44c91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:40.197774 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1050/2122] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:40 2022] DELETE /identity/v3/projects/1ec2b8f22d4246d59bae505a54875a06 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:40.206152 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06fb99-8300-4fe1-add1-f8ec976a58ce service cinder] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:40.224949 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06fb99-8300-4fe1-add1-f8ec976a58ce service cinder] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:40.385845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0155c6d-a3c6-4666-9f24-bc4b329dcfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:40.387788 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0155c6d-a3c6-4666-9f24-bc4b329dcfc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:40.388270 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0155c6d-a3c6-4666-9f24-bc4b329dcfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:40.389194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0155c6d-a3c6-4666-9f24-bc4b329dcfc6 admin admin] PATH_INFO: `/v3/users/e5efa599f08f4bf6924dde74ca7464e2` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:40.392882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0155c6d-a3c6-4666-9f24-bc4b329dcfc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5efa599f08f4bf6924dde74ca7464e2)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:40.396097 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0155c6d-a3c6-4666-9f24-bc4b329dcfc6 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:40.503311 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-a0155c6d-a3c6-4666-9f24-bc4b329dcfc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5efa599f08f4bf6924dde74ca7464e2'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:40.526706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-a0155c6d-a3c6-4666-9f24-bc4b329dcfc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5efa599f08f4bf6924dde74ca7464e2'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:40.542410 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-a0155c6d-a3c6-4666-9f24-bc4b329dcfc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5efa599f08f4bf6924dde74ca7464e2'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:40.544641 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-a0155c6d-a3c6-4666-9f24-bc4b329dcfc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5efa599f08f4bf6924dde74ca7464e2'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:40.588531 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-a0155c6d-a3c6-4666-9f24-bc4b329dcfc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5efa599f08f4bf6924dde74ca7464e2'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:40.596743 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1073/2123] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:40 2022] DELETE /identity/v3/users/e5efa599f08f4bf6924dde74ca7464e2 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:41.711858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b944106-f327-4dc7-98d1-513ef7d44c91 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:41.715566 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-6b944106-f327-4dc7-98d1-513ef7d44c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:41.744067 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b944106-f327-4dc7-98d1-513ef7d44c91 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:41.920260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d789a6-7f6f-47fa-b659-a7227ba28569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:41.921201 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d789a6-7f6f-47fa-b659-a7227ba28569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:41.921637 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d789a6-7f6f-47fa-b659-a7227ba28569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:41.922371 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d789a6-7f6f-47fa-b659-a7227ba28569 admin admin] PATH_INFO: `/v3/projects/078694ba526446dbaf7d1a5b8b34d9ea` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:41.927722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d789a6-7f6f-47fa-b659-a7227ba28569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=078694ba526446dbaf7d1a5b8b34d9ea)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:41.932212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d789a6-7f6f-47fa-b659-a7227ba28569 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:42.037688 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-24d789a6-7f6f-47fa-b659-a7227ba28569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '078694ba526446dbaf7d1a5b8b34d9ea', 'request_id': 'req-24d789a6-7f6f-47fa-b659-a7227ba28569'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:42.047653 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-24d789a6-7f6f-47fa-b659-a7227ba28569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '078694ba526446dbaf7d1a5b8b34d9ea', 'request_id': 'req-24d789a6-7f6f-47fa-b659-a7227ba28569'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:42.074746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-24d789a6-7f6f-47fa-b659-a7227ba28569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '078694ba526446dbaf7d1a5b8b34d9ea', 'request_id': 'req-24d789a6-7f6f-47fa-b659-a7227ba28569'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:42.092088 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-24d789a6-7f6f-47fa-b659-a7227ba28569 admin admin] The token cache is being invalidate because project 078694ba526446dbaf7d1a5b8b34d9ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:42.092595 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-24d789a6-7f6f-47fa-b659-a7227ba28569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:42.093432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-24d789a6-7f6f-47fa-b659-a7227ba28569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:42.095560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1051/2124] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:41 2022] DELETE /identity/v3/projects/078694ba526446dbaf7d1a5b8b34d9ea => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:42.100704 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95b50f-fc1d-47aa-a2ee-951089344ede None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:42.101667 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95b50f-fc1d-47aa-a2ee-951089344ede None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:42.102162 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95b50f-fc1d-47aa-a2ee-951089344ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:42.157733 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-3d95b50f-fc1d-47aa-a2ee-951089344ede None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:42.163509 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-3d95b50f-fc1d-47aa-a2ee-951089344ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:42.214599 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:42.294741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1074/2125] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:42.305217 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7609c48-c14c-43b7-bd85-d402a1c75497 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:42.305564 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7609c48-c14c-43b7-bd85-d402a1c75497 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:42.306662 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7609c48-c14c-43b7-bd85-d402a1c75497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:42.346383 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-b7609c48-c14c-43b7-bd85-d402a1c75497 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:42.347842 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-b7609c48-c14c-43b7-bd85-d402a1c75497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:42.360069 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1052/2126] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:42.364423 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95b50f-fc1d-47aa-a2ee-951089344ede None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:42.379973 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95b50f-fc1d-47aa-a2ee-951089344ede None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:42.386142 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e22137-4f50-47ab-aa41-1f4d846fe73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:42.387346 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e22137-4f50-47ab-aa41-1f4d846fe73d admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:42.387346 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e22137-4f50-47ab-aa41-1f4d846fe73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:42.387510 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e22137-4f50-47ab-aa41-1f4d846fe73d admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:42.388200 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e22137-4f50-47ab-aa41-1f4d846fe73d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:18:42.388513 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e22137-4f50-47ab-aa41-1f4d846fe73d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:42.390255 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e22137-4f50-47ab-aa41-1f4d846fe73d admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:42.403694 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1075/2127] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:18:42.408621 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7609c48-c14c-43b7-bd85-d402a1c75497 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:42.421246 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7609c48-c14c-43b7-bd85-d402a1c75497 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:42.430463 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b244ade-6914-41ba-bb58-563f6f29d215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:42.430463 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b244ade-6914-41ba-bb58-563f6f29d215 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:42.430463 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b244ade-6914-41ba-bb58-563f6f29d215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:42.430822 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b244ade-6914-41ba-bb58-563f6f29d215 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:42.431871 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b244ade-6914-41ba-bb58-563f6f29d215 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:42.435826 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b244ade-6914-41ba-bb58-563f6f29d215 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:42.478162 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1053/2128] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:42 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:42.480580 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e22137-4f50-47ab-aa41-1f4d846fe73d admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:42.505447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e22137-4f50-47ab-aa41-1f4d846fe73d admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:42.615535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c55e59-67de-462d-a096-fa796a38e87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:42.616248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c55e59-67de-462d-a096-fa796a38e87d admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:42.616684 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c55e59-67de-462d-a096-fa796a38e87d admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:42.618454 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c55e59-67de-462d-a096-fa796a38e87d admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:42.619183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c55e59-67de-462d-a096-fa796a38e87d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:42.622720 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c55e59-67de-462d-a096-fa796a38e87d admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:42.660046 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1076/2129] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:42 2022] POST /identity/v3/users => generated 288 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:42.664595 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b244ade-6914-41ba-bb58-563f6f29d215 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:42.696806 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b244ade-6914-41ba-bb58-563f6f29d215 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:42.703283 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154d37a-422a-4089-a6c2-8c131ad67961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:42.703966 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154d37a-422a-4089-a6c2-8c131ad67961 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:42.704253 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154d37a-422a-4089-a6c2-8c131ad67961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:42.706745 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154d37a-422a-4089-a6c2-8c131ad67961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:42.707630 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d154d37a-422a-4089-a6c2-8c131ad67961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:42.709282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d154d37a-422a-4089-a6c2-8c131ad67961 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:42.734197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1054/2130] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:18:42.737229 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c55e59-67de-462d-a096-fa796a38e87d admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:42.750686 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c55e59-67de-462d-a096-fa796a38e87d admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:42.761458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469517aa-a65b-453e-95b2-4c9dc4a59d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:42.761949 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469517aa-a65b-453e-95b2-4c9dc4a59d6c admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:42.762284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469517aa-a65b-453e-95b2-4c9dc4a59d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:42.762599 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469517aa-a65b-453e-95b2-4c9dc4a59d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:42.763346 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469517aa-a65b-453e-95b2-4c9dc4a59d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:42.765038 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469517aa-a65b-453e-95b2-4c9dc4a59d6c admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:42.787398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154d37a-422a-4089-a6c2-8c131ad67961 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:42.795537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1077/2131] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:42.800890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154d37a-422a-4089-a6c2-8c131ad67961 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:42.806614 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d25e40-c7d4-4140-a161-a4054fabd60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:42.808086 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d25e40-c7d4-4140-a161-a4054fabd60c admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:42.808376 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d25e40-c7d4-4140-a161-a4054fabd60c admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:42.808660 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d25e40-c7d4-4140-a161-a4054fabd60c admin admin] PATH_INFO: `/v3/projects/65af9b50a76543b6addfbda14436dab4/users/ad435bad8f434c15bee12647651c4ada/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:42.836845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d25e40-c7d4-4140-a161-a4054fabd60c admin admin] RBAC: Authorizing `identity:create_grant(project_id=65af9b50a76543b6addfbda14436dab4, user_id=ad435bad8f434c15bee12647651c4ada, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:42.840541 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d25e40-c7d4-4140-a161-a4054fabd60c admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:42.863664 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1055/2132] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:42 2022] PUT /identity/v3/projects/65af9b50a76543b6addfbda14436dab4/users/ad435bad8f434c15bee12647651c4ada/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:42.876662 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689056a-10f6-4c58-bf4a-e9315b02b6ad None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:42.878246 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689056a-10f6-4c58-bf4a-e9315b02b6ad None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:42.878246 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689056a-10f6-4c58-bf4a-e9315b02b6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:42.910271 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-9689056a-10f6-4c58-bf4a-e9315b02b6ad None None] MFA Rules not processed for user `ad435bad8f434c15bee12647651c4ada`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:42.912200 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-9689056a-10f6-4c58-bf4a-e9315b02b6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:42.998884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1078/2133] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:43.004932 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d25e40-c7d4-4140-a161-a4054fabd60c admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:43.086921 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:43.203418 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d25e40-c7d4-4140-a161-a4054fabd60c admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:43.209876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47943fc3-9b17-4346-96e7-31a7998601f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:43.211534 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47943fc3-9b17-4346-96e7-31a7998601f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:43.212017 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47943fc3-9b17-4346-96e7-31a7998601f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:43.212489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47943fc3-9b17-4346-96e7-31a7998601f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:43.213392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47943fc3-9b17-4346-96e7-31a7998601f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:43.216016 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47943fc3-9b17-4346-96e7-31a7998601f0 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:43.271262 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1056/2134] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:43 2022] POST /identity/v3/projects => generated 375 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:43.275077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689056a-10f6-4c58-bf4a-e9315b02b6ad None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:43.286932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689056a-10f6-4c58-bf4a-e9315b02b6ad None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:43.306538 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:43.393443 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bc63e-ddfb-4143-8ea3-d46edefae2f5 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:43.393940 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bc63e-ddfb-4143-8ea3-d46edefae2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:43.394319 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bc63e-ddfb-4143-8ea3-d46edefae2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:43.404242 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438463f-e82b-4e55-a2b3-ce28b3d6df43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:43.405187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438463f-e82b-4e55-a2b3-ce28b3d6df43 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:43.405467 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438463f-e82b-4e55-a2b3-ce28b3d6df43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:43.405753 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438463f-e82b-4e55-a2b3-ce28b3d6df43 admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:43.406503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438463f-e82b-4e55-a2b3-ce28b3d6df43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:43.409912 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438463f-e82b-4e55-a2b3-ce28b3d6df43 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:43.422057 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-9e6bc63e-ddfb-4143-8ea3-d46edefae2f5 None None] MFA Rules not processed for user `e427cded71b24920b908dc09fb75d5ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:43.423705 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-9e6bc63e-ddfb-4143-8ea3-d46edefae2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:43.451465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1079/2135] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:43 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:43.456631 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438463f-e82b-4e55-a2b3-ce28b3d6df43 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:43.480198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438463f-e82b-4e55-a2b3-ce28b3d6df43 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:43.502959 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d83e74-6445-4492-a1b7-97dc1bc29b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:43.503955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d83e74-6445-4492-a1b7-97dc1bc29b8f admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:43.504436 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d83e74-6445-4492-a1b7-97dc1bc29b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:43.506902 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d83e74-6445-4492-a1b7-97dc1bc29b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:43.515663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d83e74-6445-4492-a1b7-97dc1bc29b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:43.524484 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d83e74-6445-4492-a1b7-97dc1bc29b8f admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:43.552378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1080/2136] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:43.558903 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d83e74-6445-4492-a1b7-97dc1bc29b8f admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:43.574622 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1057/2137] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:43.576096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d83e74-6445-4492-a1b7-97dc1bc29b8f admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:43.597809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce255a1-4db8-4145-aa41-8487a454f9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:43.599091 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce255a1-4db8-4145-aa41-8487a454f9b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:43.599504 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce255a1-4db8-4145-aa41-8487a454f9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:43.599792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce255a1-4db8-4145-aa41-8487a454f9b6 admin admin] PATH_INFO: `/v3/projects/ffe24b4b098e4c9a86baa60ff9ac5c67/users/362f7683fbae4987a92c59d1801e9834/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:43.643994 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce255a1-4db8-4145-aa41-8487a454f9b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe24b4b098e4c9a86baa60ff9ac5c67, user_id=362f7683fbae4987a92c59d1801e9834, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:43.646959 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce255a1-4db8-4145-aa41-8487a454f9b6 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:43.668796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1081/2138] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:43 2022] PUT /identity/v3/projects/ffe24b4b098e4c9a86baa60ff9ac5c67/users/362f7683fbae4987a92c59d1801e9834/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:43.672820 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bc63e-ddfb-4143-8ea3-d46edefae2f5 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:43.702381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bc63e-ddfb-4143-8ea3-d46edefae2f5 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:43.837738 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be64e66-d0eb-4c06-ac4a-a7c21310485b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:43.839811 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be64e66-d0eb-4c06-ac4a-a7c21310485b admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:43.840266 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be64e66-d0eb-4c06-ac4a-a7c21310485b admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:43.840712 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be64e66-d0eb-4c06-ac4a-a7c21310485b admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:43.842770 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be64e66-d0eb-4c06-ac4a-a7c21310485b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:43.845434 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be64e66-d0eb-4c06-ac4a-a7c21310485b admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:43.868377 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1058/2139] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:43.869291 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce255a1-4db8-4145-aa41-8487a454f9b6 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:43.889627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce255a1-4db8-4145-aa41-8487a454f9b6 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:43.898461 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab381eb-013a-42f7-b88e-d54fe816e518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:43.900155 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab381eb-013a-42f7-b88e-d54fe816e518 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:43.901636 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab381eb-013a-42f7-b88e-d54fe816e518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:43.902154 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab381eb-013a-42f7-b88e-d54fe816e518 admin admin] PATH_INFO: `/v3/projects/ffe24b4b098e4c9a86baa60ff9ac5c67/users/362f7683fbae4987a92c59d1801e9834/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:43.908712 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab381eb-013a-42f7-b88e-d54fe816e518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe24b4b098e4c9a86baa60ff9ac5c67, user_id=362f7683fbae4987a92c59d1801e9834, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:43.912069 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab381eb-013a-42f7-b88e-d54fe816e518 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:43.937490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1082/2140] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:43 2022] PUT /identity/v3/projects/ffe24b4b098e4c9a86baa60ff9ac5c67/users/362f7683fbae4987a92c59d1801e9834/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:43.939613 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063941a-b47c-449a-9c24-a9f3248b059c None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:43.939977 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063941a-b47c-449a-9c24-a9f3248b059c None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:43.940498 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063941a-b47c-449a-9c24-a9f3248b059c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:43.992454 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-e063941a-b47c-449a-9c24-a9f3248b059c None None] MFA Rules not processed for user `362f7683fbae4987a92c59d1801e9834`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:43.994456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-e063941a-b47c-449a-9c24-a9f3248b059c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:44.070478 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:44.125753 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1059/2141] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:43 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:44.139375 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab381eb-013a-42f7-b88e-d54fe816e518 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:44.142020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-bab381eb-013a-42f7-b88e-d54fe816e518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:44.237578 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab381eb-013a-42f7-b88e-d54fe816e518 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:44.241843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5ce1c-0fd8-42e3-9f10-633ecf8905d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:44.242563 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5ce1c-0fd8-42e3-9f10-633ecf8905d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:44.242954 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5ce1c-0fd8-42e3-9f10-633ecf8905d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:44.243261 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5ce1c-0fd8-42e3-9f10-633ecf8905d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:44.447218 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5ce1c-0fd8-42e3-9f10-633ecf8905d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:44.449756 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5ce1c-0fd8-42e3-9f10-633ecf8905d2 service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:44.487204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1083/2142] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:44.857929 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18bd3e-f21a-47d0-938d-be56ae9b5bd7 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:44.858567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18bd3e-f21a-47d0-938d-be56ae9b5bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:44.858567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18bd3e-f21a-47d0-938d-be56ae9b5bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:44.919449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-df18bd3e-f21a-47d0-938d-be56ae9b5bd7 None None] MFA Rules not processed for user `4b2049d18bab4b0794d47cea6c7bf323`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:44.921358 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-df18bd3e-f21a-47d0-938d-be56ae9b5bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:45.110997 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1060/2143] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:18:45.126866 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5ce1c-0fd8-42e3-9f10-633ecf8905d2 service cinder] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:45.129608 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-04b5ce1c-0fd8-42e3-9f10-633ecf8905d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:45.150068 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:45.284311 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5ce1c-0fd8-42e3-9f10-633ecf8905d2 service cinder] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:45.294954 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93945f2-6207-4796-aaf9-440080cc8b76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:45.296304 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93945f2-6207-4796-aaf9-440080cc8b76 service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:45.296304 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93945f2-6207-4796-aaf9-440080cc8b76 service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:45.296304 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93945f2-6207-4796-aaf9-440080cc8b76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:45.310056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93945f2-6207-4796-aaf9-440080cc8b76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:45.313782 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93945f2-6207-4796-aaf9-440080cc8b76 service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:45.330802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1084/2144] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:45.553465 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18bd3e-f21a-47d0-938d-be56ae9b5bd7 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:45.555856 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-df18bd3e-f21a-47d0-938d-be56ae9b5bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:45.746442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18bd3e-f21a-47d0-938d-be56ae9b5bd7 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:45.756502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bbbb4-387b-4acf-83b5-d07e9337e4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:45.758065 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bbbb4-387b-4acf-83b5-d07e9337e4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:45.758457 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bbbb4-387b-4acf-83b5-d07e9337e4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:45.758802 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bbbb4-387b-4acf-83b5-d07e9337e4fd admin admin] PATH_INFO: `/v3/users/7a6e943aa2f74c76b55fabd46efef40e` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:45.760133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bbbb4-387b-4acf-83b5-d07e9337e4fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a6e943aa2f74c76b55fabd46efef40e)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:45.762565 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bbbb4-387b-4acf-83b5-d07e9337e4fd admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:45.829829 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-860bbbb4-387b-4acf-83b5-d07e9337e4fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a6e943aa2f74c76b55fabd46efef40e'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:45.830517 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-860bbbb4-387b-4acf-83b5-d07e9337e4fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a6e943aa2f74c76b55fabd46efef40e'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:45.843745 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-860bbbb4-387b-4acf-83b5-d07e9337e4fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a6e943aa2f74c76b55fabd46efef40e'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:45.863491 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-860bbbb4-387b-4acf-83b5-d07e9337e4fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a6e943aa2f74c76b55fabd46efef40e'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:45.878052 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:45.890915 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-860bbbb4-387b-4acf-83b5-d07e9337e4fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a6e943aa2f74c76b55fabd46efef40e'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:45.897964 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1061/2145] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:45 2022] DELETE /identity/v3/users/7a6e943aa2f74c76b55fabd46efef40e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:45.907553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc714e5-23ce-497f-aad3-cd60a3ee1053 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:45.908232 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc714e5-23ce-497f-aad3-cd60a3ee1053 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:45.908582 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc714e5-23ce-497f-aad3-cd60a3ee1053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:45.943261 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-8bc714e5-23ce-497f-aad3-cd60a3ee1053 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:45.944980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-8bc714e5-23ce-497f-aad3-cd60a3ee1053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:46.020284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1085/2146] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:18:46.033746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bbbb4-387b-4acf-83b5-d07e9337e4fd admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:46.038082 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-860bbbb4-387b-4acf-83b5-d07e9337e4fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:46.168372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bbbb4-387b-4acf-83b5-d07e9337e4fd admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:46.172252 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3f032-4f9d-4e4c-869a-015fa966882c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:46.173007 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3f032-4f9d-4e4c-869a-015fa966882c service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:46.173357 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3f032-4f9d-4e4c-869a-015fa966882c service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:46.173707 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3f032-4f9d-4e4c-869a-015fa966882c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:46.191602 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3f032-4f9d-4e4c-869a-015fa966882c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:46.193960 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3f032-4f9d-4e4c-869a-015fa966882c service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:46.224112 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1062/2147] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:46.828566 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc714e5-23ce-497f-aad3-cd60a3ee1053 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:46.830217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-8bc714e5-23ce-497f-aad3-cd60a3ee1053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:46.848649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc714e5-23ce-497f-aad3-cd60a3ee1053 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:46.853499 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff650a9f-65c8-4074-9d60-71cf2cbeb0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:46.855077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff650a9f-65c8-4074-9d60-71cf2cbeb0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:46.855552 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff650a9f-65c8-4074-9d60-71cf2cbeb0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:46.855990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff650a9f-65c8-4074-9d60-71cf2cbeb0ed admin admin] PATH_INFO: `/v3/projects/f889e67bb469430ca951ad24249d73e9` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:46.859061 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff650a9f-65c8-4074-9d60-71cf2cbeb0ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=f889e67bb469430ca951ad24249d73e9)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:46.861382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff650a9f-65c8-4074-9d60-71cf2cbeb0ed admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:46.927068 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-ff650a9f-65c8-4074-9d60-71cf2cbeb0ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f889e67bb469430ca951ad24249d73e9', 'request_id': 'req-ff650a9f-65c8-4074-9d60-71cf2cbeb0ed'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:46.934557 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-ff650a9f-65c8-4074-9d60-71cf2cbeb0ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f889e67bb469430ca951ad24249d73e9', 'request_id': 'req-ff650a9f-65c8-4074-9d60-71cf2cbeb0ed'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:46.944132 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-ff650a9f-65c8-4074-9d60-71cf2cbeb0ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f889e67bb469430ca951ad24249d73e9', 'request_id': 'req-ff650a9f-65c8-4074-9d60-71cf2cbeb0ed'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:46.975369 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-ff650a9f-65c8-4074-9d60-71cf2cbeb0ed admin admin] The token cache is being invalidate because project f889e67bb469430ca951ad24249d73e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:46.975900 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-ff650a9f-65c8-4074-9d60-71cf2cbeb0ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:46.977136 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-ff650a9f-65c8-4074-9d60-71cf2cbeb0ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:46.980619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1086/2148] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:46 2022] DELETE /identity/v3/projects/f889e67bb469430ca951ad24249d73e9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:46.984363 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3f032-4f9d-4e4c-869a-015fa966882c service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:46.994667 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3f032-4f9d-4e4c-869a-015fa966882c service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:47.070758 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b949c24-9003-446b-9c38-c23c98045cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:47.071675 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b949c24-9003-446b-9c38-c23c98045cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:47.071958 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b949c24-9003-446b-9c38-c23c98045cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:47.072242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b949c24-9003-446b-9c38-c23c98045cff admin admin] PATH_INFO: `/v3/users/28e381bb09e04b448eb7adc4227031c7` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:47.074309 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b949c24-9003-446b-9c38-c23c98045cff admin admin] RBAC: Authorizing `identity:delete_user(user_id=28e381bb09e04b448eb7adc4227031c7)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:47.076344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b949c24-9003-446b-9c38-c23c98045cff admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:47.134937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-8b949c24-9003-446b-9c38-c23c98045cff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28e381bb09e04b448eb7adc4227031c7'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:47.138660 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-8b949c24-9003-446b-9c38-c23c98045cff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28e381bb09e04b448eb7adc4227031c7'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:47.152986 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-8b949c24-9003-446b-9c38-c23c98045cff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28e381bb09e04b448eb7adc4227031c7'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:47.164907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-8b949c24-9003-446b-9c38-c23c98045cff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28e381bb09e04b448eb7adc4227031c7'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:47.182440 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-8b949c24-9003-446b-9c38-c23c98045cff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28e381bb09e04b448eb7adc4227031c7'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:47.190251 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1063/2149] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:46 2022] DELETE /identity/v3/users/28e381bb09e04b448eb7adc4227031c7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:18:47.448059 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff650a9f-65c8-4074-9d60-71cf2cbeb0ed admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:47.449703 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-ff650a9f-65c8-4074-9d60-71cf2cbeb0ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:47.469554 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff650a9f-65c8-4074-9d60-71cf2cbeb0ed admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:47.502694 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:47.558292 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d1aa0-6807-4938-8ba3-149b97080cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:47.558998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d1aa0-6807-4938-8ba3-149b97080cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:47.559296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d1aa0-6807-4938-8ba3-149b97080cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:47.559587 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d1aa0-6807-4938-8ba3-149b97080cb1 admin admin] PATH_INFO: `/v3/users/ad435bad8f434c15bee12647651c4ada` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:47.560954 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d1aa0-6807-4938-8ba3-149b97080cb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad435bad8f434c15bee12647651c4ada)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:47.563331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d1aa0-6807-4938-8ba3-149b97080cb1 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:47.674745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-447d1aa0-6807-4938-8ba3-149b97080cb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad435bad8f434c15bee12647651c4ada'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:47.698044 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-447d1aa0-6807-4938-8ba3-149b97080cb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad435bad8f434c15bee12647651c4ada'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:47.706741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-447d1aa0-6807-4938-8ba3-149b97080cb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad435bad8f434c15bee12647651c4ada'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:47.707502 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-447d1aa0-6807-4938-8ba3-149b97080cb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad435bad8f434c15bee12647651c4ada'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:47.724056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-447d1aa0-6807-4938-8ba3-149b97080cb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad435bad8f434c15bee12647651c4ada'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:47.732719 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1087/2150] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:47 2022] DELETE /identity/v3/users/ad435bad8f434c15bee12647651c4ada => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:47.737353 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdbac4-b205-4361-af9f-a15271e5849a None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:47.738079 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdbac4-b205-4361-af9f-a15271e5849a None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:47.738079 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdbac4-b205-4361-af9f-a15271e5849a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:47.770349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:47.782167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-d0bdbac4-b205-4361-af9f-a15271e5849a None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:47.788144 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-d0bdbac4-b205-4361-af9f-a15271e5849a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:47.944742 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1064/2151] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:47.956656 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d1aa0-6807-4938-8ba3-149b97080cb1 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:47.958341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-447d1aa0-6807-4938-8ba3-149b97080cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:48.039355 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d1aa0-6807-4938-8ba3-149b97080cb1 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:48.045674 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9699e-c275-4161-901f-58f9883805b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:48.047150 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9699e-c275-4161-901f-58f9883805b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:48.047988 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9699e-c275-4161-901f-58f9883805b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:48.048762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9699e-c275-4161-901f-58f9883805b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:48.064052 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9699e-c275-4161-901f-58f9883805b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:48.066552 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9699e-c275-4161-901f-58f9883805b5 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:48.083047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdbac4-b205-4361-af9f-a15271e5849a None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:48.084572 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-d0bdbac4-b205-4361-af9f-a15271e5849a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:48.097430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdbac4-b205-4361-af9f-a15271e5849a None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:48.101063 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1088/2152] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:48.106805 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66802aa6-1608-4823-b324-7e55cc7d9c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:48.107916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66802aa6-1608-4823-b324-7e55cc7d9c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:48.108259 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66802aa6-1608-4823-b324-7e55cc7d9c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:48.108553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66802aa6-1608-4823-b324-7e55cc7d9c03 admin admin] PATH_INFO: `/v3/projects/7b707e29c8e64cb8a483e112b0175445` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:48.109828 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66802aa6-1608-4823-b324-7e55cc7d9c03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b707e29c8e64cb8a483e112b0175445)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:48.114195 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66802aa6-1608-4823-b324-7e55cc7d9c03 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:48.201791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-66802aa6-1608-4823-b324-7e55cc7d9c03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b707e29c8e64cb8a483e112b0175445', 'request_id': 'req-66802aa6-1608-4823-b324-7e55cc7d9c03'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:48.227525 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-66802aa6-1608-4823-b324-7e55cc7d9c03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b707e29c8e64cb8a483e112b0175445', 'request_id': 'req-66802aa6-1608-4823-b324-7e55cc7d9c03'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:48.241499 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7a2d6-db46-4315-8706-b6b029bab8c8 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:48.241800 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7a2d6-db46-4315-8706-b6b029bab8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:48.242092 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7a2d6-db46-4315-8706-b6b029bab8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:48.267598 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-66802aa6-1608-4823-b324-7e55cc7d9c03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b707e29c8e64cb8a483e112b0175445', 'request_id': 'req-66802aa6-1608-4823-b324-7e55cc7d9c03'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:48.272346 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-bbd7a2d6-db46-4315-8706-b6b029bab8c8 None None] MFA Rules not processed for user `4b2049d18bab4b0794d47cea6c7bf323`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:48.277441 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-bbd7a2d6-db46-4315-8706-b6b029bab8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:48.293769 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-66802aa6-1608-4823-b324-7e55cc7d9c03 admin admin] The token cache is being invalidate because project 7b707e29c8e64cb8a483e112b0175445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:48.293980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-66802aa6-1608-4823-b324-7e55cc7d9c03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:48.295716 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-66802aa6-1608-4823-b324-7e55cc7d9c03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:48.305913 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1065/2153] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:48 2022] DELETE /identity/v3/projects/7b707e29c8e64cb8a483e112b0175445 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:18:48.307549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7c86f-0210-4f76-add5-6df1b11a4926 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:48.307847 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7c86f-0210-4f76-add5-6df1b11a4926 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:48.308134 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7c86f-0210-4f76-add5-6df1b11a4926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:48.346518 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-c7c7c86f-0210-4f76-add5-6df1b11a4926 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:48.347699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-c7c7c86f-0210-4f76-add5-6df1b11a4926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:48.369828 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:48.412346 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1089/2154] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:48.493516 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1066/2155] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:48.502698 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f458e-e26b-4cd2-b5bc-2a48740b9e8d None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:48.503260 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f458e-e26b-4cd2-b5bc-2a48740b9e8d None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:48.503775 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f458e-e26b-4cd2-b5bc-2a48740b9e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:48.537294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-8b6f458e-e26b-4cd2-b5bc-2a48740b9e8d None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:48.538815 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-8b6f458e-e26b-4cd2-b5bc-2a48740b9e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:48.552651 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7c86f-0210-4f76-add5-6df1b11a4926 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:48.559705 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1090/2156] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:48.564098 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7c86f-0210-4f76-add5-6df1b11a4926 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:48.570087 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a008f7-d99d-47e2-86f0-1008d48313b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:48.571055 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a008f7-d99d-47e2-86f0-1008d48313b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:48.571591 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a008f7-d99d-47e2-86f0-1008d48313b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:48.571950 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a008f7-d99d-47e2-86f0-1008d48313b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:48.573214 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a008f7-d99d-47e2-86f0-1008d48313b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:18:48.573846 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a008f7-d99d-47e2-86f0-1008d48313b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:48.575382 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a008f7-d99d-47e2-86f0-1008d48313b1 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:48.594865 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f458e-e26b-4cd2-b5bc-2a48740b9e8d None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:48.600937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1067/2157] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:18:48.605057 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f458e-e26b-4cd2-b5bc-2a48740b9e8d None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:48.610308 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86315bb-81a5-4d12-8845-1776d82cfa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:48.611007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86315bb-81a5-4d12-8845-1776d82cfa84 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:48.611675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86315bb-81a5-4d12-8845-1776d82cfa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:48.611675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86315bb-81a5-4d12-8845-1776d82cfa84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:48.612268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86315bb-81a5-4d12-8845-1776d82cfa84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:48.614342 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86315bb-81a5-4d12-8845-1776d82cfa84 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:48.676727 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a008f7-d99d-47e2-86f0-1008d48313b1 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:48.677816 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1091/2158] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:48 2022] POST /identity/v3/projects => generated 359 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:48.688808 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a008f7-d99d-47e2-86f0-1008d48313b1 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:48.723888 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:48.814478 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86315bb-81a5-4d12-8845-1776d82cfa84 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:48.821627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a86315bb-81a5-4d12-8845-1776d82cfa84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:48.846140 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0badb91-2ca8-4521-88ce-71adab009d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:48.846975 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0badb91-2ca8-4521-88ce-71adab009d8b admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:48.847340 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0badb91-2ca8-4521-88ce-71adab009d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:48.847697 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0badb91-2ca8-4521-88ce-71adab009d8b admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:48.848725 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0badb91-2ca8-4521-88ce-71adab009d8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:48.851807 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0badb91-2ca8-4521-88ce-71adab009d8b admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:48.915609 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1068/2159] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:48 2022] POST /identity/v3/users => generated 280 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:48.921107 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0badb91-2ca8-4521-88ce-71adab009d8b admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:48.956937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0badb91-2ca8-4521-88ce-71adab009d8b admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:48.982845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86315bb-81a5-4d12-8845-1776d82cfa84 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:48.987046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1783f26-baed-40a7-9c4d-8964c8774c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:48.987754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1783f26-baed-40a7-9c4d-8964c8774c7e admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:48.988043 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1783f26-baed-40a7-9c4d-8964c8774c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:48.988325 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1783f26-baed-40a7-9c4d-8964c8774c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:48.990443 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1783f26-baed-40a7-9c4d-8964c8774c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:48.997244 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f08f67-d076-4e08-805b-bb9523f60395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:48.997995 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f08f67-d076-4e08-805b-bb9523f60395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:48.998407 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f08f67-d076-4e08-805b-bb9523f60395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:48.998609 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f08f67-d076-4e08-805b-bb9523f60395 admin admin] PATH_INFO: `/v3/projects/65af9b50a76543b6addfbda14436dab4` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:48.999993 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f08f67-d076-4e08-805b-bb9523f60395 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65af9b50a76543b6addfbda14436dab4)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:49.002650 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1783f26-baed-40a7-9c4d-8964c8774c7e admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:49.002800 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f08f67-d076-4e08-805b-bb9523f60395 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:49.039602 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1069/2160] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:49.040159 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1783f26-baed-40a7-9c4d-8964c8774c7e admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:49.063851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1783f26-baed-40a7-9c4d-8964c8774c7e admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:49.093731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-34f08f67-d076-4e08-805b-bb9523f60395 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65af9b50a76543b6addfbda14436dab4', 'request_id': 'req-34f08f67-d076-4e08-805b-bb9523f60395'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:49.113443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-34f08f67-d076-4e08-805b-bb9523f60395 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65af9b50a76543b6addfbda14436dab4', 'request_id': 'req-34f08f67-d076-4e08-805b-bb9523f60395'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:49.126227 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-34f08f67-d076-4e08-805b-bb9523f60395 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65af9b50a76543b6addfbda14436dab4', 'request_id': 'req-34f08f67-d076-4e08-805b-bb9523f60395'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:49.192131 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-34f08f67-d076-4e08-805b-bb9523f60395 admin admin] The token cache is being invalidate because project 65af9b50a76543b6addfbda14436dab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:49.192617 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-34f08f67-d076-4e08-805b-bb9523f60395 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:49.195297 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-34f08f67-d076-4e08-805b-bb9523f60395 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:49.204160 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1092/2161] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:48 2022] DELETE /identity/v3/projects/65af9b50a76543b6addfbda14436dab4 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:18:49.209836 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f08f67-d076-4e08-805b-bb9523f60395 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:49.223472 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-34f08f67-d076-4e08-805b-bb9523f60395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:49.242782 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f133c87-9f0a-4f01-b252-77f52182d835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:49.244648 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f133c87-9f0a-4f01-b252-77f52182d835 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:49.247545 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f133c87-9f0a-4f01-b252-77f52182d835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:49.248959 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f133c87-9f0a-4f01-b252-77f52182d835 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:49.249909 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f133c87-9f0a-4f01-b252-77f52182d835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:49.254636 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f133c87-9f0a-4f01-b252-77f52182d835 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:49.281313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1070/2162] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:49.294950 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f133c87-9f0a-4f01-b252-77f52182d835 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:49.300989 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-8f133c87-9f0a-4f01-b252-77f52182d835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:49.355914 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:49.371896 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f133c87-9f0a-4f01-b252-77f52182d835 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:49.391758 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7e9a0-dbae-4a2b-8374-e94d844d4ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:49.392123 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7e9a0-dbae-4a2b-8374-e94d844d4ca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:49.392418 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7e9a0-dbae-4a2b-8374-e94d844d4ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:49.392702 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7e9a0-dbae-4a2b-8374-e94d844d4ca0 admin admin] PATH_INFO: `/v3/projects/ed8f35f4e4d546289afd3fc08f09d154/users/f85d30a190394beebc5ea6b43642be56/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:49.454684 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f08f67-d076-4e08-805b-bb9523f60395 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:49.455032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7e9a0-dbae-4a2b-8374-e94d844d4ca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8f35f4e4d546289afd3fc08f09d154, user_id=f85d30a190394beebc5ea6b43642be56, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:49.458612 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7e9a0-dbae-4a2b-8374-e94d844d4ca0 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:49.465410 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24ae66-b4f3-48ed-a337-de5936f2097e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:49.466754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24ae66-b4f3-48ed-a337-de5936f2097e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:49.466754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24ae66-b4f3-48ed-a337-de5936f2097e admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:49.466967 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24ae66-b4f3-48ed-a337-de5936f2097e admin admin] PATH_INFO: `/v3/users/362f7683fbae4987a92c59d1801e9834` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:49.469687 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24ae66-b4f3-48ed-a337-de5936f2097e admin admin] RBAC: Authorizing `identity:delete_user(user_id=362f7683fbae4987a92c59d1801e9834)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:49.477989 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24ae66-b4f3-48ed-a337-de5936f2097e admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:49.490874 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1071/2163] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:49 2022] PUT /identity/v3/projects/ed8f35f4e4d546289afd3fc08f09d154/users/f85d30a190394beebc5ea6b43642be56/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:49.502070 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b00e9-9b92-405a-8252-9c788456d200 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:49.502439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b00e9-9b92-405a-8252-9c788456d200 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:49.503536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b00e9-9b92-405a-8252-9c788456d200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:49.638182 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-ab24ae66-b4f3-48ed-a337-de5936f2097e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '362f7683fbae4987a92c59d1801e9834'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:49.645668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-df0b00e9-9b92-405a-8252-9c788456d200 None None] MFA Rules not processed for user `f85d30a190394beebc5ea6b43642be56`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:49.651598 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-df0b00e9-9b92-405a-8252-9c788456d200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:49.654617 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-ab24ae66-b4f3-48ed-a337-de5936f2097e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '362f7683fbae4987a92c59d1801e9834'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:49.671156 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-ab24ae66-b4f3-48ed-a337-de5936f2097e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '362f7683fbae4987a92c59d1801e9834'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:49.693746 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-ab24ae66-b4f3-48ed-a337-de5936f2097e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '362f7683fbae4987a92c59d1801e9834'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:49.722214 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-ab24ae66-b4f3-48ed-a337-de5936f2097e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '362f7683fbae4987a92c59d1801e9834'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:49.756486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1093/2164] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:49 2022] DELETE /identity/v3/users/362f7683fbae4987a92c59d1801e9834 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:49.893304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:49.924567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1072/2165] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:49 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:49.962055 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24ae66-b4f3-48ed-a337-de5936f2097e admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:49.963862 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-ab24ae66-b4f3-48ed-a337-de5936f2097e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:50.039733 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24ae66-b4f3-48ed-a337-de5936f2097e admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:50.044204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab114a-5fcb-45cd-99c7-8c9de7c5c3af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:50.044881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab114a-5fcb-45cd-99c7-8c9de7c5c3af service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:50.045167 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab114a-5fcb-45cd-99c7-8c9de7c5c3af service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:50.045448 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab114a-5fcb-45cd-99c7-8c9de7c5c3af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:50.124330 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab114a-5fcb-45cd-99c7-8c9de7c5c3af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:50.125809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab114a-5fcb-45cd-99c7-8c9de7c5c3af service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:50.136638 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1094/2166] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:49 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:50.153414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b00e9-9b92-405a-8252-9c788456d200 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:50.155162 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-df0b00e9-9b92-405a-8252-9c788456d200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:50.358833 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b00e9-9b92-405a-8252-9c788456d200 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:50.491457 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f82195-392c-4d94-93e3-50f5a9209b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:50.492957 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f82195-392c-4d94-93e3-50f5a9209b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:50.493469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f82195-392c-4d94-93e3-50f5a9209b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:50.494045 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f82195-392c-4d94-93e3-50f5a9209b4e admin admin] PATH_INFO: `/v3/users/f85d30a190394beebc5ea6b43642be56` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:50.496132 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f82195-392c-4d94-93e3-50f5a9209b4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f85d30a190394beebc5ea6b43642be56)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:50.499580 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f82195-392c-4d94-93e3-50f5a9209b4e admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:50.617418 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-e0f82195-392c-4d94-93e3-50f5a9209b4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f85d30a190394beebc5ea6b43642be56'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:50.618714 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-e0f82195-392c-4d94-93e3-50f5a9209b4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f85d30a190394beebc5ea6b43642be56'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:50.644129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-e0f82195-392c-4d94-93e3-50f5a9209b4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f85d30a190394beebc5ea6b43642be56'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:50.655184 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-e0f82195-392c-4d94-93e3-50f5a9209b4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f85d30a190394beebc5ea6b43642be56'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:50.677447 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-e0f82195-392c-4d94-93e3-50f5a9209b4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f85d30a190394beebc5ea6b43642be56'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:50.693363 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1073/2167] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:50 2022] DELETE /identity/v3/users/f85d30a190394beebc5ea6b43642be56 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:50.695008 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ac0ef-cd9a-40a0-8cc2-57f396110c2a None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:50.695303 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ac0ef-cd9a-40a0-8cc2-57f396110c2a None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:50.695589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ac0ef-cd9a-40a0-8cc2-57f396110c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:50.734282 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-8b0ac0ef-cd9a-40a0-8cc2-57f396110c2a None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:50.739053 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-8b0ac0ef-cd9a-40a0-8cc2-57f396110c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:50.790856 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:50.886870 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f82195-392c-4d94-93e3-50f5a9209b4e admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:50.888838 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-e0f82195-392c-4d94-93e3-50f5a9209b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:50.929053 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1095/2168] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:50.939712 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ac0ef-cd9a-40a0-8cc2-57f396110c2a None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:50.942976 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-8b0ac0ef-cd9a-40a0-8cc2-57f396110c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:50.983128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:51.047302 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f82195-392c-4d94-93e3-50f5a9209b4e admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:51.052620 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ac0ef-cd9a-40a0-8cc2-57f396110c2a None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:51.056607 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdb362-7790-4646-b81d-f578e8c400c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:51.056782 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5919d34-c1bc-459e-9cfd-133fd7834235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:51.057700 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdb362-7790-4646-b81d-f578e8c400c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:51.057827 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5919d34-c1bc-459e-9cfd-133fd7834235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:51.058054 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5919d34-c1bc-459e-9cfd-133fd7834235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:51.058398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5919d34-c1bc-459e-9cfd-133fd7834235 admin admin] PATH_INFO: `/v3/projects/ffe24b4b098e4c9a86baa60ff9ac5c67` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:51.059035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdb362-7790-4646-b81d-f578e8c400c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:51.059326 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdb362-7790-4646-b81d-f578e8c400c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:51.070763 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cdb362-7790-4646-b81d-f578e8c400c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:51.071942 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5919d34-c1bc-459e-9cfd-133fd7834235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffe24b4b098e4c9a86baa60ff9ac5c67)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:51.073277 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cdb362-7790-4646-b81d-f578e8c400c2 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:51.074452 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5919d34-c1bc-459e-9cfd-133fd7834235 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:51.084903 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1096/2169] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:51.164733 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a5919d34-c1bc-459e-9cfd-133fd7834235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe24b4b098e4c9a86baa60ff9ac5c67', 'request_id': 'req-a5919d34-c1bc-459e-9cfd-133fd7834235'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:51.175585 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a5919d34-c1bc-459e-9cfd-133fd7834235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe24b4b098e4c9a86baa60ff9ac5c67', 'request_id': 'req-a5919d34-c1bc-459e-9cfd-133fd7834235'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:51.195535 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a5919d34-c1bc-459e-9cfd-133fd7834235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe24b4b098e4c9a86baa60ff9ac5c67', 'request_id': 'req-a5919d34-c1bc-459e-9cfd-133fd7834235'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:51.218021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a5919d34-c1bc-459e-9cfd-133fd7834235 admin admin] The token cache is being invalidate because project ffe24b4b098e4c9a86baa60ff9ac5c67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:51.218637 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a5919d34-c1bc-459e-9cfd-133fd7834235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:51.219891 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a5919d34-c1bc-459e-9cfd-133fd7834235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:51.221817 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1074/2170] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:50 2022] DELETE /identity/v3/projects/ffe24b4b098e4c9a86baa60ff9ac5c67 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:51.227223 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac306ee-ed92-4861-81e4-f1ea0750509d None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:51.227223 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac306ee-ed92-4861-81e4-f1ea0750509d None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:51.229594 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac306ee-ed92-4861-81e4-f1ea0750509d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:51.254580 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-4ac306ee-ed92-4861-81e4-f1ea0750509d None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:51.255937 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-4ac306ee-ed92-4861-81e4-f1ea0750509d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:51.338840 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1097/2171] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:51.411639 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13b97f-d2b6-431a-9a17-af51c0dfa1fc None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:51.412140 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13b97f-d2b6-431a-9a17-af51c0dfa1fc None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:51.412260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13b97f-d2b6-431a-9a17-af51c0dfa1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:51.445473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-3d13b97f-d2b6-431a-9a17-af51c0dfa1fc None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:51.446760 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-3d13b97f-d2b6-431a-9a17-af51c0dfa1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:51.461839 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1075/2172] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:51.463145 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac306ee-ed92-4861-81e4-f1ea0750509d None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:51.475528 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac306ee-ed92-4861-81e4-f1ea0750509d None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:51.485833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50030f62-1d9b-43ca-8bc5-6e83fba59da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:51.486980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50030f62-1d9b-43ca-8bc5-6e83fba59da5 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:51.487341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50030f62-1d9b-43ca-8bc5-6e83fba59da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:51.487629 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50030f62-1d9b-43ca-8bc5-6e83fba59da5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:51.488842 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50030f62-1d9b-43ca-8bc5-6e83fba59da5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:18:51.489431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50030f62-1d9b-43ca-8bc5-6e83fba59da5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:51.491591 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50030f62-1d9b-43ca-8bc5-6e83fba59da5 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:51.511047 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1098/2173] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:18:51.513122 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13b97f-d2b6-431a-9a17-af51c0dfa1fc None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:51.514091 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-3d13b97f-d2b6-431a-9a17-af51c0dfa1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:51.514240 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50030f62-1d9b-43ca-8bc5-6e83fba59da5 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:51.530102 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50030f62-1d9b-43ca-8bc5-6e83fba59da5 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:51.538251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdf65b-c063-4954-a2a0-785c0e5f5ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:51.539070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdf65b-c063-4954-a2a0-785c0e5f5ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:51.539391 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdf65b-c063-4954-a2a0-785c0e5f5ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:51.539737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdf65b-c063-4954-a2a0-785c0e5f5ce7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:51.540519 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cdf65b-c063-4954-a2a0-785c0e5f5ce7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:51.540902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13b97f-d2b6-431a-9a17-af51c0dfa1fc None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:51.543235 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cdf65b-c063-4954-a2a0-785c0e5f5ce7 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:51.547491 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0394b-0378-4a02-a132-f15d15e178a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:51.548471 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0394b-0378-4a02-a132-f15d15e178a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:51.548885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0394b-0378-4a02-a132-f15d15e178a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:51.549172 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0394b-0378-4a02-a132-f15d15e178a1 admin admin] PATH_INFO: `/v3/projects/ed8f35f4e4d546289afd3fc08f09d154` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:51.550444 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0394b-0378-4a02-a132-f15d15e178a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed8f35f4e4d546289afd3fc08f09d154)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:51.552361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0394b-0378-4a02-a132-f15d15e178a1 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:51.577756 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1099/2174] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:51 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:51.581545 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdf65b-c063-4954-a2a0-785c0e5f5ce7 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:51.625527 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-61b0394b-0378-4a02-a132-f15d15e178a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed8f35f4e4d546289afd3fc08f09d154', 'request_id': 'req-61b0394b-0378-4a02-a132-f15d15e178a1'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:51.633991 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-61b0394b-0378-4a02-a132-f15d15e178a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed8f35f4e4d546289afd3fc08f09d154', 'request_id': 'req-61b0394b-0378-4a02-a132-f15d15e178a1'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:51.646402 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-61b0394b-0378-4a02-a132-f15d15e178a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed8f35f4e4d546289afd3fc08f09d154', 'request_id': 'req-61b0394b-0378-4a02-a132-f15d15e178a1'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:51.650241 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:51.662355 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-61b0394b-0378-4a02-a132-f15d15e178a1 admin admin] The token cache is being invalidate because project ed8f35f4e4d546289afd3fc08f09d154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:51.662742 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-61b0394b-0378-4a02-a132-f15d15e178a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:51.663359 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-61b0394b-0378-4a02-a132-f15d15e178a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:51.668271 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1076/2175] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:51 2022] DELETE /identity/v3/projects/ed8f35f4e4d546289afd3fc08f09d154 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:51.670991 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410e562-eacc-4fac-ab0e-2b0e8051919f None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:51.671278 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410e562-eacc-4fac-ab0e-2b0e8051919f None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:51.671561 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410e562-eacc-4fac-ab0e-2b0e8051919f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:51.700037 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdf65b-c063-4954-a2a0-785c0e5f5ce7 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:51.700849 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-5410e562-eacc-4fac-ab0e-2b0e8051919f None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:51.702151 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-5410e562-eacc-4fac-ab0e-2b0e8051919f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:51.732472 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:51.772612 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269aad1-6115-4d03-aba2-0fa3e0458c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:51.773403 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269aad1-6115-4d03-aba2-0fa3e0458c87 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:51.773550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269aad1-6115-4d03-aba2-0fa3e0458c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:51.773808 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269aad1-6115-4d03-aba2-0fa3e0458c87 admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:51.774550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269aad1-6115-4d03-aba2-0fa3e0458c87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:51.776690 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269aad1-6115-4d03-aba2-0fa3e0458c87 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:51.777211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1077/2176] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:51.785541 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8da82e-7b28-490b-8151-c56cf57d46bc None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:51.786643 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8da82e-7b28-490b-8151-c56cf57d46bc None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:51.786643 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8da82e-7b28-490b-8151-c56cf57d46bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:51.804657 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1100/2177] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:51 2022] POST /identity/v3/users => generated 289 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:51.808991 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269aad1-6115-4d03-aba2-0fa3e0458c87 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:51.809666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-5c8da82e-7b28-490b-8151-c56cf57d46bc None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:51.810760 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-0269aad1-6115-4d03-aba2-0fa3e0458c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:51.810938 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-5c8da82e-7b28-490b-8151-c56cf57d46bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:51.819847 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1078/2178] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:18:51.822569 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269aad1-6115-4d03-aba2-0fa3e0458c87 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:51.823858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8da82e-7b28-490b-8151-c56cf57d46bc None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:51.827334 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc191c54-40e0-4588-9405-59b17af0410c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:51.828014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc191c54-40e0-4588-9405-59b17af0410c admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:51.828496 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc191c54-40e0-4588-9405-59b17af0410c admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:51.828881 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc191c54-40e0-4588-9405-59b17af0410c admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:51.830157 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc191c54-40e0-4588-9405-59b17af0410c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:51.831775 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc191c54-40e0-4588-9405-59b17af0410c admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:51.833559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8da82e-7b28-490b-8151-c56cf57d46bc None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:51.838308 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c98bf6-1471-48f7-beb5-a3459358af4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:51.838984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c98bf6-1471-48f7-beb5-a3459358af4d admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:51.839271 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c98bf6-1471-48f7-beb5-a3459358af4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:51.839550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c98bf6-1471-48f7-beb5-a3459358af4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:51.840278 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c98bf6-1471-48f7-beb5-a3459358af4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:18:51.840587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c98bf6-1471-48f7-beb5-a3459358af4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:51.842284 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c98bf6-1471-48f7-beb5-a3459358af4d admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:51.842720 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1101/2179] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:18:51.846519 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc191c54-40e0-4588-9405-59b17af0410c admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:51.857418 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc191c54-40e0-4588-9405-59b17af0410c admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:51.858501 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1079/2180] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:18:51.862364 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fcb7a-5c7a-464c-ae3b-1965da6dfe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:51.863273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fcb7a-5c7a-464c-ae3b-1965da6dfe8c admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:51.863617 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fcb7a-5c7a-464c-ae3b-1965da6dfe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:51.863842 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fcb7a-5c7a-464c-ae3b-1965da6dfe8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:51.864326 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c98bf6-1471-48f7-beb5-a3459358af4d admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:51.864570 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fcb7a-5c7a-464c-ae3b-1965da6dfe8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:51.866211 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fcb7a-5c7a-464c-ae3b-1965da6dfe8c admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:51.875596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c98bf6-1471-48f7-beb5-a3459358af4d admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:51.879028 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1102/2181] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:18:51.881190 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2228fc-1601-4073-8c1b-82347a1006f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:51.882295 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2228fc-1601-4073-8c1b-82347a1006f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:51.882647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2228fc-1601-4073-8c1b-82347a1006f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:51.883002 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2228fc-1601-4073-8c1b-82347a1006f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:51.883103 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fcb7a-5c7a-464c-ae3b-1965da6dfe8c admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:51.883765 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2228fc-1601-4073-8c1b-82347a1006f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:51.885731 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2228fc-1601-4073-8c1b-82347a1006f7 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:51.893251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fcb7a-5c7a-464c-ae3b-1965da6dfe8c admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:51.898447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74bf6a-650a-44bb-ac77-ad489450415c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:51.899486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74bf6a-650a-44bb-ac77-ad489450415c admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:51.899776 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74bf6a-650a-44bb-ac77-ad489450415c admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:51.900060 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74bf6a-650a-44bb-ac77-ad489450415c admin admin] PATH_INFO: `/v3/projects/d0e48091f4ac460e864c532bad7634f1/users/82f8c83217d04a128cbc34d5f4f13666/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:51.917930 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74bf6a-650a-44bb-ac77-ad489450415c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0e48091f4ac460e864c532bad7634f1, user_id=82f8c83217d04a128cbc34d5f4f13666, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:51.920664 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74bf6a-650a-44bb-ac77-ad489450415c admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:51.923563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1080/2182] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:51 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:51.928315 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2228fc-1601-4073-8c1b-82347a1006f7 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:51.936193 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1103/2183] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:51 2022] PUT /identity/v3/projects/d0e48091f4ac460e864c532bad7634f1/users/82f8c83217d04a128cbc34d5f4f13666/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:18:51.946390 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c7c1e-87b0-4dd5-a28b-ff729386fca5 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:51.946824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c7c1e-87b0-4dd5-a28b-ff729386fca5 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:51.946983 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c7c1e-87b0-4dd5-a28b-ff729386fca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:51.977947 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-234c7c1e-87b0-4dd5-a28b-ff729386fca5 None None] MFA Rules not processed for user `82f8c83217d04a128cbc34d5f4f13666`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:51.979963 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-234c7c1e-87b0-4dd5-a28b-ff729386fca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:52.000537 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2228fc-1601-4073-8c1b-82347a1006f7 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:52.051862 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1104/2184] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:18:52.057529 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c7c1e-87b0-4dd5-a28b-ff729386fca5 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:52.074233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:52.080716 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ace56c-5c14-4fdb-be67-73579b16066a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:52.081402 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ace56c-5c14-4fdb-be67-73579b16066a admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:52.081703 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ace56c-5c14-4fdb-be67-73579b16066a admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:52.081968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ace56c-5c14-4fdb-be67-73579b16066a admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:52.082702 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ace56c-5c14-4fdb-be67-73579b16066a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:52.084703 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ace56c-5c14-4fdb-be67-73579b16066a admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:52.110961 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1081/2185] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:51 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:18:52.115727 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ace56c-5c14-4fdb-be67-73579b16066a admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:52.126102 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ace56c-5c14-4fdb-be67-73579b16066a admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:52.131129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7d7fc-611c-48ac-be10-33d32dbde06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:52.132211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7d7fc-611c-48ac-be10-33d32dbde06c admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:52.133026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7d7fc-611c-48ac-be10-33d32dbde06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:52.133026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7d7fc-611c-48ac-be10-33d32dbde06c admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:52.133687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7d7fc-611c-48ac-be10-33d32dbde06c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:52.135348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7d7fc-611c-48ac-be10-33d32dbde06c admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:52.136934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c7c1e-87b0-4dd5-a28b-ff729386fca5 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:52.141598 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7121f-e9dd-42d0-aacf-77d520f74450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:52.142301 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7121f-e9dd-42d0-aacf-77d520f74450 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:52.142588 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7121f-e9dd-42d0-aacf-77d520f74450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:52.142863 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7121f-e9dd-42d0-aacf-77d520f74450 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:52.143555 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7121f-e9dd-42d0-aacf-77d520f74450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:52.145453 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7121f-e9dd-42d0-aacf-77d520f74450 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:52.148973 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1082/2186] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:52.149997 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7d7fc-611c-48ac-be10-33d32dbde06c admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:52.160819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7d7fc-611c-48ac-be10-33d32dbde06c admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:52.167374 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e30b68-5127-407a-8b33-c78edea315c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:52.168050 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e30b68-5127-407a-8b33-c78edea315c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:52.168345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e30b68-5127-407a-8b33-c78edea315c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:52.168622 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e30b68-5127-407a-8b33-c78edea315c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:52.169348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e30b68-5127-407a-8b33-c78edea315c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:52.170989 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e30b68-5127-407a-8b33-c78edea315c1 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:52.174557 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1105/2187] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:52 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:18:52.178660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7121f-e9dd-42d0-aacf-77d520f74450 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:52.185555 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1083/2188] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:18:52.190987 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e30b68-5127-407a-8b33-c78edea315c1 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:52.197416 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:52.201658 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e30b68-5127-407a-8b33-c78edea315c1 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:52.257733 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7121f-e9dd-42d0-aacf-77d520f74450 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:52.264256 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c98992-7317-467d-a170-91bda79af882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:52.264948 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c98992-7317-467d-a170-91bda79af882 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:52.265235 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c98992-7317-467d-a170-91bda79af882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:52.265772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c98992-7317-467d-a170-91bda79af882 admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:52.266249 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c98992-7317-467d-a170-91bda79af882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:52.268188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c98992-7317-467d-a170-91bda79af882 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:52.280502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3583d-c13d-43ec-a30c-421c60e7c7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:52.281419 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3583d-c13d-43ec-a30c-421c60e7c7d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:52.281686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3583d-c13d-43ec-a30c-421c60e7c7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:52.282059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3583d-c13d-43ec-a30c-421c60e7c7d3 admin admin] PATH_INFO: `/v3/projects/0ae350857a37435aabbb5ca539a4a13a/users/c5fbd154dd1f43e58c933cd5adcc8fa3/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:52.292379 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1106/2189] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:52 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:18:52.296702 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c98992-7317-467d-a170-91bda79af882 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:52.298752 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3583d-c13d-43ec-a30c-421c60e7c7d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ae350857a37435aabbb5ca539a4a13a, user_id=c5fbd154dd1f43e58c933cd5adcc8fa3, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:52.301508 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3583d-c13d-43ec-a30c-421c60e7c7d3 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:52.307398 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c98992-7317-467d-a170-91bda79af882 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:52.313328 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bbe86-3519-464c-9222-f34f19994346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:52.314062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bbe86-3519-464c-9222-f34f19994346 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:52.314385 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bbe86-3519-464c-9222-f34f19994346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:52.314728 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bbe86-3519-464c-9222-f34f19994346 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:52.315472 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3bbe86-3519-464c-9222-f34f19994346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:52.315944 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1084/2190] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:52 2022] PUT /identity/v3/projects/0ae350857a37435aabbb5ca539a4a13a/users/c5fbd154dd1f43e58c933cd5adcc8fa3/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:52.317247 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3bbe86-3519-464c-9222-f34f19994346 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:52.327145 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867298d8-35af-4886-a7a7-22a010f5d70c None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:52.327431 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867298d8-35af-4886-a7a7-22a010f5d70c None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:52.327715 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867298d8-35af-4886-a7a7-22a010f5d70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:52.330082 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1107/2191] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:18:52.333944 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bbe86-3519-464c-9222-f34f19994346 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:52.344768 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bbe86-3519-464c-9222-f34f19994346 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:52.357615 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-867298d8-35af-4886-a7a7-22a010f5d70c None None] MFA Rules not processed for user `c5fbd154dd1f43e58c933cd5adcc8fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:52.358906 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-867298d8-35af-4886-a7a7-22a010f5d70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:52.437907 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da568b-4659-48c0-9c6c-d970369f391e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:52.438749 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da568b-4659-48c0-9c6c-d970369f391e admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:52.439041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da568b-4659-48c0-9c6c-d970369f391e admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:52.439318 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da568b-4659-48c0-9c6c-d970369f391e admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:52.440077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da568b-4659-48c0-9c6c-d970369f391e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:52.441681 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da568b-4659-48c0-9c6c-d970369f391e admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:52.451187 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1085/2192] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:18:52.455781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1108/2193] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:18:52.456816 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867298d8-35af-4886-a7a7-22a010f5d70c None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:52.462939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da568b-4659-48c0-9c6c-d970369f391e admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:52.465923 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-51da568b-4659-48c0-9c6c-d970369f391e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:52.468722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867298d8-35af-4886-a7a7-22a010f5d70c None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:52.473878 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b3bcc-b5a5-4325-a577-20759a97a34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:52.474878 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b3bcc-b5a5-4325-a577-20759a97a34e admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:52.475261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b3bcc-b5a5-4325-a577-20759a97a34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:52.475568 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b3bcc-b5a5-4325-a577-20759a97a34e admin admin] PATH_INFO: `/v3/projects/2688fb0c26174153901ea244a37d4637/users/f8ad1bdcb8c4462f938debf6086166a5/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:52.483961 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:52.493326 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b3bcc-b5a5-4325-a577-20759a97a34e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2688fb0c26174153901ea244a37d4637, user_id=f8ad1bdcb8c4462f938debf6086166a5, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:52.496245 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b3bcc-b5a5-4325-a577-20759a97a34e admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:52.511224 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1086/2194] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:52 2022] PUT /identity/v3/projects/2688fb0c26174153901ea244a37d4637/users/f8ad1bdcb8c4462f938debf6086166a5/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:18:52.523051 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f73d27-1c3e-40bd-bea3-ff448a5167c9 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:52.523051 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f73d27-1c3e-40bd-bea3-ff448a5167c9 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:52.523379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f73d27-1c3e-40bd-bea3-ff448a5167c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:52.534578 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da568b-4659-48c0-9c6c-d970369f391e admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:52.558997 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-a1f73d27-1c3e-40bd-bea3-ff448a5167c9 None None] MFA Rules not processed for user `f8ad1bdcb8c4462f938debf6086166a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:52.560234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-a1f73d27-1c3e-40bd-bea3-ff448a5167c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:52.591431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba0fd3-807f-41f6-942f-61b7ff337e53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:52.592098 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0fd3-807f-41f6-942f-61b7ff337e53 service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:52.592392 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0fd3-807f-41f6-942f-61b7ff337e53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:52.592671 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0fd3-807f-41f6-942f-61b7ff337e53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:52.610494 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:52.645047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1087/2195] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:18:52.651423 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f73d27-1c3e-40bd-bea3-ff448a5167c9 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:52.679612 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba0fd3-807f-41f6-942f-61b7ff337e53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:52.682758 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba0fd3-807f-41f6-942f-61b7ff337e53 service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:52.701320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1109/2196] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:18:52.755392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f73d27-1c3e-40bd-bea3-ff448a5167c9 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:52.768730 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0870f3-37f0-432f-86c5-3e1571f530f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:52.770089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0870f3-37f0-432f-86c5-3e1571f530f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:52.770427 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0870f3-37f0-432f-86c5-3e1571f530f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:52.770712 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0870f3-37f0-432f-86c5-3e1571f530f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:52.772346 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0870f3-37f0-432f-86c5-3e1571f530f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:52.775477 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0870f3-37f0-432f-86c5-3e1571f530f5 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:52.827398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1088/2197] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:18:52 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:18:52.828850 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba0fd3-807f-41f6-942f-61b7ff337e53 service cinder] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:52.843210 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba0fd3-807f-41f6-942f-61b7ff337e53 service cinder] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:52.943133 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579aac3-f46e-44a7-aca6-289d096e7913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:52.944645 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579aac3-f46e-44a7-aca6-289d096e7913 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:52.945099 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579aac3-f46e-44a7-aca6-289d096e7913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:52.945588 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579aac3-f46e-44a7-aca6-289d096e7913 admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:52.946741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579aac3-f46e-44a7-aca6-289d096e7913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:52.950002 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579aac3-f46e-44a7-aca6-289d096e7913 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:53.006563 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1110/2198] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:18:52 2022] POST /identity/v3/users => generated 295 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:18:53.011472 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0870f3-37f0-432f-86c5-3e1571f530f5 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:53.028999 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0870f3-37f0-432f-86c5-3e1571f530f5 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:53.034366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998a1b2-840d-4806-8994-398b8bbbe027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:53.035164 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998a1b2-840d-4806-8994-398b8bbbe027 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:53.035582 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998a1b2-840d-4806-8994-398b8bbbe027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:53.035864 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998a1b2-840d-4806-8994-398b8bbbe027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:53.036808 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998a1b2-840d-4806-8994-398b8bbbe027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:53.038512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998a1b2-840d-4806-8994-398b8bbbe027 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:53.065520 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1089/2199] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:53.069233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579aac3-f46e-44a7-aca6-289d096e7913 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:53.089054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579aac3-f46e-44a7-aca6-289d096e7913 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:53.105031 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966098ac-9c9c-4278-9a3a-d4d99bfc9af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:53.106052 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966098ac-9c9c-4278-9a3a-d4d99bfc9af7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:53.106988 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966098ac-9c9c-4278-9a3a-d4d99bfc9af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:53.107242 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966098ac-9c9c-4278-9a3a-d4d99bfc9af7 admin admin] PATH_INFO: `/v3/projects/a54e23ea7a8748449b526f5a7d7be1fe/users/bff84e28df684c149536078fcbef5a2e/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:53.126937 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:53.142798 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966098ac-9c9c-4278-9a3a-d4d99bfc9af7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a54e23ea7a8748449b526f5a7d7be1fe, user_id=bff84e28df684c149536078fcbef5a2e, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:53.157912 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966098ac-9c9c-4278-9a3a-d4d99bfc9af7 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:53.179329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1111/2200] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:53 2022] PUT /identity/v3/projects/a54e23ea7a8748449b526f5a7d7be1fe/users/bff84e28df684c149536078fcbef5a2e/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:18:53.183581 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998a1b2-840d-4806-8994-398b8bbbe027 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:53.199306 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998a1b2-840d-4806-8994-398b8bbbe027 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:53.289208 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4dba9-c3d0-4077-b1c8-ed1913f1347c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:53.289910 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4dba9-c3d0-4077-b1c8-ed1913f1347c admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:53.290235 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4dba9-c3d0-4077-b1c8-ed1913f1347c admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:53.290525 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4dba9-c3d0-4077-b1c8-ed1913f1347c admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:53.292939 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4dba9-c3d0-4077-b1c8-ed1913f1347c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:53.294626 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4dba9-c3d0-4077-b1c8-ed1913f1347c admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:53.310375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1090/2201] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:18:53.311580 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966098ac-9c9c-4278-9a3a-d4d99bfc9af7 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:53.323341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966098ac-9c9c-4278-9a3a-d4d99bfc9af7 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:53.328304 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d34da-96a8-4103-ab03-e08f0b1ac425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:53.329207 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d34da-96a8-4103-ab03-e08f0b1ac425 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:53.329488 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d34da-96a8-4103-ab03-e08f0b1ac425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:53.329758 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d34da-96a8-4103-ab03-e08f0b1ac425 admin admin] PATH_INFO: `/v3/projects/a54e23ea7a8748449b526f5a7d7be1fe/users/bff84e28df684c149536078fcbef5a2e/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:53.331803 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d34da-96a8-4103-ab03-e08f0b1ac425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a54e23ea7a8748449b526f5a7d7be1fe, user_id=bff84e28df684c149536078fcbef5a2e, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:53.334499 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d34da-96a8-4103-ab03-e08f0b1ac425 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:53.345669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1112/2202] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:18:53 2022] PUT /identity/v3/projects/a54e23ea7a8748449b526f5a7d7be1fe/users/bff84e28df684c149536078fcbef5a2e/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:53.356246 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ad0d1-fdb5-46a2-8fa7-037f5b9385ad None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:53.356483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ad0d1-fdb5-46a2-8fa7-037f5b9385ad None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:53.356708 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ad0d1-fdb5-46a2-8fa7-037f5b9385ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:53.389675 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-516ad0d1-fdb5-46a2-8fa7-037f5b9385ad None None] MFA Rules not processed for user `bff84e28df684c149536078fcbef5a2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:53.391927 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-516ad0d1-fdb5-46a2-8fa7-037f5b9385ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:53.464528 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:53.505066 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1091/2203] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:53.517069 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d34da-96a8-4103-ab03-e08f0b1ac425 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:53.518890 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-aa2d34da-96a8-4103-ab03-e08f0b1ac425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:53.596502 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d34da-96a8-4103-ab03-e08f0b1ac425 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:53.606258 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e4f59-2440-4317-8fb4-00831b1b9303 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:53.607151 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e4f59-2440-4317-8fb4-00831b1b9303 service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:53.607440 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e4f59-2440-4317-8fb4-00831b1b9303 service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:53.607720 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e4f59-2440-4317-8fb4-00831b1b9303 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:53.672436 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e4f59-2440-4317-8fb4-00831b1b9303 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:53.674182 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e4f59-2440-4317-8fb4-00831b1b9303 service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:53.687975 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1113/2204] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:55.449768 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ad0d1-fdb5-46a2-8fa7-037f5b9385ad None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:55.459710 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ad0d1-fdb5-46a2-8fa7-037f5b9385ad None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:55.464212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f09e2-0430-4f48-bfd3-0e6fca9a1659 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:55.464887 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f09e2-0430-4f48-bfd3-0e6fca9a1659 service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:55.465176 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f09e2-0430-4f48-bfd3-0e6fca9a1659 service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:55.465455 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f09e2-0430-4f48-bfd3-0e6fca9a1659 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:55.537972 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f09e2-0430-4f48-bfd3-0e6fca9a1659 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:55.539467 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f09e2-0430-4f48-bfd3-0e6fca9a1659 service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:55.549746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1092/2205] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:56.183567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e4f59-2440-4317-8fb4-00831b1b9303 service cinder] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:56.192711 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e4f59-2440-4317-8fb4-00831b1b9303 service cinder] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:56.197231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9c6cf-516d-4f72-96f4-298a725cd5d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:56.198759 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9c6cf-516d-4f72-96f4-298a725cd5d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:56.199193 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9c6cf-516d-4f72-96f4-298a725cd5d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:56.199657 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9c6cf-516d-4f72-96f4-298a725cd5d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:56.211847 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9c6cf-516d-4f72-96f4-298a725cd5d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:56.213864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9c6cf-516d-4f72-96f4-298a725cd5d3 service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:56.224122 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1114/2206] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:18:56.277953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f09e2-0430-4f48-bfd3-0e6fca9a1659 service cinder] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:56.376519 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f09e2-0430-4f48-bfd3-0e6fca9a1659 service cinder] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:56.381393 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61214015-74ba-4da0-b857-dae4e30c8a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:56.382643 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61214015-74ba-4da0-b857-dae4e30c8a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:56.382932 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61214015-74ba-4da0-b857-dae4e30c8a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:56.383212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61214015-74ba-4da0-b857-dae4e30c8a97 admin admin] PATH_INFO: `/v3/users/c5fbd154dd1f43e58c933cd5adcc8fa3` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:56.384463 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61214015-74ba-4da0-b857-dae4e30c8a97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5fbd154dd1f43e58c933cd5adcc8fa3)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:56.387061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61214015-74ba-4da0-b857-dae4e30c8a97 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:56.460746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-61214015-74ba-4da0-b857-dae4e30c8a97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5fbd154dd1f43e58c933cd5adcc8fa3'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:56.461521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-61214015-74ba-4da0-b857-dae4e30c8a97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5fbd154dd1f43e58c933cd5adcc8fa3'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:56.478653 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-61214015-74ba-4da0-b857-dae4e30c8a97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5fbd154dd1f43e58c933cd5adcc8fa3'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:56.492659 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-61214015-74ba-4da0-b857-dae4e30c8a97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5fbd154dd1f43e58c933cd5adcc8fa3'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:56.512162 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:56.513069 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-61214015-74ba-4da0-b857-dae4e30c8a97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5fbd154dd1f43e58c933cd5adcc8fa3'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:56.560122 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1093/2207] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:56 2022] DELETE /identity/v3/users/c5fbd154dd1f43e58c933cd5adcc8fa3 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:56.567137 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ab268-b0e5-437c-a0e0-0f287a795462 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:56.567642 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ab268-b0e5-437c-a0e0-0f287a795462 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:56.568121 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ab268-b0e5-437c-a0e0-0f287a795462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:56.606890 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-2b9ab268-b0e5-437c-a0e0-0f287a795462 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:56.609821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-2b9ab268-b0e5-437c-a0e0-0f287a795462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:56.706163 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1115/2208] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:56.716404 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61214015-74ba-4da0-b857-dae4e30c8a97 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:56.718036 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-61214015-74ba-4da0-b857-dae4e30c8a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:56.797928 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61214015-74ba-4da0-b857-dae4e30c8a97 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:56.810609 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38e74a-48cc-480b-b439-7b3169ee52ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:56.810609 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38e74a-48cc-480b-b439-7b3169ee52ed service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:56.810609 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38e74a-48cc-480b-b439-7b3169ee52ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:56.810609 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38e74a-48cc-480b-b439-7b3169ee52ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:56.821705 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38e74a-48cc-480b-b439-7b3169ee52ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:56.823774 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38e74a-48cc-480b-b439-7b3169ee52ed service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:56.834334 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1094/2209] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:18:57.127754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ab268-b0e5-437c-a0e0-0f287a795462 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:57.129844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-2b9ab268-b0e5-437c-a0e0-0f287a795462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:57.151575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ab268-b0e5-437c-a0e0-0f287a795462 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:57.164627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ed658-e8bd-4a35-87f8-ea80a84a4101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:57.165010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ed658-e8bd-4a35-87f8-ea80a84a4101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:57.165299 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ed658-e8bd-4a35-87f8-ea80a84a4101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:57.165578 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ed658-e8bd-4a35-87f8-ea80a84a4101 admin admin] PATH_INFO: `/v3/projects/0ae350857a37435aabbb5ca539a4a13a` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:57.168072 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ed658-e8bd-4a35-87f8-ea80a84a4101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ae350857a37435aabbb5ca539a4a13a)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:57.170101 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ed658-e8bd-4a35-87f8-ea80a84a4101 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:57.184243 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:57.233009 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-2d6ed658-e8bd-4a35-87f8-ea80a84a4101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ae350857a37435aabbb5ca539a4a13a', 'request_id': 'req-2d6ed658-e8bd-4a35-87f8-ea80a84a4101'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:57.239304 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-2d6ed658-e8bd-4a35-87f8-ea80a84a4101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ae350857a37435aabbb5ca539a4a13a', 'request_id': 'req-2d6ed658-e8bd-4a35-87f8-ea80a84a4101'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:57.247407 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-2d6ed658-e8bd-4a35-87f8-ea80a84a4101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ae350857a37435aabbb5ca539a4a13a', 'request_id': 'req-2d6ed658-e8bd-4a35-87f8-ea80a84a4101'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:57.258082 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-2d6ed658-e8bd-4a35-87f8-ea80a84a4101 admin admin] The token cache is being invalidate because project 0ae350857a37435aabbb5ca539a4a13a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:18:57.258395 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-2d6ed658-e8bd-4a35-87f8-ea80a84a4101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:57.259053 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-2d6ed658-e8bd-4a35-87f8-ea80a84a4101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:57.260650 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1116/2210] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:18:57 2022] DELETE /identity/v3/projects/0ae350857a37435aabbb5ca539a4a13a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:59.644131 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38e74a-48cc-480b-b439-7b3169ee52ed service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:59.645555 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-de38e74a-48cc-480b-b439-7b3169ee52ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:59.663478 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38e74a-48cc-480b-b439-7b3169ee52ed service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:18:59.725976 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cbc6d-ee2d-4013-8e2c-15b48d286a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:18:59.726965 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cbc6d-ee2d-4013-8e2c-15b48d286a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:59.727335 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cbc6d-ee2d-4013-8e2c-15b48d286a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:59.727741 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cbc6d-ee2d-4013-8e2c-15b48d286a2a admin admin] PATH_INFO: `/v3/users/f96cb43423aa4b27a38573b96a62870e` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:59.729510 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3cbc6d-ee2d-4013-8e2c-15b48d286a2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f96cb43423aa4b27a38573b96a62870e)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:18:59.731451 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3cbc6d-ee2d-4013-8e2c-15b48d286a2a admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:18:59.784853 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-fb3cbc6d-ee2d-4013-8e2c-15b48d286a2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f96cb43423aa4b27a38573b96a62870e'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:59.785543 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-fb3cbc6d-ee2d-4013-8e2c-15b48d286a2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f96cb43423aa4b27a38573b96a62870e'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:59.794672 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-fb3cbc6d-ee2d-4013-8e2c-15b48d286a2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f96cb43423aa4b27a38573b96a62870e'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:59.805809 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-fb3cbc6d-ee2d-4013-8e2c-15b48d286a2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f96cb43423aa4b27a38573b96a62870e'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:59.820563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-fb3cbc6d-ee2d-4013-8e2c-15b48d286a2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f96cb43423aa4b27a38573b96a62870e'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:18:59.827530 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1095/2211] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:18:59 2022] DELETE /identity/v3/users/f96cb43423aa4b27a38573b96a62870e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:18:59.831901 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5397c5-4cca-41f9-a65a-7a54b4bbac7f None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:18:59.832360 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5397c5-4cca-41f9-a65a-7a54b4bbac7f None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:18:59.832514 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5397c5-4cca-41f9-a65a-7a54b4bbac7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:18:59.852267 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-5b5397c5-4cca-41f9-a65a-7a54b4bbac7f None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:18:59.853707 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-5b5397c5-4cca-41f9-a65a-7a54b4bbac7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:59.926327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1117/2212] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:18:59.936229 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cbc6d-ee2d-4013-8e2c-15b48d286a2a admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:18:59.937708 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-fb3cbc6d-ee2d-4013-8e2c-15b48d286a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:18:59.958991 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:00.003533 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cbc6d-ee2d-4013-8e2c-15b48d286a2a admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:00.008791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857db727-6cd2-48ef-b5e9-bd0ec6902712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:00.009445 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857db727-6cd2-48ef-b5e9-bd0ec6902712 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:00.009757 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857db727-6cd2-48ef-b5e9-bd0ec6902712 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:00.010049 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857db727-6cd2-48ef-b5e9-bd0ec6902712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:00.028384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857db727-6cd2-48ef-b5e9-bd0ec6902712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:00.030349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857db727-6cd2-48ef-b5e9-bd0ec6902712 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:00.042337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1096/2213] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:18:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:19:00.183056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5397c5-4cca-41f9-a65a-7a54b4bbac7f None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:00.185293 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-5b5397c5-4cca-41f9-a65a-7a54b4bbac7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:00.229621 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5397c5-4cca-41f9-a65a-7a54b4bbac7f None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:00.250607 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b7fe2-d089-4881-9f65-f34c0f9973cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:00.251730 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b7fe2-d089-4881-9f65-f34c0f9973cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:00.252570 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b7fe2-d089-4881-9f65-f34c0f9973cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:00.252570 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b7fe2-d089-4881-9f65-f34c0f9973cb admin admin] PATH_INFO: `/v3/users/82f8c83217d04a128cbc34d5f4f13666` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:00.254471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b7fe2-d089-4881-9f65-f34c0f9973cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=82f8c83217d04a128cbc34d5f4f13666)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:00.256995 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b7fe2-d089-4881-9f65-f34c0f9973cb admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:00.340023 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5e2b7fe2-d089-4881-9f65-f34c0f9973cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82f8c83217d04a128cbc34d5f4f13666'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:00.348273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5e2b7fe2-d089-4881-9f65-f34c0f9973cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82f8c83217d04a128cbc34d5f4f13666'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:00.359822 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5e2b7fe2-d089-4881-9f65-f34c0f9973cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82f8c83217d04a128cbc34d5f4f13666'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:00.360559 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5e2b7fe2-d089-4881-9f65-f34c0f9973cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82f8c83217d04a128cbc34d5f4f13666'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:00.373381 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5e2b7fe2-d089-4881-9f65-f34c0f9973cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82f8c83217d04a128cbc34d5f4f13666'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:00.379620 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1118/2214] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:19:00 2022] DELETE /identity/v3/users/82f8c83217d04a128cbc34d5f4f13666 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:19:00.384700 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ba668-22d3-4ec4-a23f-17255113aef4 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:00.385754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ba668-22d3-4ec4-a23f-17255113aef4 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:00.386038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ba668-22d3-4ec4-a23f-17255113aef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:00.409442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-679ba668-22d3-4ec4-a23f-17255113aef4 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:19:00.410729 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-679ba668-22d3-4ec4-a23f-17255113aef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:00.474726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1097/2215] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:19:00.490668 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b7fe2-d089-4881-9f65-f34c0f9973cb admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:00.492268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-5e2b7fe2-d089-4881-9f65-f34c0f9973cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:00.516168 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:00.541830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ba668-22d3-4ec4-a23f-17255113aef4 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:00.543195 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-679ba668-22d3-4ec4-a23f-17255113aef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:00.556758 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ba668-22d3-4ec4-a23f-17255113aef4 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:00.563134 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414bc7e-f547-4bc0-8414-e6feb6774a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:00.564262 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414bc7e-f547-4bc0-8414-e6feb6774a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:00.564727 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414bc7e-f547-4bc0-8414-e6feb6774a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:00.565159 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414bc7e-f547-4bc0-8414-e6feb6774a17 admin admin] PATH_INFO: `/v3/projects/df5f624340ac409eabd0179c7a294bb8` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:00.566895 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414bc7e-f547-4bc0-8414-e6feb6774a17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df5f624340ac409eabd0179c7a294bb8)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:00.569041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414bc7e-f547-4bc0-8414-e6feb6774a17 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:00.585938 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b7fe2-d089-4881-9f65-f34c0f9973cb admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:00.599423 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949bf82d-fdb5-4e2a-bb55-6f9ca24c109c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:00.600281 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bf82d-fdb5-4e2a-bb55-6f9ca24c109c service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:00.600572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bf82d-fdb5-4e2a-bb55-6f9ca24c109c service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:00.601041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bf82d-fdb5-4e2a-bb55-6f9ca24c109c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:00.624147 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949bf82d-fdb5-4e2a-bb55-6f9ca24c109c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:00.626034 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949bf82d-fdb5-4e2a-bb55-6f9ca24c109c service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:00.639642 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1119/2216] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:19:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:19:00.653257 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-9414bc7e-f547-4bc0-8414-e6feb6774a17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df5f624340ac409eabd0179c7a294bb8', 'request_id': 'req-9414bc7e-f547-4bc0-8414-e6feb6774a17'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:00.659982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-9414bc7e-f547-4bc0-8414-e6feb6774a17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df5f624340ac409eabd0179c7a294bb8', 'request_id': 'req-9414bc7e-f547-4bc0-8414-e6feb6774a17'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:00.671689 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-9414bc7e-f547-4bc0-8414-e6feb6774a17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df5f624340ac409eabd0179c7a294bb8', 'request_id': 'req-9414bc7e-f547-4bc0-8414-e6feb6774a17'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:00.688782 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-9414bc7e-f547-4bc0-8414-e6feb6774a17 admin admin] The token cache is being invalidate because project df5f624340ac409eabd0179c7a294bb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:19:00.690553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-9414bc7e-f547-4bc0-8414-e6feb6774a17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:00.691913 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-9414bc7e-f547-4bc0-8414-e6feb6774a17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:00.698220 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1098/2217] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:19:00 2022] DELETE /identity/v3/projects/df5f624340ac409eabd0179c7a294bb8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:19:00.703510 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b8ce1-b118-40d0-8e71-bc43f646fb12 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:00.703814 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b8ce1-b118-40d0-8e71-bc43f646fb12 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:00.704098 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b8ce1-b118-40d0-8e71-bc43f646fb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:00.728030 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-f31b8ce1-b118-40d0-8e71-bc43f646fb12 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:19:00.729505 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-f31b8ce1-b118-40d0-8e71-bc43f646fb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:00.812415 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1120/2218] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:19:00.821411 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0d752-00df-4d53-baff-3b5201712ada None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:00.821715 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0d752-00df-4d53-baff-3b5201712ada None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:00.822004 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0d752-00df-4d53-baff-3b5201712ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:00.843155 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-24b0d752-00df-4d53-baff-3b5201712ada None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:19:00.844626 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-24b0d752-00df-4d53-baff-3b5201712ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:00.853258 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1099/2219] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:19:00.859061 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b8ce1-b118-40d0-8e71-bc43f646fb12 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:00.870991 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b8ce1-b118-40d0-8e71-bc43f646fb12 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:00.875965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82560666-f2a4-49ec-832b-3da5bc6802cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:00.876785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82560666-f2a4-49ec-832b-3da5bc6802cd admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:00.877122 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82560666-f2a4-49ec-832b-3da5bc6802cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:00.877407 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82560666-f2a4-49ec-832b-3da5bc6802cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:00.878343 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82560666-f2a4-49ec-832b-3da5bc6802cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:19:00.878690 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82560666-f2a4-49ec-832b-3da5bc6802cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:00.880834 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82560666-f2a4-49ec-832b-3da5bc6802cd admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:00.899271 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1121/2220] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:19:00.905450 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0d752-00df-4d53-baff-3b5201712ada None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:00.915000 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0d752-00df-4d53-baff-3b5201712ada None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:00.920720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d725fd-e57e-4eeb-b70b-dad3a2104381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:00.921515 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d725fd-e57e-4eeb-b70b-dad3a2104381 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:00.921805 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d725fd-e57e-4eeb-b70b-dad3a2104381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:00.922189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d725fd-e57e-4eeb-b70b-dad3a2104381 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:00.922899 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d725fd-e57e-4eeb-b70b-dad3a2104381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:00.924922 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d725fd-e57e-4eeb-b70b-dad3a2104381 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:00.957196 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1100/2221] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:19:00 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:19:00.960858 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82560666-f2a4-49ec-832b-3da5bc6802cd admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:00.976256 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d725fd-e57e-4eeb-b70b-dad3a2104381 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:00.976532 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82560666-f2a4-49ec-832b-3da5bc6802cd admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:00.978154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-72d725fd-e57e-4eeb-b70b-dad3a2104381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:01.006269 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:01.049838 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467efb3-8fe6-4931-b7e9-ff60db6d438d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:01.050487 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467efb3-8fe6-4931-b7e9-ff60db6d438d admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:01.050780 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467efb3-8fe6-4931-b7e9-ff60db6d438d admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:01.051061 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467efb3-8fe6-4931-b7e9-ff60db6d438d admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:01.051754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467efb3-8fe6-4931-b7e9-ff60db6d438d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:01.053678 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467efb3-8fe6-4931-b7e9-ff60db6d438d admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:01.056630 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d725fd-e57e-4eeb-b70b-dad3a2104381 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:01.061416 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a260e-97c9-40c9-b1d7-9f4e1b9c6ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:01.062329 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a260e-97c9-40c9-b1d7-9f4e1b9c6ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:01.062618 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a260e-97c9-40c9-b1d7-9f4e1b9c6ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:01.062895 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a260e-97c9-40c9-b1d7-9f4e1b9c6ea8 admin admin] PATH_INFO: `/v3/projects/d0e48091f4ac460e864c532bad7634f1` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:01.064084 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a260e-97c9-40c9-b1d7-9f4e1b9c6ea8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0e48091f4ac460e864c532bad7634f1)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:01.065992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a260e-97c9-40c9-b1d7-9f4e1b9c6ea8 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:01.073243 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1122/2222] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:19:00 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:19:01.077368 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467efb3-8fe6-4931-b7e9-ff60db6d438d admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:01.086950 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467efb3-8fe6-4931-b7e9-ff60db6d438d admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:01.092125 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60dd5a-65da-4ef8-9bbc-efe9adc773f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:01.092811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60dd5a-65da-4ef8-9bbc-efe9adc773f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:01.093076 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60dd5a-65da-4ef8-9bbc-efe9adc773f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:01.093433 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60dd5a-65da-4ef8-9bbc-efe9adc773f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:01.094320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60dd5a-65da-4ef8-9bbc-efe9adc773f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:01.096113 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60dd5a-65da-4ef8-9bbc-efe9adc773f8 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:01.107575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1123/2223] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:19:01.111481 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60dd5a-65da-4ef8-9bbc-efe9adc773f8 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:01.118594 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-4d7a260e-97c9-40c9-b1d7-9f4e1b9c6ea8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0e48091f4ac460e864c532bad7634f1', 'request_id': 'req-4d7a260e-97c9-40c9-b1d7-9f4e1b9c6ea8'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:01.121055 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60dd5a-65da-4ef8-9bbc-efe9adc773f8 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:01.124745 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-4d7a260e-97c9-40c9-b1d7-9f4e1b9c6ea8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0e48091f4ac460e864c532bad7634f1', 'request_id': 'req-4d7a260e-97c9-40c9-b1d7-9f4e1b9c6ea8'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:01.132379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-4d7a260e-97c9-40c9-b1d7-9f4e1b9c6ea8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0e48091f4ac460e864c532bad7634f1', 'request_id': 'req-4d7a260e-97c9-40c9-b1d7-9f4e1b9c6ea8'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:01.141215 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:01.142756 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-4d7a260e-97c9-40c9-b1d7-9f4e1b9c6ea8 admin admin] The token cache is being invalidate because project d0e48091f4ac460e864c532bad7634f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:19:01.143107 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-4d7a260e-97c9-40c9-b1d7-9f4e1b9c6ea8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:01.143868 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-4d7a260e-97c9-40c9-b1d7-9f4e1b9c6ea8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:01.145619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1101/2224] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:19:00 2022] DELETE /identity/v3/projects/d0e48091f4ac460e864c532bad7634f1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:19:01.149323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a260e-97c9-40c9-b1d7-9f4e1b9c6ea8 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:01.151278 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-4d7a260e-97c9-40c9-b1d7-9f4e1b9c6ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:01.183324 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619be233-6c20-47ec-a49d-5bfaa75d7bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:01.184003 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619be233-6c20-47ec-a49d-5bfaa75d7bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:01.184297 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619be233-6c20-47ec-a49d-5bfaa75d7bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:01.184578 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619be233-6c20-47ec-a49d-5bfaa75d7bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:01.185331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619be233-6c20-47ec-a49d-5bfaa75d7bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:01.186974 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619be233-6c20-47ec-a49d-5bfaa75d7bc0 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:01.196764 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1124/2225] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:19:01.201560 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619be233-6c20-47ec-a49d-5bfaa75d7bc0 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:01.203960 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-619be233-6c20-47ec-a49d-5bfaa75d7bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:01.216381 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619be233-6c20-47ec-a49d-5bfaa75d7bc0 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:01.221045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a20629-af5a-41a8-86d1-b087fa8be2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:01.221931 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a20629-af5a-41a8-86d1-b087fa8be2e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:01.222246 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a20629-af5a-41a8-86d1-b087fa8be2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:01.222533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a20629-af5a-41a8-86d1-b087fa8be2e6 admin admin] PATH_INFO: `/v3/projects/694d81c3828e43ba91c55412d0e55196/users/a9fd2aee58ed4ba48b475562c3331ec9/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:01.230840 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a260e-97c9-40c9-b1d7-9f4e1b9c6ea8 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:01.235453 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b553a-3d0f-4ffa-82a7-f187678c0523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:01.236330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b553a-3d0f-4ffa-82a7-f187678c0523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:01.236619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b553a-3d0f-4ffa-82a7-f187678c0523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:01.236894 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b553a-3d0f-4ffa-82a7-f187678c0523 admin admin] PATH_INFO: `/v3/users/f8ad1bdcb8c4462f938debf6086166a5` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:01.238131 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b553a-3d0f-4ffa-82a7-f187678c0523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8ad1bdcb8c4462f938debf6086166a5)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:01.239477 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a20629-af5a-41a8-86d1-b087fa8be2e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=694d81c3828e43ba91c55412d0e55196, user_id=a9fd2aee58ed4ba48b475562c3331ec9, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:01.240080 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b553a-3d0f-4ffa-82a7-f187678c0523 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:01.242677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a20629-af5a-41a8-86d1-b087fa8be2e6 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:01.257383 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1125/2226] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:19:01 2022] PUT /identity/v3/projects/694d81c3828e43ba91c55412d0e55196/users/a9fd2aee58ed4ba48b475562c3331ec9/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:19:01.268644 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fcbc5-7598-40d9-bb44-a84c6765d704 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:01.268935 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fcbc5-7598-40d9-bb44-a84c6765d704 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:01.269292 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fcbc5-7598-40d9-bb44-a84c6765d704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:01.289028 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-972b553a-3d0f-4ffa-82a7-f187678c0523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8ad1bdcb8c4462f938debf6086166a5'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:01.289791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-972b553a-3d0f-4ffa-82a7-f187678c0523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8ad1bdcb8c4462f938debf6086166a5'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:01.291665 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:01.298473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-a25fcbc5-7598-40d9-bb44-a84c6765d704 None None] MFA Rules not processed for user `a9fd2aee58ed4ba48b475562c3331ec9`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:19:01.299305 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-972b553a-3d0f-4ffa-82a7-f187678c0523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8ad1bdcb8c4462f938debf6086166a5'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:01.299813 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a25fcbc5-7598-40d9-bb44-a84c6765d704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:01.308307 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-972b553a-3d0f-4ffa-82a7-f187678c0523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8ad1bdcb8c4462f938debf6086166a5'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:01.320216 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-972b553a-3d0f-4ffa-82a7-f187678c0523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8ad1bdcb8c4462f938debf6086166a5'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:01.328112 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1102/2227] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:19:01 2022] DELETE /identity/v3/users/f8ad1bdcb8c4462f938debf6086166a5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:19:01.375421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1126/2228] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:19:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:19:01.387507 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b553a-3d0f-4ffa-82a7-f187678c0523 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:01.389767 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-972b553a-3d0f-4ffa-82a7-f187678c0523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:01.461430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b553a-3d0f-4ffa-82a7-f187678c0523 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:01.465647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436e5ac-2b94-429b-9b30-875d2fcc3d56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:01.466337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436e5ac-2b94-429b-9b30-875d2fcc3d56 service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:01.467078 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436e5ac-2b94-429b-9b30-875d2fcc3d56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:01.467078 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436e5ac-2b94-429b-9b30-875d2fcc3d56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:01.537599 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436e5ac-2b94-429b-9b30-875d2fcc3d56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:01.539555 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436e5ac-2b94-429b-9b30-875d2fcc3d56 service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:01.552584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1103/2229] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:19:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:19:01.663013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fcbc5-7598-40d9-bb44-a84c6765d704 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:01.664427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a25fcbc5-7598-40d9-bb44-a84c6765d704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:01.777815 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fcbc5-7598-40d9-bb44-a84c6765d704 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:01.809831 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:01.847762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f6757-7df7-4128-8ba8-2b3a45a59a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:01.848985 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f6757-7df7-4128-8ba8-2b3a45a59a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:01.849600 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f6757-7df7-4128-8ba8-2b3a45a59a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:01.850070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f6757-7df7-4128-8ba8-2b3a45a59a7c admin admin] PATH_INFO: `/v3/projects/2688fb0c26174153901ea244a37d4637` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:01.851792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f6757-7df7-4128-8ba8-2b3a45a59a7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2688fb0c26174153901ea244a37d4637)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:01.855060 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f6757-7df7-4128-8ba8-2b3a45a59a7c admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:01.923877 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-4f0f6757-7df7-4128-8ba8-2b3a45a59a7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2688fb0c26174153901ea244a37d4637', 'request_id': 'req-4f0f6757-7df7-4128-8ba8-2b3a45a59a7c'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:01.933971 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-4f0f6757-7df7-4128-8ba8-2b3a45a59a7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2688fb0c26174153901ea244a37d4637', 'request_id': 'req-4f0f6757-7df7-4128-8ba8-2b3a45a59a7c'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:01.948520 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-4f0f6757-7df7-4128-8ba8-2b3a45a59a7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2688fb0c26174153901ea244a37d4637', 'request_id': 'req-4f0f6757-7df7-4128-8ba8-2b3a45a59a7c'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:01.981136 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-4f0f6757-7df7-4128-8ba8-2b3a45a59a7c admin admin] The token cache is being invalidate because project 2688fb0c26174153901ea244a37d4637 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:19:01.981433 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-4f0f6757-7df7-4128-8ba8-2b3a45a59a7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:01.986795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-4f0f6757-7df7-4128-8ba8-2b3a45a59a7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:01.989101 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1127/2230] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:19:01 2022] DELETE /identity/v3/projects/2688fb0c26174153901ea244a37d4637 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:19:01.993283 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436e5ac-2b94-429b-9b30-875d2fcc3d56 service cinder] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:02.005097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436e5ac-2b94-429b-9b30-875d2fcc3d56 service cinder] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:02.082014 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902e902-ee73-4b0d-9aa1-ad5ad7ed5809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:02.082945 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902e902-ee73-4b0d-9aa1-ad5ad7ed5809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:02.083245 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902e902-ee73-4b0d-9aa1-ad5ad7ed5809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:02.083521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902e902-ee73-4b0d-9aa1-ad5ad7ed5809 admin admin] PATH_INFO: `/v3/users/bff84e28df684c149536078fcbef5a2e` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:02.084746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0902e902-ee73-4b0d-9aa1-ad5ad7ed5809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bff84e28df684c149536078fcbef5a2e)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:02.087450 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0902e902-ee73-4b0d-9aa1-ad5ad7ed5809 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:02.125701 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:INSERT=1,keystone:DELETE=6,keystone:SELECT=93 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:02.157939 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-0902e902-ee73-4b0d-9aa1-ad5ad7ed5809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bff84e28df684c149536078fcbef5a2e'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:02.158699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-0902e902-ee73-4b0d-9aa1-ad5ad7ed5809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bff84e28df684c149536078fcbef5a2e'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:02.168336 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-0902e902-ee73-4b0d-9aa1-ad5ad7ed5809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bff84e28df684c149536078fcbef5a2e'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:02.175557 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-0902e902-ee73-4b0d-9aa1-ad5ad7ed5809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bff84e28df684c149536078fcbef5a2e'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:02.187665 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-0902e902-ee73-4b0d-9aa1-ad5ad7ed5809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bff84e28df684c149536078fcbef5a2e'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:02.194378 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1104/2231] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:19:01 2022] DELETE /identity/v3/users/bff84e28df684c149536078fcbef5a2e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:19:02.630751 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f6757-7df7-4128-8ba8-2b3a45a59a7c admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:02.635465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-4f0f6757-7df7-4128-8ba8-2b3a45a59a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:02.653028 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f6757-7df7-4128-8ba8-2b3a45a59a7c admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:02.728480 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f319697-f72b-44f1-8027-27cda34d2ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:02.729452 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f319697-f72b-44f1-8027-27cda34d2ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:02.729744 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f319697-f72b-44f1-8027-27cda34d2ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:02.730030 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f319697-f72b-44f1-8027-27cda34d2ca2 admin admin] PATH_INFO: `/v3/projects/a54e23ea7a8748449b526f5a7d7be1fe` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:02.731301 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f319697-f72b-44f1-8027-27cda34d2ca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a54e23ea7a8748449b526f5a7d7be1fe)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:02.733254 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f319697-f72b-44f1-8027-27cda34d2ca2 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:02.798663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5f319697-f72b-44f1-8027-27cda34d2ca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a54e23ea7a8748449b526f5a7d7be1fe', 'request_id': 'req-5f319697-f72b-44f1-8027-27cda34d2ca2'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:02.807955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5f319697-f72b-44f1-8027-27cda34d2ca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a54e23ea7a8748449b526f5a7d7be1fe', 'request_id': 'req-5f319697-f72b-44f1-8027-27cda34d2ca2'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:02.819370 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5f319697-f72b-44f1-8027-27cda34d2ca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a54e23ea7a8748449b526f5a7d7be1fe', 'request_id': 'req-5f319697-f72b-44f1-8027-27cda34d2ca2'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:02.823052 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:02.836701 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5f319697-f72b-44f1-8027-27cda34d2ca2 admin admin] The token cache is being invalidate because project a54e23ea7a8748449b526f5a7d7be1fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:19:02.837059 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5f319697-f72b-44f1-8027-27cda34d2ca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:02.838401 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5f319697-f72b-44f1-8027-27cda34d2ca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:02.840420 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1128/2232] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:19:02 2022] DELETE /identity/v3/projects/a54e23ea7a8748449b526f5a7d7be1fe => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:19:06.339455 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230041f5-485a-46ed-9b0b-d8155cbaa932 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:06.339948 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230041f5-485a-46ed-9b0b-d8155cbaa932 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:06.340042 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230041f5-485a-46ed-9b0b-d8155cbaa932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:06.359898 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-230041f5-485a-46ed-9b0b-d8155cbaa932 None None] MFA Rules not processed for user `72f556aac45c460cb573498aab7590fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:19:06.361121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-230041f5-485a-46ed-9b0b-d8155cbaa932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:06.421064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1105/2233] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Jul 12 13:19:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:19:06.469315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f319697-f72b-44f1-8027-27cda34d2ca2 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:06.470803 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-5f319697-f72b-44f1-8027-27cda34d2ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:06.553858 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f319697-f72b-44f1-8027-27cda34d2ca2 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:06.561159 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbb31b-7b95-49f5-ab95-f6385ba8637d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe10f0f42b8247c99ed5f88eff5065e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:06.561817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbb31b-7b95-49f5-ab95-f6385ba8637d service swift] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:06.562101 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbb31b-7b95-49f5-ab95-f6385ba8637d service swift] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:06.562481 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbb31b-7b95-49f5-ab95-f6385ba8637d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:06.571567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcbb31b-7b95-49f5-ab95-f6385ba8637d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:06.573655 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcbb31b-7b95-49f5-ab95-f6385ba8637d service swift] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:06.583186 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1129/2234] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Jul 12 13:19:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:19:12.325823 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230041f5-485a-46ed-9b0b-d8155cbaa932 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:12.328625 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-230041f5-485a-46ed-9b0b-d8155cbaa932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:12.474417 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230041f5-485a-46ed-9b0b-d8155cbaa932 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:12.482079 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb2b8d-9f0a-4f56-8cde-a8f1348333f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:12.483524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb2b8d-9f0a-4f56-8cde-a8f1348333f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:12.484010 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb2b8d-9f0a-4f56-8cde-a8f1348333f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:12.484559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb2b8d-9f0a-4f56-8cde-a8f1348333f9 admin admin] PATH_INFO: `/v3/users/a9fd2aee58ed4ba48b475562c3331ec9` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:12.486106 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb2b8d-9f0a-4f56-8cde-a8f1348333f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9fd2aee58ed4ba48b475562c3331ec9)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:12.488817 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb2b8d-9f0a-4f56-8cde-a8f1348333f9 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:12.596207 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:12.602018 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-c3cb2b8d-9f0a-4f56-8cde-a8f1348333f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9fd2aee58ed4ba48b475562c3331ec9'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:12.605439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-c3cb2b8d-9f0a-4f56-8cde-a8f1348333f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9fd2aee58ed4ba48b475562c3331ec9'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:12.622158 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-c3cb2b8d-9f0a-4f56-8cde-a8f1348333f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9fd2aee58ed4ba48b475562c3331ec9'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:12.633364 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-c3cb2b8d-9f0a-4f56-8cde-a8f1348333f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9fd2aee58ed4ba48b475562c3331ec9'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:12.651007 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-c3cb2b8d-9f0a-4f56-8cde-a8f1348333f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9fd2aee58ed4ba48b475562c3331ec9'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:12.659417 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1106/2235] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:19:12 2022] DELETE /identity/v3/users/a9fd2aee58ed4ba48b475562c3331ec9 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:19:12.662513 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d65629-5e14-4c49-a504-79e39dcb2e64 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:12.663069 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d65629-5e14-4c49-a504-79e39dcb2e64 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:12.663927 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d65629-5e14-4c49-a504-79e39dcb2e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:12.683909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-91d65629-5e14-4c49-a504-79e39dcb2e64 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:19:12.685252 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-91d65629-5e14-4c49-a504-79e39dcb2e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:12.767295 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1130/2236] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:19:12.781830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb2b8d-9f0a-4f56-8cde-a8f1348333f9 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:12.783479 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-c3cb2b8d-9f0a-4f56-8cde-a8f1348333f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:12.845936 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb2b8d-9f0a-4f56-8cde-a8f1348333f9 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:12.856247 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ee153-e246-49ca-8d1a-9a1d01f8701d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:12.856915 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ee153-e246-49ca-8d1a-9a1d01f8701d service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:12.857198 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ee153-e246-49ca-8d1a-9a1d01f8701d service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:12.857499 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ee153-e246-49ca-8d1a-9a1d01f8701d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:12.867410 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ee153-e246-49ca-8d1a-9a1d01f8701d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:12.869480 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ee153-e246-49ca-8d1a-9a1d01f8701d service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:12.879650 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1107/2237] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:19:13.220219 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d65629-5e14-4c49-a504-79e39dcb2e64 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:13.221676 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-91d65629-5e14-4c49-a504-79e39dcb2e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:13.240801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d65629-5e14-4c49-a504-79e39dcb2e64 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:13.274322 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8618f-f3c3-478f-86cd-f1b005db5c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:13.275805 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8618f-f3c3-478f-86cd-f1b005db5c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:13.276086 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8618f-f3c3-478f-86cd-f1b005db5c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:13.276362 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8618f-f3c3-478f-86cd-f1b005db5c91 admin admin] PATH_INFO: `/v3/projects/694d81c3828e43ba91c55412d0e55196` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:13.277739 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8618f-f3c3-478f-86cd-f1b005db5c91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=694d81c3828e43ba91c55412d0e55196)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:13.279946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8618f-f3c3-478f-86cd-f1b005db5c91 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:13.442271 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-def8618f-f3c3-478f-86cd-f1b005db5c91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '694d81c3828e43ba91c55412d0e55196', 'request_id': 'req-def8618f-f3c3-478f-86cd-f1b005db5c91'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:13.442271 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-def8618f-f3c3-478f-86cd-f1b005db5c91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '694d81c3828e43ba91c55412d0e55196', 'request_id': 'req-def8618f-f3c3-478f-86cd-f1b005db5c91'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:13.453441 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-def8618f-f3c3-478f-86cd-f1b005db5c91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '694d81c3828e43ba91c55412d0e55196', 'request_id': 'req-def8618f-f3c3-478f-86cd-f1b005db5c91'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:13.467803 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-def8618f-f3c3-478f-86cd-f1b005db5c91 admin admin] The token cache is being invalidate because project 694d81c3828e43ba91c55412d0e55196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:19:13.468194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-def8618f-f3c3-478f-86cd-f1b005db5c91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:13.468964 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-def8618f-f3c3-478f-86cd-f1b005db5c91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:13.470574 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1131/2238] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:19:13 2022] DELETE /identity/v3/projects/694d81c3828e43ba91c55412d0e55196 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:19:18.198230 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34bafb-9bab-4239-aeb6-1f770fd9e9b0 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:18.198862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34bafb-9bab-4239-aeb6-1f770fd9e9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:18.199249 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34bafb-9bab-4239-aeb6-1f770fd9e9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:18.222416 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-aa34bafb-9bab-4239-aeb6-1f770fd9e9b0 None None] MFA Rules not processed for user `f558b5ee5b5e43f4894d350fc73df0f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:19:18.224073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-aa34bafb-9bab-4239-aeb6-1f770fd9e9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:18.297988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1108/2239] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:19:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:19:23.466911 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:24.842800 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db53df-3376-4718-bcac-aa6b79425a74 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:24.843441 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db53df-3376-4718-bcac-aa6b79425a74 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:24.843441 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db53df-3376-4718-bcac-aa6b79425a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:24.864663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-20db53df-3376-4718-bcac-aa6b79425a74 None None] MFA Rules not processed for user `72f556aac45c460cb573498aab7590fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:19:24.866834 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-20db53df-3376-4718-bcac-aa6b79425a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:24.961790 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1132/2240] 10.222.0.17 () {58 vars in 967 bytes} [Tue Jul 12 13:19:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:19:24.977283 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34bafb-9bab-4239-aeb6-1f770fd9e9b0 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:24.978867 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-aa34bafb-9bab-4239-aeb6-1f770fd9e9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:25.055431 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34bafb-9bab-4239-aeb6-1f770fd9e9b0 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:25.061974 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5254716-dec1-4389-8673-568c4cb334d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe10f0f42b8247c99ed5f88eff5065e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:25.062938 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5254716-dec1-4389-8673-568c4cb334d2 service swift] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:25.063185 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5254716-dec1-4389-8673-568c4cb334d2 service swift] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:25.063574 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5254716-dec1-4389-8673-568c4cb334d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:25.073173 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5254716-dec1-4389-8673-568c4cb334d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:25.074950 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5254716-dec1-4389-8673-568c4cb334d2 service swift] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:25.082155 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:25.087227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1109/2241] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Jul 12 13:19:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:19:27.462696 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db53df-3376-4718-bcac-aa6b79425a74 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:27.465015 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-20db53df-3376-4718-bcac-aa6b79425a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:27.561222 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db53df-3376-4718-bcac-aa6b79425a74 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:27.566148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f3251-5c35-4c1f-bbdb-4cca50a06eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:27.567497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f3251-5c35-4c1f-bbdb-4cca50a06eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:27.567947 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f3251-5c35-4c1f-bbdb-4cca50a06eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:27.568537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f3251-5c35-4c1f-bbdb-4cca50a06eba admin admin] PATH_INFO: `/v3/users/e427cded71b24920b908dc09fb75d5ec` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:27.570094 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f3251-5c35-4c1f-bbdb-4cca50a06eba admin admin] RBAC: Authorizing `identity:delete_user(user_id=e427cded71b24920b908dc09fb75d5ec)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:27.572945 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f3251-5c35-4c1f-bbdb-4cca50a06eba admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:27.650324 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-3e2f3251-5c35-4c1f-bbdb-4cca50a06eba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e427cded71b24920b908dc09fb75d5ec'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:27.662405 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-3e2f3251-5c35-4c1f-bbdb-4cca50a06eba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e427cded71b24920b908dc09fb75d5ec'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:27.683101 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-3e2f3251-5c35-4c1f-bbdb-4cca50a06eba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e427cded71b24920b908dc09fb75d5ec'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:27.684789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-3e2f3251-5c35-4c1f-bbdb-4cca50a06eba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e427cded71b24920b908dc09fb75d5ec'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:27.705740 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-3e2f3251-5c35-4c1f-bbdb-4cca50a06eba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e427cded71b24920b908dc09fb75d5ec'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:27.714479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1133/2242] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:19:27 2022] DELETE /identity/v3/users/e427cded71b24920b908dc09fb75d5ec => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:19:27.973277 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5254716-dec1-4389-8673-568c4cb334d2 service swift] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:27.992646 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5254716-dec1-4389-8673-568c4cb334d2 service swift] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:28.063145 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90b762-306c-4909-8dd1-6d5dc9796413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:28.064025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90b762-306c-4909-8dd1-6d5dc9796413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:28.064312 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90b762-306c-4909-8dd1-6d5dc9796413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:28.064596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90b762-306c-4909-8dd1-6d5dc9796413 admin admin] PATH_INFO: `/v3/projects/638dfb23bfc445e392691283776872c7` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:28.065810 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90b762-306c-4909-8dd1-6d5dc9796413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=638dfb23bfc445e392691283776872c7)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:28.067780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90b762-306c-4909-8dd1-6d5dc9796413 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:28.117316 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-6e90b762-306c-4909-8dd1-6d5dc9796413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '638dfb23bfc445e392691283776872c7', 'request_id': 'req-6e90b762-306c-4909-8dd1-6d5dc9796413'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:28.126844 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-6e90b762-306c-4909-8dd1-6d5dc9796413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '638dfb23bfc445e392691283776872c7', 'request_id': 'req-6e90b762-306c-4909-8dd1-6d5dc9796413'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:28.138705 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-6e90b762-306c-4909-8dd1-6d5dc9796413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '638dfb23bfc445e392691283776872c7', 'request_id': 'req-6e90b762-306c-4909-8dd1-6d5dc9796413'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:28.153514 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-6e90b762-306c-4909-8dd1-6d5dc9796413 admin admin] The token cache is being invalidate because project 638dfb23bfc445e392691283776872c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:19:28.153807 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-6e90b762-306c-4909-8dd1-6d5dc9796413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:28.154551 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-6e90b762-306c-4909-8dd1-6d5dc9796413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:28.156170 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1110/2243] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:19:27 2022] DELETE /identity/v3/projects/638dfb23bfc445e392691283776872c7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:19:28.162066 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34c667-b9c1-4f21-914c-59677777e68a None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:28.162390 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34c667-b9c1-4f21-914c-59677777e68a None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:28.162669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34c667-b9c1-4f21-914c-59677777e68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:28.181678 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-3c34c667-b9c1-4f21-914c-59677777e68a None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:19:28.182938 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-3c34c667-b9c1-4f21-914c-59677777e68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:28.202652 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:28.251451 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1134/2244] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:19:28.259774 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2ae60-6dfe-448d-a3cf-ee64f121b415 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:28.260065 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2ae60-6dfe-448d-a3cf-ee64f121b415 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:28.260348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2ae60-6dfe-448d-a3cf-ee64f121b415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:28.280509 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-a3f2ae60-6dfe-448d-a3cf-ee64f121b415 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:19:28.281740 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-a3f2ae60-6dfe-448d-a3cf-ee64f121b415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:28.291160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1111/2245] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:19:28.295764 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34c667-b9c1-4f21-914c-59677777e68a None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:28.307862 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34c667-b9c1-4f21-914c-59677777e68a None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:28.314964 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af107eb-740e-47b2-9f93-96aa57e5fb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:28.315982 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af107eb-740e-47b2-9f93-96aa57e5fb08 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:28.316444 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af107eb-740e-47b2-9f93-96aa57e5fb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:28.316843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af107eb-740e-47b2-9f93-96aa57e5fb08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:28.317579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af107eb-740e-47b2-9f93-96aa57e5fb08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:19:28.317891 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af107eb-740e-47b2-9f93-96aa57e5fb08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:28.319557 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af107eb-740e-47b2-9f93-96aa57e5fb08 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:28.332751 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1135/2246] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:19:28.337335 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2ae60-6dfe-448d-a3cf-ee64f121b415 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:28.346766 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2ae60-6dfe-448d-a3cf-ee64f121b415 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:28.351478 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf709b6-085c-4f38-bad2-f263bd035585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:28.352193 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf709b6-085c-4f38-bad2-f263bd035585 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:28.353007 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf709b6-085c-4f38-bad2-f263bd035585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:28.353330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf709b6-085c-4f38-bad2-f263bd035585 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:28.354498 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf709b6-085c-4f38-bad2-f263bd035585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:28.356403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf709b6-085c-4f38-bad2-f263bd035585 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:28.383439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1112/2247] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:19:28 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:19:28.388033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af107eb-740e-47b2-9f93-96aa57e5fb08 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:28.398369 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af107eb-740e-47b2-9f93-96aa57e5fb08 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:28.469790 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8abc42-ae60-4b0a-82e4-64ab4b224438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:28.470480 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8abc42-ae60-4b0a-82e4-64ab4b224438 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:28.470744 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8abc42-ae60-4b0a-82e4-64ab4b224438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:28.471020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8abc42-ae60-4b0a-82e4-64ab4b224438 admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:28.471712 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8abc42-ae60-4b0a-82e4-64ab4b224438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:28.473660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8abc42-ae60-4b0a-82e4-64ab4b224438 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:28.496878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1136/2248] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:19:28 2022] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:19:28.501297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf709b6-085c-4f38-bad2-f263bd035585 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:28.513709 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf709b6-085c-4f38-bad2-f263bd035585 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:28.518808 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeec6c-f682-463a-8653-a6e1b8be3010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:28.519502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeec6c-f682-463a-8653-a6e1b8be3010 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:28.519786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeec6c-f682-463a-8653-a6e1b8be3010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:28.520061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeec6c-f682-463a-8653-a6e1b8be3010 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:28.520791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdeec6c-f682-463a-8653-a6e1b8be3010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:28.522446 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdeec6c-f682-463a-8653-a6e1b8be3010 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:28.533992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1113/2249] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:19:28.537964 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8abc42-ae60-4b0a-82e4-64ab4b224438 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:28.553779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8abc42-ae60-4b0a-82e4-64ab4b224438 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:28.559368 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ffa37-1612-45a5-8701-9e8114852903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:28.560067 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ffa37-1612-45a5-8701-9e8114852903 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:28.560357 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ffa37-1612-45a5-8701-9e8114852903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:28.560636 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ffa37-1612-45a5-8701-9e8114852903 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:28.561421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ffa37-1612-45a5-8701-9e8114852903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:28.563164 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ffa37-1612-45a5-8701-9e8114852903 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:28.576315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1137/2250] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:19:28.586955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeec6c-f682-463a-8653-a6e1b8be3010 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:28.597187 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeec6c-f682-463a-8653-a6e1b8be3010 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:28.604875 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434e508-10d0-4a0d-b5f4-f9622cf6d087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:28.605812 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434e508-10d0-4a0d-b5f4-f9622cf6d087 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:28.606100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434e508-10d0-4a0d-b5f4-f9622cf6d087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:28.606409 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434e508-10d0-4a0d-b5f4-f9622cf6d087 admin admin] PATH_INFO: `/v3/projects/91f9b532a7d24341a8ee080169b56dd4/users/ec8527a2d31c4f32ac9316f2998ac7a2/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:28.623183 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434e508-10d0-4a0d-b5f4-f9622cf6d087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91f9b532a7d24341a8ee080169b56dd4, user_id=ec8527a2d31c4f32ac9316f2998ac7a2, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:28.625919 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434e508-10d0-4a0d-b5f4-f9622cf6d087 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:28.642835 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1114/2251] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:19:28 2022] PUT /identity/v3/projects/91f9b532a7d24341a8ee080169b56dd4/users/ec8527a2d31c4f32ac9316f2998ac7a2/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:19:28.653111 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc5ffc-d85b-4363-9f75-29fefca23ec5 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:28.653404 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc5ffc-d85b-4363-9f75-29fefca23ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:28.653686 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc5ffc-d85b-4363-9f75-29fefca23ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:28.689122 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-a2cc5ffc-d85b-4363-9f75-29fefca23ec5 None None] MFA Rules not processed for user `ec8527a2d31c4f32ac9316f2998ac7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:19:28.690396 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a2cc5ffc-d85b-4363-9f75-29fefca23ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:28.768211 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1138/2252] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:19:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:19:28.782314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434e508-10d0-4a0d-b5f4-f9622cf6d087 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:28.784583 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-b434e508-10d0-4a0d-b5f4-f9622cf6d087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:28.840694 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:28.913813 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434e508-10d0-4a0d-b5f4-f9622cf6d087 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:28.918811 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d3a7c-c0ad-4627-8178-c1104c0897ea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7af0259f7f24dfdafbdfc1f613ebb42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:28.919567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d3a7c-c0ad-4627-8178-c1104c0897ea service glance] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:28.919858 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d3a7c-c0ad-4627-8178-c1104c0897ea service glance] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:28.920144 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d3a7c-c0ad-4627-8178-c1104c0897ea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:28.930331 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d3a7c-c0ad-4627-8178-c1104c0897ea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:28.932699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d3a7c-c0ad-4627-8178-c1104c0897ea service glance] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:28.945251 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1115/2253] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:19:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:19:30.504757 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca964949-5557-43b3-bb3b-e5c922fe2731 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:30.505668 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca964949-5557-43b3-bb3b-e5c922fe2731 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:30.506020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca964949-5557-43b3-bb3b-e5c922fe2731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:30.527417 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-ca964949-5557-43b3-bb3b-e5c922fe2731 None None] MFA Rules not processed for user `155dfbdcace94d9d93d8d4758fbcb372`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:19:30.528788 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-ca964949-5557-43b3-bb3b-e5c922fe2731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:30.543415 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:30.593662 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1139/2254] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:19:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:19:38.938887 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=23 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:40.586433 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=16 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:52.854856 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d3a7c-c0ad-4627-8178-c1104c0897ea service glance] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:52.916468 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d3a7c-c0ad-4627-8178-c1104c0897ea service glance] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:52.921026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba8297-9e62-4097-b068-89278efe6dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:52.921899 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba8297-9e62-4097-b068-89278efe6dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:52.922216 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba8297-9e62-4097-b068-89278efe6dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:52.922503 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba8297-9e62-4097-b068-89278efe6dee admin admin] PATH_INFO: `/v3/users/ec8527a2d31c4f32ac9316f2998ac7a2` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:52.923694 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba8297-9e62-4097-b068-89278efe6dee admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec8527a2d31c4f32ac9316f2998ac7a2)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:52.925618 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba8297-9e62-4097-b068-89278efe6dee admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:52.972683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-77ba8297-9e62-4097-b068-89278efe6dee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec8527a2d31c4f32ac9316f2998ac7a2'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:52.973347 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-77ba8297-9e62-4097-b068-89278efe6dee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec8527a2d31c4f32ac9316f2998ac7a2'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:52.980982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-77ba8297-9e62-4097-b068-89278efe6dee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec8527a2d31c4f32ac9316f2998ac7a2'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:52.989093 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-77ba8297-9e62-4097-b068-89278efe6dee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec8527a2d31c4f32ac9316f2998ac7a2'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:53.001979 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-77ba8297-9e62-4097-b068-89278efe6dee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec8527a2d31c4f32ac9316f2998ac7a2'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:53.008230 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1116/2255] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:19:52 2022] DELETE /identity/v3/users/ec8527a2d31c4f32ac9316f2998ac7a2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:19:53.012810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a602a-22c1-4ec6-a33d-ec0fa54ec284 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:53.013350 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a602a-22c1-4ec6-a33d-ec0fa54ec284 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:53.013350 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a602a-22c1-4ec6-a33d-ec0fa54ec284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:53.031651 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-992a602a-22c1-4ec6-a33d-ec0fa54ec284 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:19:53.032866 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-992a602a-22c1-4ec6-a33d-ec0fa54ec284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:53.092467 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1140/2256] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:19:53.102932 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba8297-9e62-4097-b068-89278efe6dee admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:53.104376 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-77ba8297-9e62-4097-b068-89278efe6dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:53.163090 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba8297-9e62-4097-b068-89278efe6dee admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:53.167015 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b549f6e-de9a-44f0-85bb-28baa2e04430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:53.167847 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b549f6e-de9a-44f0-85bb-28baa2e04430 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:53.168041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b549f6e-de9a-44f0-85bb-28baa2e04430 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:53.168321 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b549f6e-de9a-44f0-85bb-28baa2e04430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:53.178831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b549f6e-de9a-44f0-85bb-28baa2e04430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:53.180294 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b549f6e-de9a-44f0-85bb-28baa2e04430 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:53.196813 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1117/2257] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:19:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:19:53.472944 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a602a-22c1-4ec6-a33d-ec0fa54ec284 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:53.474515 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-992a602a-22c1-4ec6-a33d-ec0fa54ec284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:53.487834 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a602a-22c1-4ec6-a33d-ec0fa54ec284 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:53.492750 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e07b77-b686-4ae2-9635-763566340bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:53.494176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e07b77-b686-4ae2-9635-763566340bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:53.494463 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e07b77-b686-4ae2-9635-763566340bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:53.494738 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e07b77-b686-4ae2-9635-763566340bb6 admin admin] PATH_INFO: `/v3/projects/91f9b532a7d24341a8ee080169b56dd4` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:53.495951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e07b77-b686-4ae2-9635-763566340bb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91f9b532a7d24341a8ee080169b56dd4)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:53.497931 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e07b77-b686-4ae2-9635-763566340bb6 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:53.551797 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-c5e07b77-b686-4ae2-9635-763566340bb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91f9b532a7d24341a8ee080169b56dd4', 'request_id': 'req-c5e07b77-b686-4ae2-9635-763566340bb6'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:53.558492 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-c5e07b77-b686-4ae2-9635-763566340bb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91f9b532a7d24341a8ee080169b56dd4', 'request_id': 'req-c5e07b77-b686-4ae2-9635-763566340bb6'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:53.566503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-c5e07b77-b686-4ae2-9635-763566340bb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91f9b532a7d24341a8ee080169b56dd4', 'request_id': 'req-c5e07b77-b686-4ae2-9635-763566340bb6'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:53.577720 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-c5e07b77-b686-4ae2-9635-763566340bb6 admin admin] The token cache is being invalidate because project 91f9b532a7d24341a8ee080169b56dd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:19:53.578068 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-c5e07b77-b686-4ae2-9635-763566340bb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:53.578922 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-c5e07b77-b686-4ae2-9635-763566340bb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:19:53.580501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1141/2258] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:19:53 2022] DELETE /identity/v3/projects/91f9b532a7d24341a8ee080169b56dd4 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:19:53.585645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708208d1-b36c-4377-bf99-3486991fd255 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:53.585935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708208d1-b36c-4377-bf99-3486991fd255 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:53.586240 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708208d1-b36c-4377-bf99-3486991fd255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:53.611805 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-708208d1-b36c-4377-bf99-3486991fd255 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:19:53.613907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-708208d1-b36c-4377-bf99-3486991fd255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:53.638842 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:53.695804 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1118/2259] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:19:53.705310 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c35095-d227-447f-82a0-a7cd79c42033 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:53.705601 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c35095-d227-447f-82a0-a7cd79c42033 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:53.705882 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c35095-d227-447f-82a0-a7cd79c42033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:53.725318 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-c1c35095-d227-447f-82a0-a7cd79c42033 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:19:53.726679 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-c1c35095-d227-447f-82a0-a7cd79c42033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:53.735572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1142/2260] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:19:53.739847 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708208d1-b36c-4377-bf99-3486991fd255 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:53.749925 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708208d1-b36c-4377-bf99-3486991fd255 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:53.754779 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370c5d5-2eb4-451e-88d9-d408fda81b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:53.755451 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370c5d5-2eb4-451e-88d9-d408fda81b1d admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:53.755741 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370c5d5-2eb4-451e-88d9-d408fda81b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:53.756022 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370c5d5-2eb4-451e-88d9-d408fda81b1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:53.757040 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370c5d5-2eb4-451e-88d9-d408fda81b1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:19:53.757356 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370c5d5-2eb4-451e-88d9-d408fda81b1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:53.759012 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370c5d5-2eb4-451e-88d9-d408fda81b1d admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:53.771469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1119/2261] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:19:53.776287 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c35095-d227-447f-82a0-a7cd79c42033 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:53.785718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c35095-d227-447f-82a0-a7cd79c42033 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:53.791420 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861a874-bb02-4b39-b1f4-2ce6dfdfdb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:53.792097 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861a874-bb02-4b39-b1f4-2ce6dfdfdb01 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:53.792387 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861a874-bb02-4b39-b1f4-2ce6dfdfdb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:53.792670 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861a874-bb02-4b39-b1f4-2ce6dfdfdb01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:53.793368 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861a874-bb02-4b39-b1f4-2ce6dfdfdb01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:53.795314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861a874-bb02-4b39-b1f4-2ce6dfdfdb01 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:53.821790 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1143/2262] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:19:53 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:19:53.825921 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370c5d5-2eb4-451e-88d9-d408fda81b1d admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:53.837645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370c5d5-2eb4-451e-88d9-d408fda81b1d admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:53.898059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229bec0-254f-4ead-a4d6-92e21b45084f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:53.898772 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229bec0-254f-4ead-a4d6-92e21b45084f admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:53.899046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229bec0-254f-4ead-a4d6-92e21b45084f admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:53.899938 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229bec0-254f-4ead-a4d6-92e21b45084f admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:53.900640 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229bec0-254f-4ead-a4d6-92e21b45084f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:53.902582 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229bec0-254f-4ead-a4d6-92e21b45084f admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:53.922046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1120/2263] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:19:53 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:19:53.926100 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861a874-bb02-4b39-b1f4-2ce6dfdfdb01 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:53.936535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861a874-bb02-4b39-b1f4-2ce6dfdfdb01 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:53.941114 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c981b-ead9-4475-aac6-6a3bd8380cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:53.941786 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c981b-ead9-4475-aac6-6a3bd8380cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:53.942069 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c981b-ead9-4475-aac6-6a3bd8380cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:53.942380 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c981b-ead9-4475-aac6-6a3bd8380cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:53.943098 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c981b-ead9-4475-aac6-6a3bd8380cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:53.944695 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c981b-ead9-4475-aac6-6a3bd8380cd1 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:53.955676 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1144/2264] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:19:53.959709 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229bec0-254f-4ead-a4d6-92e21b45084f admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:53.970461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229bec0-254f-4ead-a4d6-92e21b45084f admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:53.975243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02baa74-a807-4d67-8f44-688ed5c3a9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:53.975917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02baa74-a807-4d67-8f44-688ed5c3a9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:53.976207 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02baa74-a807-4d67-8f44-688ed5c3a9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:53.976495 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02baa74-a807-4d67-8f44-688ed5c3a9d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:53.977215 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02baa74-a807-4d67-8f44-688ed5c3a9d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:53.978878 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02baa74-a807-4d67-8f44-688ed5c3a9d6 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:53.989227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1121/2265] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:19:53.993555 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c981b-ead9-4475-aac6-6a3bd8380cd1 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:54.003624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c981b-ead9-4475-aac6-6a3bd8380cd1 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:54.008527 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea36da1-6ac8-4e2c-b3f0-29fd713195a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:54.009915 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea36da1-6ac8-4e2c-b3f0-29fd713195a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:54.010230 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea36da1-6ac8-4e2c-b3f0-29fd713195a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:54.010512 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea36da1-6ac8-4e2c-b3f0-29fd713195a2 admin admin] PATH_INFO: `/v3/projects/7f2fe3130454491384ebdfbc4ceb6679/users/f25f35f5c4154efa967cf1c82c9f0e5b/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:54.025944 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea36da1-6ac8-4e2c-b3f0-29fd713195a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2fe3130454491384ebdfbc4ceb6679, user_id=f25f35f5c4154efa967cf1c82c9f0e5b, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:54.028628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea36da1-6ac8-4e2c-b3f0-29fd713195a2 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:54.041791 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1145/2266] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:19:53 2022] PUT /identity/v3/projects/7f2fe3130454491384ebdfbc4ceb6679/users/f25f35f5c4154efa967cf1c82c9f0e5b/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:19:54.047104 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c57cc2-c582-41f8-9cbc-5e02016f5485 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:54.047402 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c57cc2-c582-41f8-9cbc-5e02016f5485 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:54.047687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c57cc2-c582-41f8-9cbc-5e02016f5485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:54.065935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-84c57cc2-c582-41f8-9cbc-5e02016f5485 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:19:54.067190 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-84c57cc2-c582-41f8-9cbc-5e02016f5485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:54.129567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1122/2267] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:19:54.138637 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea36da1-6ac8-4e2c-b3f0-29fd713195a2 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:54.140480 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-2ea36da1-6ac8-4e2c-b3f0-29fd713195a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:54.163529 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:54.200671 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea36da1-6ac8-4e2c-b3f0-29fd713195a2 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:54.204690 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1753c96-6b23-4a4d-a738-765b7b566b78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:54.205345 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1753c96-6b23-4a4d-a738-765b7b566b78 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:54.205635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1753c96-6b23-4a4d-a738-765b7b566b78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:54.205919 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1753c96-6b23-4a4d-a738-765b7b566b78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:54.215212 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1753c96-6b23-4a4d-a738-765b7b566b78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:54.216664 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1753c96-6b23-4a4d-a738-765b7b566b78 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:54.226686 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1146/2268] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:19:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:19:58.002420 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91752819-1f4c-449e-825e-6250b7e873fc None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:58.002981 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91752819-1f4c-449e-825e-6250b7e873fc None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:58.002981 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91752819-1f4c-449e-825e-6250b7e873fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:58.032449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-91752819-1f4c-449e-825e-6250b7e873fc None None] MFA Rules not processed for user `f25f35f5c4154efa967cf1c82c9f0e5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:19:58.033593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-91752819-1f4c-449e-825e-6250b7e873fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:19:58.051169 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:58.103082 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1123/2269] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:19:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:19:58.107606 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1753c96-6b23-4a4d-a738-765b7b566b78 service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:58.117406 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1753c96-6b23-4a4d-a738-765b7b566b78 service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:58.122899 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10305d9a-1946-4cbc-98c3-404343de3b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:58.123586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10305d9a-1946-4cbc-98c3-404343de3b66 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:58.123907 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10305d9a-1946-4cbc-98c3-404343de3b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:58.124191 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10305d9a-1946-4cbc-98c3-404343de3b66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:58.124909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10305d9a-1946-4cbc-98c3-404343de3b66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:58.126892 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10305d9a-1946-4cbc-98c3-404343de3b66 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:58.155282 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1147/2270] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:19:58 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:19:58.159624 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91752819-1f4c-449e-825e-6250b7e873fc None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:58.170821 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91752819-1f4c-449e-825e-6250b7e873fc None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:58.243556 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b89ad-b931-424d-8ce2-1d935322ace5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:58.244250 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b89ad-b931-424d-8ce2-1d935322ace5 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:58.244536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b89ad-b931-424d-8ce2-1d935322ace5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:58.244813 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b89ad-b931-424d-8ce2-1d935322ace5 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:58.245513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b89ad-b931-424d-8ce2-1d935322ace5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:58.247610 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b89ad-b931-424d-8ce2-1d935322ace5 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:58.270847 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1124/2271] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:19:58 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:19:58.274817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10305d9a-1946-4cbc-98c3-404343de3b66 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:58.285744 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10305d9a-1946-4cbc-98c3-404343de3b66 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:58.291171 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278e279-bda6-42f0-b9e2-46b49575148e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:58.291944 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278e279-bda6-42f0-b9e2-46b49575148e admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:58.292237 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278e279-bda6-42f0-b9e2-46b49575148e admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:58.292554 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278e279-bda6-42f0-b9e2-46b49575148e admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:58.293245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278e279-bda6-42f0-b9e2-46b49575148e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:58.294938 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278e279-bda6-42f0-b9e2-46b49575148e admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:58.308711 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1148/2272] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:19:58.313010 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b89ad-b931-424d-8ce2-1d935322ace5 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:58.323847 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b89ad-b931-424d-8ce2-1d935322ace5 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:58.328603 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f68d1-68a9-429e-8127-cbacf0ed753d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:58.329503 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f68d1-68a9-429e-8127-cbacf0ed753d admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:58.329793 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f68d1-68a9-429e-8127-cbacf0ed753d admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:58.330073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f68d1-68a9-429e-8127-cbacf0ed753d admin admin] PATH_INFO: `/v3/projects/dcd4a6b1131e41b8b8aafd4cefc8eb5d/users/41035f7a4d95412fafd167d58ee08ced/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:58.347137 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f68d1-68a9-429e-8127-cbacf0ed753d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd4a6b1131e41b8b8aafd4cefc8eb5d, user_id=41035f7a4d95412fafd167d58ee08ced, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:58.349869 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f68d1-68a9-429e-8127-cbacf0ed753d admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:58.366747 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1125/2273] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:19:58 2022] PUT /identity/v3/projects/dcd4a6b1131e41b8b8aafd4cefc8eb5d/users/41035f7a4d95412fafd167d58ee08ced/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:19:58.371006 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278e279-bda6-42f0-b9e2-46b49575148e admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:58.391999 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278e279-bda6-42f0-b9e2-46b49575148e admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:58.470660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee3f6f-4c9d-4c36-84ed-019041f52bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:58.471358 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee3f6f-4c9d-4c36-84ed-019041f52bae admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:58.471646 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee3f6f-4c9d-4c36-84ed-019041f52bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:58.472034 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee3f6f-4c9d-4c36-84ed-019041f52bae admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:58.472777 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee3f6f-4c9d-4c36-84ed-019041f52bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:58.474447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee3f6f-4c9d-4c36-84ed-019041f52bae admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:58.486662 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1149/2274] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:19:58.491093 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f68d1-68a9-429e-8127-cbacf0ed753d admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:19:58.502437 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f68d1-68a9-429e-8127-cbacf0ed753d admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:19:58.507586 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee8dc8-a181-4039-a1e5-601df24bc78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:19:58.508499 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee8dc8-a181-4039-a1e5-601df24bc78d admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:19:58.508831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee8dc8-a181-4039-a1e5-601df24bc78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:19:58.509110 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee8dc8-a181-4039-a1e5-601df24bc78d admin admin] PATH_INFO: `/v3/projects/dcd4a6b1131e41b8b8aafd4cefc8eb5d/users/41035f7a4d95412fafd167d58ee08ced/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:19:58.511203 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee8dc8-a181-4039-a1e5-601df24bc78d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd4a6b1131e41b8b8aafd4cefc8eb5d, user_id=41035f7a4d95412fafd167d58ee08ced, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:19:58.513875 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee8dc8-a181-4039-a1e5-601df24bc78d admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:19:58.529749 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1126/2275] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:19:58 2022] PUT /identity/v3/projects/dcd4a6b1131e41b8b8aafd4cefc8eb5d/users/41035f7a4d95412fafd167d58ee08ced/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:20:03.403578 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e4e3c-1bd6-4079-ada5-a1200c1f0a5a None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:20:03.404083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e4e3c-1bd6-4079-ada5-a1200c1f0a5a None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:20:03.404179 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e4e3c-1bd6-4079-ada5-a1200c1f0a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:20:03.434850 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-432e4e3c-1bd6-4079-ada5-a1200c1f0a5a None None] MFA Rules not processed for user `41035f7a4d95412fafd167d58ee08ced`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:20:03.436162 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-432e4e3c-1bd6-4079-ada5-a1200c1f0a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:20:03.523561 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1150/2276] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:20:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:20:03.535981 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee8dc8-a181-4039-a1e5-601df24bc78d admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:20:03.537768 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-1dee8dc8-a181-4039-a1e5-601df24bc78d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:20:03.612435 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee8dc8-a181-4039-a1e5-601df24bc78d admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:20:03.616145 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfa2e9-9988-4793-ad17-c3c832a99fb5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7af0259f7f24dfdafbdfc1f613ebb42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:20:03.617332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfa2e9-9988-4793-ad17-c3c832a99fb5 service glance] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:20:03.617332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfa2e9-9988-4793-ad17-c3c832a99fb5 service glance] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:20:03.617610 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfa2e9-9988-4793-ad17-c3c832a99fb5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:20:03.646906 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:03.684635 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcfa2e9-9988-4793-ad17-c3c832a99fb5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:20:03.686095 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcfa2e9-9988-4793-ad17-c3c832a99fb5 service glance] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:20:03.701252 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1127/2277] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:20:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:20:03.821216 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fa44e-7e0e-4ee7-8140-72520123bf25 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:20:03.821565 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fa44e-7e0e-4ee7-8140-72520123bf25 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:20:03.821857 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fa44e-7e0e-4ee7-8140-72520123bf25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:20:03.842670 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-767fa44e-7e0e-4ee7-8140-72520123bf25 None None] MFA Rules not processed for user `72f556aac45c460cb573498aab7590fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:20:03.843898 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-767fa44e-7e0e-4ee7-8140-72520123bf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:20:03.849802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:03.913830 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1151/2278] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Jul 12 13:20:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:20:03.927264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfa2e9-9988-4793-ad17-c3c832a99fb5 service glance] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:20:03.928722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-ffcfa2e9-9988-4793-ad17-c3c832a99fb5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:20:04.038092 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfa2e9-9988-4793-ad17-c3c832a99fb5 service glance] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:20:04.044287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e908f9-fb7f-4132-89a7-b360aef13ff8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe10f0f42b8247c99ed5f88eff5065e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:20:04.045026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e908f9-fb7f-4132-89a7-b360aef13ff8 service swift] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:20:04.045382 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e908f9-fb7f-4132-89a7-b360aef13ff8 service swift] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:20:04.045726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e908f9-fb7f-4132-89a7-b360aef13ff8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:20:04.057014 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e908f9-fb7f-4132-89a7-b360aef13ff8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:20:04.057812 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e908f9-fb7f-4132-89a7-b360aef13ff8 service swift] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:20:04.067642 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1128/2279] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Jul 12 13:20:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:20:12.985544 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4be024-cb53-4dbb-80ac-41ea589ad535 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:20:12.986226 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4be024-cb53-4dbb-80ac-41ea589ad535 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:20:12.986226 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4be024-cb53-4dbb-80ac-41ea589ad535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:20:13.003656 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-8d4be024-cb53-4dbb-80ac-41ea589ad535 None None] MFA Rules not processed for user `f25f35f5c4154efa967cf1c82c9f0e5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:20:13.004858 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-8d4be024-cb53-4dbb-80ac-41ea589ad535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:20:13.011955 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1152/2280] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:20:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:20:14.064432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=48 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:15.019459 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62176f79-ee60-4f70-9923-5187fbf58b30 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:20:15.019899 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62176f79-ee60-4f70-9923-5187fbf58b30 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:20:15.020189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62176f79-ee60-4f70-9923-5187fbf58b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:20:15.038768 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-62176f79-ee60-4f70-9923-5187fbf58b30 None None] MFA Rules not processed for user `72f556aac45c460cb573498aab7590fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:20:15.039989 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-62176f79-ee60-4f70-9923-5187fbf58b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:20:15.047444 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1129/2281] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Jul 12 13:20:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:20:15.059564 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4be024-cb53-4dbb-80ac-41ea589ad535 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:20:15.071973 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4be024-cb53-4dbb-80ac-41ea589ad535 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:20:15.077011 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82ca00-6623-479f-a170-b9cc7c96d741 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe10f0f42b8247c99ed5f88eff5065e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:20:15.077756 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82ca00-6623-479f-a170-b9cc7c96d741 service swift] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:20:15.078103 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82ca00-6623-479f-a170-b9cc7c96d741 service swift] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:20:15.078490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82ca00-6623-479f-a170-b9cc7c96d741 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:20:15.087670 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82ca00-6623-479f-a170-b9cc7c96d741 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:20:15.089270 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82ca00-6623-479f-a170-b9cc7c96d741 service swift] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:20:15.097824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1153/2282] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Jul 12 13:20:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:20:25.033316 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:25.094344 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=29 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:27.026885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62176f79-ee60-4f70-9923-5187fbf58b30 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:20:27.028350 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-62176f79-ee60-4f70-9923-5187fbf58b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:20:27.105585 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62176f79-ee60-4f70-9923-5187fbf58b30 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:20:27.110608 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8015283-6402-478a-ba50-9288b6d2c8ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '698828dd940f46e2b493ba55cd894eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:20:27.112609 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8015283-6402-478a-ba50-9288b6d2c8ed service placement] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:20:27.112609 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8015283-6402-478a-ba50-9288b6d2c8ed service placement] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:20:27.112609 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8015283-6402-478a-ba50-9288b6d2c8ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:20:27.113647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-d8015283-6402-478a-ba50-9288b6d2c8ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:20:27.125981 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8015283-6402-478a-ba50-9288b6d2c8ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:20:27.127613 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8015283-6402-478a-ba50-9288b6d2c8ed service placement] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:20:27.140415 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1130/2283] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:20:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:20:30.672464 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d7405-d105-43a0-8cb4-0802be0d97e4 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:20:30.673351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d7405-d105-43a0-8cb4-0802be0d97e4 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:20:30.673640 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d7405-d105-43a0-8cb4-0802be0d97e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:20:30.696069 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-c03d7405-d105-43a0-8cb4-0802be0d97e4 None None] MFA Rules not processed for user `72f556aac45c460cb573498aab7590fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:20:30.697365 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-c03d7405-d105-43a0-8cb4-0802be0d97e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:20:30.704786 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1154/2284] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Jul 12 13:20:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:20:30.720105 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8015283-6402-478a-ba50-9288b6d2c8ed service placement] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:20:30.733387 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8015283-6402-478a-ba50-9288b6d2c8ed service placement] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:20:30.740087 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541e591-f46d-4d27-aa37-65048541af2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe10f0f42b8247c99ed5f88eff5065e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:20:30.740796 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541e591-f46d-4d27-aa37-65048541af2f service swift] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:20:30.741291 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541e591-f46d-4d27-aa37-65048541af2f service swift] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:20:30.741814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541e591-f46d-4d27-aa37-65048541af2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:20:30.752611 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541e591-f46d-4d27-aa37-65048541af2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:20:30.754589 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541e591-f46d-4d27-aa37-65048541af2f service swift] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:20:30.771051 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1131/2285] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Jul 12 13:20:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:20:40.692556 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:40.761560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=38 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:42.312808 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee5910-d388-491f-9bbe-dd79f287928c None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:20:42.313366 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee5910-d388-491f-9bbe-dd79f287928c None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:20:42.313366 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee5910-d388-491f-9bbe-dd79f287928c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:20:42.336216 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-9fee5910-d388-491f-9bbe-dd79f287928c None None] MFA Rules not processed for user `f558b5ee5b5e43f4894d350fc73df0f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:20:42.337866 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-9fee5910-d388-491f-9bbe-dd79f287928c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:20:42.400869 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1155/2286] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:20:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:20:45.313288 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbbdfc-effa-422a-b64b-d23f44c31723 None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:20:45.313888 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbbdfc-effa-422a-b64b-d23f44c31723 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:20:45.314397 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbbdfc-effa-422a-b64b-d23f44c31723 None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:20:45.317029 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1132/2287] 10.222.0.17 () {54 vars in 921 bytes} [Tue Jul 12 13:20:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:20:45.324256 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb5c31-30c2-4d53-9bec-288634e97ac9 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:20:45.324799 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb5c31-30c2-4d53-9bec-288634e97ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:20:45.325124 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb5c31-30c2-4d53-9bec-288634e97ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:20:45.344261 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-06bb5c31-30c2-4d53-9bec-288634e97ac9 None None] MFA Rules not processed for user `e52dfce1b06346bfbde6ee33e7f6f249`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:20:45.346439 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-06bb5c31-30c2-4d53-9bec-288634e97ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:20:45.418607 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1156/2288] 10.222.0.17 () {58 vars in 1018 bytes} [Tue Jul 12 13:20:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:20:45.431494 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbbdfc-effa-422a-b64b-d23f44c31723 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:20:45.442537 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbbdfc-effa-422a-b64b-d23f44c31723 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:20:45.447180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09662344-29af-4e17-9c8d-51d298f2a171 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7af0259f7f24dfdafbdfc1f613ebb42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:20:45.451981 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09662344-29af-4e17-9c8d-51d298f2a171 service glance] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:20:45.452290 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09662344-29af-4e17-9c8d-51d298f2a171 service glance] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:20:45.452586 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09662344-29af-4e17-9c8d-51d298f2a171 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:20:45.472719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09662344-29af-4e17-9c8d-51d298f2a171 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:20:45.474944 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09662344-29af-4e17-9c8d-51d298f2a171 service glance] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:20:45.488682 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1133/2289] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:20:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:20:45.561443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc2cef-a2c5-4d04-9f23-5d4e16bdd017 None None] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:20:45.561783 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc2cef-a2c5-4d04-9f23-5d4e16bdd017 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:20:45.562066 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc2cef-a2c5-4d04-9f23-5d4e16bdd017 None None] PATH_INFO: `/` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:20:45.563485 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1157/2290] 10.222.0.17 () {54 vars in 921 bytes} [Tue Jul 12 13:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:20:45.568601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134ba9d-bdbb-42ad-b045-380076c538d8 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:20:45.581843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134ba9d-bdbb-42ad-b045-380076c538d8 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:20:45.581843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134ba9d-bdbb-42ad-b045-380076c538d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:20:45.596472 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-b134ba9d-bdbb-42ad-b045-380076c538d8 None None] MFA Rules not processed for user `0f39694be5f447f9a25dacf7e4c99a4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:20:45.597839 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-b134ba9d-bdbb-42ad-b045-380076c538d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:20:45.651026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1134/2291] 10.222.0.17 () {58 vars in 1018 bytes} [Tue Jul 12 13:20:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:20:45.662794 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc2cef-a2c5-4d04-9f23-5d4e16bdd017 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:20:45.664990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-69fc2cef-a2c5-4d04-9f23-5d4e16bdd017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:20:45.678637 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc2cef-a2c5-4d04-9f23-5d4e16bdd017 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:20:45.683165 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933dfd73-9e5c-4fd9-b9f0-4a08a4f1f988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:20:45.683824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dfd73-9e5c-4fd9-b9f0-4a08a4f1f988 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:20:45.684109 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dfd73-9e5c-4fd9-b9f0-4a08a4f1f988 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:20:45.684385 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dfd73-9e5c-4fd9-b9f0-4a08a4f1f988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:20:45.692764 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933dfd73-9e5c-4fd9-b9f0-4a08a4f1f988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:20:45.694241 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933dfd73-9e5c-4fd9-b9f0-4a08a4f1f988 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:20:45.702207 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1158/2292] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:20:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:20:45.788982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88952be2-b9be-41ed-9394-a8fa3e19656b None None] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:20:45.789273 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88952be2-b9be-41ed-9394-a8fa3e19656b None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:20:45.789552 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88952be2-b9be-41ed-9394-a8fa3e19656b None None] PATH_INFO: `/` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:20:45.790983 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1135/2293] 10.222.0.17 () {54 vars in 921 bytes} [Tue Jul 12 13:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:20:45.795845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e904a-ecad-47da-ac0c-2c5e20279fc5 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:20:45.796133 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e904a-ecad-47da-ac0c-2c5e20279fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:20:45.796412 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e904a-ecad-47da-ac0c-2c5e20279fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:20:45.815488 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-8e7e904a-ecad-47da-ac0c-2c5e20279fc5 None None] MFA Rules not processed for user `e52dfce1b06346bfbde6ee33e7f6f249`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:20:45.816718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-8e7e904a-ecad-47da-ac0c-2c5e20279fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:20:45.826739 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1159/2294] 10.222.0.17 () {58 vars in 1018 bytes} [Tue Jul 12 13:20:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:20:45.837870 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88952be2-b9be-41ed-9394-a8fa3e19656b None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:20:45.850258 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88952be2-b9be-41ed-9394-a8fa3e19656b None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:20:45.854009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfb9cb-ec86-456a-ac50-559d8af4b569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:20:45.854709 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfb9cb-ec86-456a-ac50-559d8af4b569 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:20:45.854999 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfb9cb-ec86-456a-ac50-559d8af4b569 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:20:45.855278 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfb9cb-ec86-456a-ac50-559d8af4b569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:20:45.866562 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfb9cb-ec86-456a-ac50-559d8af4b569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:20:45.868025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfb9cb-ec86-456a-ac50-559d8af4b569 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:20:45.880097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1136/2295] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:20:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:20:47.177201 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e904a-ecad-47da-ac0c-2c5e20279fc5 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:20:47.192034 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e904a-ecad-47da-ac0c-2c5e20279fc5 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:20:47.197776 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d577c7-d30a-4173-a9fa-8cd4ec73cf54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:20:47.198479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d577c7-d30a-4173-a9fa-8cd4ec73cf54 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:20:47.198943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d577c7-d30a-4173-a9fa-8cd4ec73cf54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:20:47.199232 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d577c7-d30a-4173-a9fa-8cd4ec73cf54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:20:47.210941 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d577c7-d30a-4173-a9fa-8cd4ec73cf54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:20:47.212527 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d577c7-d30a-4173-a9fa-8cd4ec73cf54 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:20:47.227531 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1160/2296] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:20:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:20:49.528930 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb95a42-2fc2-4c59-8809-c84f9b3c0716 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:20:49.529520 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb95a42-2fc2-4c59-8809-c84f9b3c0716 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:20:49.529520 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb95a42-2fc2-4c59-8809-c84f9b3c0716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:20:49.554892 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-1fb95a42-2fc2-4c59-8809-c84f9b3c0716 None None] MFA Rules not processed for user `72f556aac45c460cb573498aab7590fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:20:49.558146 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-1fb95a42-2fc2-4c59-8809-c84f9b3c0716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:20:49.576446 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1137/2297] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Jul 12 13:20:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:20:49.584457 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d577c7-d30a-4173-a9fa-8cd4ec73cf54 service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:20:49.598086 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d577c7-d30a-4173-a9fa-8cd4ec73cf54 service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:20:49.605947 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e348fed-c35d-405b-915c-605c5ebd1ec4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe10f0f42b8247c99ed5f88eff5065e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:20:49.607477 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e348fed-c35d-405b-915c-605c5ebd1ec4 service swift] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:20:49.608077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e348fed-c35d-405b-915c-605c5ebd1ec4 service swift] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:20:49.608570 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e348fed-c35d-405b-915c-605c5ebd1ec4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:20:49.630198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e348fed-c35d-405b-915c-605c5ebd1ec4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:20:49.632788 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e348fed-c35d-405b-915c-605c5ebd1ec4 service swift] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:20:49.644476 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1161/2298] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Jul 12 13:20:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:20:59.544512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=38 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:59.639105 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=77 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:21:04.923978 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ca1ee-d350-4e60-8af4-5ee0c208f262 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:21:04.924837 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ca1ee-d350-4e60-8af4-5ee0c208f262 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:21:04.924837 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ca1ee-d350-4e60-8af4-5ee0c208f262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:21:04.943110 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-836ca1ee-d350-4e60-8af4-5ee0c208f262 None None] MFA Rules not processed for user `155dfbdcace94d9d93d8d4758fbcb372`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:21:04.944480 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-836ca1ee-d350-4e60-8af4-5ee0c208f262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:21:04.999912 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1138/2299] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:21:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:21:12.163408 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb0828-4ee1-4d3e-bddc-1e2264324a03 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:21:12.163921 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb0828-4ee1-4d3e-bddc-1e2264324a03 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:21:12.164028 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb0828-4ee1-4d3e-bddc-1e2264324a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:21:12.183700 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-d2eb0828-4ee1-4d3e-bddc-1e2264324a03 None None] MFA Rules not processed for user `72f556aac45c460cb573498aab7590fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:21:12.185120 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-d2eb0828-4ee1-4d3e-bddc-1e2264324a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:21:12.200236 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1162/2300] 10.222.0.17 () {58 vars in 967 bytes} [Tue Jul 12 13:21:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:21:12.221230 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ca1ee-d350-4e60-8af4-5ee0c208f262 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:21:12.235813 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ca1ee-d350-4e60-8af4-5ee0c208f262 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:21:12.243194 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc1176-f6cc-42c5-b350-db39e2919fe0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe10f0f42b8247c99ed5f88eff5065e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:21:12.244116 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc1176-f6cc-42c5-b350-db39e2919fe0 service swift] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:21:12.244609 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc1176-f6cc-42c5-b350-db39e2919fe0 service swift] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:21:12.245101 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc1176-f6cc-42c5-b350-db39e2919fe0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:21:12.257409 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc1176-f6cc-42c5-b350-db39e2919fe0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:21:12.259555 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc1176-f6cc-42c5-b350-db39e2919fe0 service swift] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:21:12.272275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1139/2301] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Jul 12 13:21:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:21:22.177349 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:21:22.273936 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=31 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:21:57.448274 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76347d12-ea46-4573-8e23-f55dd4aec900 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:21:57.448816 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76347d12-ea46-4573-8e23-f55dd4aec900 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:21:57.448816 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76347d12-ea46-4573-8e23-f55dd4aec900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:21:57.466977 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-76347d12-ea46-4573-8e23-f55dd4aec900 None None] MFA Rules not processed for user `48f4be3ee79e42aeb67d87c06803c031`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:21:57.468187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-76347d12-ea46-4573-8e23-f55dd4aec900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:21:57.524096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1163/2302] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:21:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:07.368103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee2555-8c57-4b7b-a1b9-ce6965e1ce91 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:07.369223 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee2555-8c57-4b7b-a1b9-ce6965e1ce91 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:07.369223 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee2555-8c57-4b7b-a1b9-ce6965e1ce91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:07.388591 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-6dee2555-8c57-4b7b-a1b9-ce6965e1ce91 None None] MFA Rules not processed for user `4b2049d18bab4b0794d47cea6c7bf323`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:07.389932 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-6dee2555-8c57-4b7b-a1b9-ce6965e1ce91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:07.452323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1140/2303] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:22:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:22:07.516334 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=25 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:12.776374 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e76bb-68dd-4368-b7e6-bdccb051955d None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:12.777014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e76bb-68dd-4368-b7e6-bdccb051955d None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:12.777113 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e76bb-68dd-4368-b7e6-bdccb051955d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:12.799587 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-f35e76bb-68dd-4368-b7e6-bdccb051955d None None] MFA Rules not processed for user `f558b5ee5b5e43f4894d350fc73df0f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:12.801008 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-f35e76bb-68dd-4368-b7e6-bdccb051955d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:12.808613 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1164/2304] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:22:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:17.444479 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=25 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:17.523745 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee2555-8c57-4b7b-a1b9-ce6965e1ce91 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:17.534415 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e76bb-68dd-4368-b7e6-bdccb051955d None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:17.537415 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee2555-8c57-4b7b-a1b9-ce6965e1ce91 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:17.543148 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005e8a6-a504-4265-abf5-408b1947694c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:17.543829 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005e8a6-a504-4265-abf5-408b1947694c service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:17.544116 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005e8a6-a504-4265-abf5-408b1947694c service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:17.544394 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005e8a6-a504-4265-abf5-408b1947694c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:17.546276 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-2005e8a6-a504-4265-abf5-408b1947694c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:17.546952 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e76bb-68dd-4368-b7e6-bdccb051955d None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:17.550905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551de1a6-1169-4d13-b3df-43e362d51481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:17.551991 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551de1a6-1169-4d13-b3df-43e362d51481 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:17.552566 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551de1a6-1169-4d13-b3df-43e362d51481 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:17.553207 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551de1a6-1169-4d13-b3df-43e362d51481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:17.555196 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-551de1a6-1169-4d13-b3df-43e362d51481 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:17.561204 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005e8a6-a504-4265-abf5-408b1947694c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:17.562697 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005e8a6-a504-4265-abf5-408b1947694c service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:17.572508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551de1a6-1169-4d13-b3df-43e362d51481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:17.574512 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551de1a6-1169-4d13-b3df-43e362d51481 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:17.574942 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1141/2305] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:22:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:22:17.587082 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1165/2306] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:22:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:22:18.090421 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005e8a6-a504-4265-abf5-408b1947694c service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:18.103614 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005e8a6-a504-4265-abf5-408b1947694c service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:18.110853 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90131712-0b39-4c28-b4f0-36a85f0b54a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:18.111757 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90131712-0b39-4c28-b4f0-36a85f0b54a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:18.112228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90131712-0b39-4c28-b4f0-36a85f0b54a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:18.113055 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90131712-0b39-4c28-b4f0-36a85f0b54a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:18.114595 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-90131712-0b39-4c28-b4f0-36a85f0b54a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:18.224393 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90131712-0b39-4c28-b4f0-36a85f0b54a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:18.225972 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90131712-0b39-4c28-b4f0-36a85f0b54a8 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:18.238804 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1142/2307] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:22:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:22:23.253279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551de1a6-1169-4d13-b3df-43e362d51481 service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:23.254983 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-551de1a6-1169-4d13-b3df-43e362d51481 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:23.272790 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551de1a6-1169-4d13-b3df-43e362d51481 service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:23.278527 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0094b98-2f56-44a8-9644-40ce6704e804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:23.279505 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0094b98-2f56-44a8-9644-40ce6704e804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:23.279860 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0094b98-2f56-44a8-9644-40ce6704e804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:23.280203 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0094b98-2f56-44a8-9644-40ce6704e804 admin admin] PATH_INFO: `/v3/users/155dfbdcace94d9d93d8d4758fbcb372` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:23.281632 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0094b98-2f56-44a8-9644-40ce6704e804 admin admin] RBAC: Authorizing `identity:delete_user(user_id=155dfbdcace94d9d93d8d4758fbcb372)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:23.284387 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0094b98-2f56-44a8-9644-40ce6704e804 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:23.348883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b0094b98-2f56-44a8-9644-40ce6704e804 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '155dfbdcace94d9d93d8d4758fbcb372'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:23.357931 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b0094b98-2f56-44a8-9644-40ce6704e804 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '155dfbdcace94d9d93d8d4758fbcb372'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:23.366272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b0094b98-2f56-44a8-9644-40ce6704e804 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '155dfbdcace94d9d93d8d4758fbcb372'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:23.367007 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b0094b98-2f56-44a8-9644-40ce6704e804 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '155dfbdcace94d9d93d8d4758fbcb372'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:23.382578 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b0094b98-2f56-44a8-9644-40ce6704e804 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '155dfbdcace94d9d93d8d4758fbcb372'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:23.389242 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1166/2308] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:22:23 2022] DELETE /identity/v3/users/155dfbdcace94d9d93d8d4758fbcb372 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:22:23.572481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90131712-0b39-4c28-b4f0-36a85f0b54a8 service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:23.583534 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90131712-0b39-4c28-b4f0-36a85f0b54a8 service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:23.655003 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8c2a9-9eeb-4e78-9847-3cac28bdcb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:23.655915 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8c2a9-9eeb-4e78-9847-3cac28bdcb3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:23.656231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8c2a9-9eeb-4e78-9847-3cac28bdcb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:23.656515 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8c2a9-9eeb-4e78-9847-3cac28bdcb3d admin admin] PATH_INFO: `/v3/projects/36bba9bc3fb049bfa8a42fca5e8a74c6` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:23.657707 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8c2a9-9eeb-4e78-9847-3cac28bdcb3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=36bba9bc3fb049bfa8a42fca5e8a74c6)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:23.659690 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8c2a9-9eeb-4e78-9847-3cac28bdcb3d admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:23.706934 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-99c8c2a9-9eeb-4e78-9847-3cac28bdcb3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36bba9bc3fb049bfa8a42fca5e8a74c6', 'request_id': 'req-99c8c2a9-9eeb-4e78-9847-3cac28bdcb3d'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:23.713827 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-99c8c2a9-9eeb-4e78-9847-3cac28bdcb3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36bba9bc3fb049bfa8a42fca5e8a74c6', 'request_id': 'req-99c8c2a9-9eeb-4e78-9847-3cac28bdcb3d'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:23.722315 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-99c8c2a9-9eeb-4e78-9847-3cac28bdcb3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36bba9bc3fb049bfa8a42fca5e8a74c6', 'request_id': 'req-99c8c2a9-9eeb-4e78-9847-3cac28bdcb3d'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:23.734399 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-99c8c2a9-9eeb-4e78-9847-3cac28bdcb3d admin admin] The token cache is being invalidate because project 36bba9bc3fb049bfa8a42fca5e8a74c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:22:23.734697 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-99c8c2a9-9eeb-4e78-9847-3cac28bdcb3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:23.735398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-99c8c2a9-9eeb-4e78-9847-3cac28bdcb3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:23.737031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1143/2309] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:22:23 2022] DELETE /identity/v3/projects/36bba9bc3fb049bfa8a42fca5e8a74c6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:22:23.741905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be4ca4-3cd5-4731-b129-d670c65b9b59 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:23.742279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be4ca4-3cd5-4731-b129-d670c65b9b59 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:23.742730 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be4ca4-3cd5-4731-b129-d670c65b9b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:23.762015 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-71be4ca4-3cd5-4731-b129-d670c65b9b59 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:23.763267 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-71be4ca4-3cd5-4731-b129-d670c65b9b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:23.821253 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1167/2310] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:23.828907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef463a31-ceee-45ff-925f-a1c41d7a3c56 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:23.829212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef463a31-ceee-45ff-925f-a1c41d7a3c56 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:23.829497 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef463a31-ceee-45ff-925f-a1c41d7a3c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:23.848198 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-ef463a31-ceee-45ff-925f-a1c41d7a3c56 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:23.849413 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-ef463a31-ceee-45ff-925f-a1c41d7a3c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:23.858169 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1144/2311] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:23.862540 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be4ca4-3cd5-4731-b129-d670c65b9b59 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:23.872986 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be4ca4-3cd5-4731-b129-d670c65b9b59 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:23.877644 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec740335-c048-4195-9117-38c567a05aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:23.878347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec740335-c048-4195-9117-38c567a05aba admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:23.878643 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec740335-c048-4195-9117-38c567a05aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:23.878929 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec740335-c048-4195-9117-38c567a05aba admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:23.879698 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec740335-c048-4195-9117-38c567a05aba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:22:23.880010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec740335-c048-4195-9117-38c567a05aba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:23.881889 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec740335-c048-4195-9117-38c567a05aba admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:23.894531 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1168/2312] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:22:23.898792 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef463a31-ceee-45ff-925f-a1c41d7a3c56 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:23.905063 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:23.909824 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef463a31-ceee-45ff-925f-a1c41d7a3c56 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:23.916436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a958e9-6e5c-4cdf-be76-381ae89f76c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:23.917377 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a958e9-6e5c-4cdf-be76-381ae89f76c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:23.917744 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a958e9-6e5c-4cdf-be76-381ae89f76c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:23.918275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a958e9-6e5c-4cdf-be76-381ae89f76c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:23.919233 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a958e9-6e5c-4cdf-be76-381ae89f76c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:23.921224 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a958e9-6e5c-4cdf-be76-381ae89f76c0 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:23.948842 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1145/2313] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:22:23 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:22:23.954268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec740335-c048-4195-9117-38c567a05aba admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:23.965939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec740335-c048-4195-9117-38c567a05aba admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:24.007948 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:24.029355 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a48fe0-21e0-4f72-bfe2-e46d11c977ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:24.030070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a48fe0-21e0-4f72-bfe2-e46d11c977ad admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:24.030388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a48fe0-21e0-4f72-bfe2-e46d11c977ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:24.030674 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a48fe0-21e0-4f72-bfe2-e46d11c977ad admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:24.031389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a48fe0-21e0-4f72-bfe2-e46d11c977ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:24.033332 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a48fe0-21e0-4f72-bfe2-e46d11c977ad admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:24.058744 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1169/2314] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:22:23 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:22:24.062835 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a958e9-6e5c-4cdf-be76-381ae89f76c0 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:24.074075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a958e9-6e5c-4cdf-be76-381ae89f76c0 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:24.079066 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4964b-78c7-4d21-bbef-3a297a9d105a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:24.079749 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4964b-78c7-4d21-bbef-3a297a9d105a admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:24.080040 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4964b-78c7-4d21-bbef-3a297a9d105a admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:24.080327 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4964b-78c7-4d21-bbef-3a297a9d105a admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:24.081087 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4964b-78c7-4d21-bbef-3a297a9d105a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:24.082772 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4964b-78c7-4d21-bbef-3a297a9d105a admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:24.094280 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1146/2315] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:22:24.098371 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a48fe0-21e0-4f72-bfe2-e46d11c977ad admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:24.109308 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a48fe0-21e0-4f72-bfe2-e46d11c977ad admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:24.114267 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941d11a-c0cd-40ad-9904-2e5a386fb32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:24.114968 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941d11a-c0cd-40ad-9904-2e5a386fb32d admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:24.115254 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941d11a-c0cd-40ad-9904-2e5a386fb32d admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:24.115538 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941d11a-c0cd-40ad-9904-2e5a386fb32d admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:24.116414 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941d11a-c0cd-40ad-9904-2e5a386fb32d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:24.118134 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941d11a-c0cd-40ad-9904-2e5a386fb32d admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:24.133598 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1170/2316] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:22:24.136893 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4964b-78c7-4d21-bbef-3a297a9d105a admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:24.147301 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4964b-78c7-4d21-bbef-3a297a9d105a admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:24.152214 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85054a8-f70e-44c9-af38-5f097f8dda72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:24.153131 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85054a8-f70e-44c9-af38-5f097f8dda72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:24.153414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85054a8-f70e-44c9-af38-5f097f8dda72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:24.153692 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85054a8-f70e-44c9-af38-5f097f8dda72 admin admin] PATH_INFO: `/v3/projects/608f082acac14ae39f47ec52369652f0/users/5f815a1d208841239412ce3d476792fd/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:24.171934 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85054a8-f70e-44c9-af38-5f097f8dda72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=608f082acac14ae39f47ec52369652f0, user_id=5f815a1d208841239412ce3d476792fd, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:24.174875 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85054a8-f70e-44c9-af38-5f097f8dda72 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:24.194204 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1147/2317] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:22:24 2022] PUT /identity/v3/projects/608f082acac14ae39f47ec52369652f0/users/5f815a1d208841239412ce3d476792fd/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:22:24.204980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1605f-61c8-4c55-8993-8fc1db2cc1c9 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:24.205270 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1605f-61c8-4c55-8993-8fc1db2cc1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:24.205553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1605f-61c8-4c55-8993-8fc1db2cc1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:24.234448 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-4bb1605f-61c8-4c55-8993-8fc1db2cc1c9 None None] MFA Rules not processed for user `5f815a1d208841239412ce3d476792fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:24.235919 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-4bb1605f-61c8-4c55-8993-8fc1db2cc1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:24.307670 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1171/2318] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:22:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:22:24.312134 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85054a8-f70e-44c9-af38-5f097f8dda72 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:24.374772 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85054a8-f70e-44c9-af38-5f097f8dda72 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:24.379539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bfd44-10b5-41a1-a57e-fb43179cf9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:24.380219 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bfd44-10b5-41a1-a57e-fb43179cf9a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:24.380508 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bfd44-10b5-41a1-a57e-fb43179cf9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:24.380789 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bfd44-10b5-41a1-a57e-fb43179cf9a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:24.381758 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0bfd44-10b5-41a1-a57e-fb43179cf9a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:24.383707 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0bfd44-10b5-41a1-a57e-fb43179cf9a3 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:24.414416 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1148/2319] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:22:24 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:22:24.416096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1605f-61c8-4c55-8993-8fc1db2cc1c9 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:24.427223 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1605f-61c8-4c55-8993-8fc1db2cc1c9 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:24.499680 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a48d4-719c-4f2b-9efe-0e920a2b5f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:24.500373 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a48d4-719c-4f2b-9efe-0e920a2b5f1a admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:24.500666 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a48d4-719c-4f2b-9efe-0e920a2b5f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:24.500974 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a48d4-719c-4f2b-9efe-0e920a2b5f1a admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:24.501702 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a48d4-719c-4f2b-9efe-0e920a2b5f1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:24.503671 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a48d4-719c-4f2b-9efe-0e920a2b5f1a admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:24.525658 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1172/2320] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:22:24 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:22:24.530026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bfd44-10b5-41a1-a57e-fb43179cf9a3 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:24.541005 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bfd44-10b5-41a1-a57e-fb43179cf9a3 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:24.545626 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521e4eb-9b1c-4909-bee6-488b2cdda84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:24.546341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521e4eb-9b1c-4909-bee6-488b2cdda84d admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:24.546634 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521e4eb-9b1c-4909-bee6-488b2cdda84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:24.546919 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521e4eb-9b1c-4909-bee6-488b2cdda84d admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:24.547646 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521e4eb-9b1c-4909-bee6-488b2cdda84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:24.549247 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521e4eb-9b1c-4909-bee6-488b2cdda84d admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:24.559997 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1149/2321] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:22:24.564187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a48d4-719c-4f2b-9efe-0e920a2b5f1a admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:24.574821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a48d4-719c-4f2b-9efe-0e920a2b5f1a admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:24.579724 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457ad97-9e5a-4052-a6b4-07fdbdd5d77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:24.580664 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457ad97-9e5a-4052-a6b4-07fdbdd5d77a admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:24.580953 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457ad97-9e5a-4052-a6b4-07fdbdd5d77a admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:24.581229 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457ad97-9e5a-4052-a6b4-07fdbdd5d77a admin admin] PATH_INFO: `/v3/projects/3d44a69bb8394a24910c197ea121c214/users/34330f24847c4e878b97f57b1810b5c4/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:24.597098 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457ad97-9e5a-4052-a6b4-07fdbdd5d77a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d44a69bb8394a24910c197ea121c214, user_id=34330f24847c4e878b97f57b1810b5c4, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:24.599843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457ad97-9e5a-4052-a6b4-07fdbdd5d77a admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:24.613472 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1173/2322] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:22:24 2022] PUT /identity/v3/projects/3d44a69bb8394a24910c197ea121c214/users/34330f24847c4e878b97f57b1810b5c4/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:22:24.617451 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521e4eb-9b1c-4909-bee6-488b2cdda84d admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:24.627869 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521e4eb-9b1c-4909-bee6-488b2cdda84d admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:24.685282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb1704-c2c1-4424-bbb3-295b93db2422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:24.685967 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb1704-c2c1-4424-bbb3-295b93db2422 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:24.686291 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb1704-c2c1-4424-bbb3-295b93db2422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:24.686570 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb1704-c2c1-4424-bbb3-295b93db2422 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:24.687298 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb1704-c2c1-4424-bbb3-295b93db2422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:24.688910 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb1704-c2c1-4424-bbb3-295b93db2422 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:24.699264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1150/2323] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:22:24.703361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457ad97-9e5a-4052-a6b4-07fdbdd5d77a admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:24.714313 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457ad97-9e5a-4052-a6b4-07fdbdd5d77a admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:24.719217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b9595-0669-46dc-b5cc-20eb3707a528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:24.720127 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b9595-0669-46dc-b5cc-20eb3707a528 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:24.720417 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b9595-0669-46dc-b5cc-20eb3707a528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:24.720726 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b9595-0669-46dc-b5cc-20eb3707a528 admin admin] PATH_INFO: `/v3/projects/3d44a69bb8394a24910c197ea121c214/users/34330f24847c4e878b97f57b1810b5c4/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:24.722752 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b9595-0669-46dc-b5cc-20eb3707a528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d44a69bb8394a24910c197ea121c214, user_id=34330f24847c4e878b97f57b1810b5c4, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:24.725494 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b9595-0669-46dc-b5cc-20eb3707a528 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:24.732340 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:24.737620 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1174/2324] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:22:24 2022] PUT /identity/v3/projects/3d44a69bb8394a24910c197ea121c214/users/34330f24847c4e878b97f57b1810b5c4/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:22:24.747668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ebdca-c64c-45be-a42f-d75ab5cde04a None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:24.747964 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ebdca-c64c-45be-a42f-d75ab5cde04a None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:24.748253 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ebdca-c64c-45be-a42f-d75ab5cde04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:24.775410 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-fc2ebdca-c64c-45be-a42f-d75ab5cde04a None None] MFA Rules not processed for user `34330f24847c4e878b97f57b1810b5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:24.776689 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-fc2ebdca-c64c-45be-a42f-d75ab5cde04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:24.781784 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:24.845189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1151/2325] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:22:24 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:24.857240 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b9595-0669-46dc-b5cc-20eb3707a528 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:24.859016 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a65b9595-0669-46dc-b5cc-20eb3707a528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:24.917820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b9595-0669-46dc-b5cc-20eb3707a528 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:24.922029 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbe7ba-f380-4850-92bb-fa848596f78e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:24.922739 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbe7ba-f380-4850-92bb-fa848596f78e service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:24.923030 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbe7ba-f380-4850-92bb-fa848596f78e service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:24.923314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbe7ba-f380-4850-92bb-fa848596f78e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:24.932629 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbe7ba-f380-4850-92bb-fa848596f78e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:24.934069 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbe7ba-f380-4850-92bb-fa848596f78e service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:24.943737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1175/2326] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:22:24 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:22:25.015284 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ebdca-c64c-45be-a42f-d75ab5cde04a None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:25.025657 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ebdca-c64c-45be-a42f-d75ab5cde04a None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:25.029363 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c10fc-dd23-446b-a416-5bc53fab05e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:25.030017 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c10fc-dd23-446b-a416-5bc53fab05e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:25.030335 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c10fc-dd23-446b-a416-5bc53fab05e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:25.030614 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c10fc-dd23-446b-a416-5bc53fab05e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:25.091892 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c10fc-dd23-446b-a416-5bc53fab05e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:25.093228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c10fc-dd23-446b-a416-5bc53fab05e9 service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:25.103084 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1152/2327] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:22:25 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:22:27.358235 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ee1b8-eca1-417b-b0ec-49bf0d97cbb9 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:27.358746 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ee1b8-eca1-417b-b0ec-49bf0d97cbb9 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:27.358839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ee1b8-eca1-417b-b0ec-49bf0d97cbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:27.378228 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-1e2ee1b8-eca1-417b-b0ec-49bf0d97cbb9 None None] MFA Rules not processed for user `72f556aac45c460cb573498aab7590fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:27.379372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-1e2ee1b8-eca1-417b-b0ec-49bf0d97cbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:27.437189 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1176/2328] 10.222.0.17 () {58 vars in 967 bytes} [Tue Jul 12 13:22:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:27.485460 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c10fc-dd23-446b-a416-5bc53fab05e9 service cinder] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:27.487435 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-115c10fc-dd23-446b-a416-5bc53fab05e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:27.598757 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c10fc-dd23-446b-a416-5bc53fab05e9 service cinder] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:27.607027 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9a1b1-76f2-478c-a67f-81d6fdf81a1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe10f0f42b8247c99ed5f88eff5065e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:27.607785 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9a1b1-76f2-478c-a67f-81d6fdf81a1e service swift] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:27.608069 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9a1b1-76f2-478c-a67f-81d6fdf81a1e service swift] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:27.608397 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9a1b1-76f2-478c-a67f-81d6fdf81a1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:27.618655 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9a1b1-76f2-478c-a67f-81d6fdf81a1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:27.621038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9a1b1-76f2-478c-a67f-81d6fdf81a1e service swift] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:27.632340 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1153/2329] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Jul 12 13:22:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:22:27.902374 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ee1b8-eca1-417b-b0ec-49bf0d97cbb9 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:27.980981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ee1b8-eca1-417b-b0ec-49bf0d97cbb9 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:27.986903 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf983d40-89f7-4b98-bfe3-505d822a2f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:27.987837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf983d40-89f7-4b98-bfe3-505d822a2f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:27.988130 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf983d40-89f7-4b98-bfe3-505d822a2f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:27.988412 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf983d40-89f7-4b98-bfe3-505d822a2f2a admin admin] PATH_INFO: `/v3/users/5f815a1d208841239412ce3d476792fd` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:27.990371 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf983d40-89f7-4b98-bfe3-505d822a2f2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f815a1d208841239412ce3d476792fd)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:27.992367 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf983d40-89f7-4b98-bfe3-505d822a2f2a admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:28.050239 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-cf983d40-89f7-4b98-bfe3-505d822a2f2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f815a1d208841239412ce3d476792fd'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:28.053976 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:28.062840 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-cf983d40-89f7-4b98-bfe3-505d822a2f2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f815a1d208841239412ce3d476792fd'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:28.073422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-cf983d40-89f7-4b98-bfe3-505d822a2f2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f815a1d208841239412ce3d476792fd'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:28.074211 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-cf983d40-89f7-4b98-bfe3-505d822a2f2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f815a1d208841239412ce3d476792fd'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:28.094804 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-cf983d40-89f7-4b98-bfe3-505d822a2f2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f815a1d208841239412ce3d476792fd'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:28.102417 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1177/2330] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:22:27 2022] DELETE /identity/v3/users/5f815a1d208841239412ce3d476792fd => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:22:28.107907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd1599-57b3-400f-bc46-44e372552f95 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:28.108925 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd1599-57b3-400f-bc46-44e372552f95 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:28.109467 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd1599-57b3-400f-bc46-44e372552f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:28.129996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-b1bd1599-57b3-400f-bc46-44e372552f95 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:28.131424 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-b1bd1599-57b3-400f-bc46-44e372552f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:28.164386 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:28.215734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1154/2331] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:28.235966 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf983d40-89f7-4b98-bfe3-505d822a2f2a admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:28.237504 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-cf983d40-89f7-4b98-bfe3-505d822a2f2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:28.327756 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf983d40-89f7-4b98-bfe3-505d822a2f2a admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:28.332155 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba4320-8a18-4bc1-aca4-b9847bf3d601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:28.332796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba4320-8a18-4bc1-aca4-b9847bf3d601 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:28.333293 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba4320-8a18-4bc1-aca4-b9847bf3d601 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:28.333671 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba4320-8a18-4bc1-aca4-b9847bf3d601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:28.344877 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba4320-8a18-4bc1-aca4-b9847bf3d601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:28.346525 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba4320-8a18-4bc1-aca4-b9847bf3d601 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:28.357402 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1178/2332] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:22:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:22:29.117091 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd1599-57b3-400f-bc46-44e372552f95 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:29.119761 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-b1bd1599-57b3-400f-bc46-44e372552f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:29.133904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd1599-57b3-400f-bc46-44e372552f95 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:29.139890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1e950-324f-4ceb-8469-4c548329eb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:29.141137 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1e950-324f-4ceb-8469-4c548329eb3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:29.141423 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1e950-324f-4ceb-8469-4c548329eb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:29.142073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1e950-324f-4ceb-8469-4c548329eb3e admin admin] PATH_INFO: `/v3/projects/608f082acac14ae39f47ec52369652f0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:29.143555 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1e950-324f-4ceb-8469-4c548329eb3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=608f082acac14ae39f47ec52369652f0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:29.145634 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1e950-324f-4ceb-8469-4c548329eb3e admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:29.207397 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-96b1e950-324f-4ceb-8469-4c548329eb3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '608f082acac14ae39f47ec52369652f0', 'request_id': 'req-96b1e950-324f-4ceb-8469-4c548329eb3e'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:29.216735 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-96b1e950-324f-4ceb-8469-4c548329eb3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '608f082acac14ae39f47ec52369652f0', 'request_id': 'req-96b1e950-324f-4ceb-8469-4c548329eb3e'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:29.229749 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-96b1e950-324f-4ceb-8469-4c548329eb3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '608f082acac14ae39f47ec52369652f0', 'request_id': 'req-96b1e950-324f-4ceb-8469-4c548329eb3e'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:29.252618 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-96b1e950-324f-4ceb-8469-4c548329eb3e admin admin] The token cache is being invalidate because project 608f082acac14ae39f47ec52369652f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:22:29.252999 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-96b1e950-324f-4ceb-8469-4c548329eb3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:29.253645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-96b1e950-324f-4ceb-8469-4c548329eb3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:29.256776 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1155/2333] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:22:29 2022] DELETE /identity/v3/projects/608f082acac14ae39f47ec52369652f0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:22:29.265748 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba4320-8a18-4bc1-aca4-b9847bf3d601 service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:29.279651 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba4320-8a18-4bc1-aca4-b9847bf3d601 service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:29.386443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435038b-4e6c-4141-b2c8-fc4bc16c46c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:29.387682 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435038b-4e6c-4141-b2c8-fc4bc16c46c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:29.388135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435038b-4e6c-4141-b2c8-fc4bc16c46c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:29.388566 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435038b-4e6c-4141-b2c8-fc4bc16c46c7 admin admin] PATH_INFO: `/v3/users/34330f24847c4e878b97f57b1810b5c4` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:29.390035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9435038b-4e6c-4141-b2c8-fc4bc16c46c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34330f24847c4e878b97f57b1810b5c4)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:29.392360 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9435038b-4e6c-4141-b2c8-fc4bc16c46c7 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:29.511667 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-9435038b-4e6c-4141-b2c8-fc4bc16c46c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34330f24847c4e878b97f57b1810b5c4'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:29.527732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-9435038b-4e6c-4141-b2c8-fc4bc16c46c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34330f24847c4e878b97f57b1810b5c4'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:29.539202 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-9435038b-4e6c-4141-b2c8-fc4bc16c46c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34330f24847c4e878b97f57b1810b5c4'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:29.540727 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-9435038b-4e6c-4141-b2c8-fc4bc16c46c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34330f24847c4e878b97f57b1810b5c4'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:29.549904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:29.560425 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-9435038b-4e6c-4141-b2c8-fc4bc16c46c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34330f24847c4e878b97f57b1810b5c4'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:29.571037 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1179/2334] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:22:29 2022] DELETE /identity/v3/users/34330f24847c4e878b97f57b1810b5c4 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:22:30.162657 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1e950-324f-4ceb-8469-4c548329eb3e admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:30.166780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-96b1e950-324f-4ceb-8469-4c548329eb3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:30.190602 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1e950-324f-4ceb-8469-4c548329eb3e admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:30.290643 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3c86b-78b8-428d-b05f-f261eb31f856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:30.291540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3c86b-78b8-428d-b05f-f261eb31f856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:30.291819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3c86b-78b8-428d-b05f-f261eb31f856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:30.292144 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3c86b-78b8-428d-b05f-f261eb31f856 admin admin] PATH_INFO: `/v3/projects/3d44a69bb8394a24910c197ea121c214` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:30.293389 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3c86b-78b8-428d-b05f-f261eb31f856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d44a69bb8394a24910c197ea121c214)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:30.295655 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3c86b-78b8-428d-b05f-f261eb31f856 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:30.366875 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-54a3c86b-78b8-428d-b05f-f261eb31f856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d44a69bb8394a24910c197ea121c214', 'request_id': 'req-54a3c86b-78b8-428d-b05f-f261eb31f856'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:30.377896 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-54a3c86b-78b8-428d-b05f-f261eb31f856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d44a69bb8394a24910c197ea121c214', 'request_id': 'req-54a3c86b-78b8-428d-b05f-f261eb31f856'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:30.384194 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:30.391790 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-54a3c86b-78b8-428d-b05f-f261eb31f856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d44a69bb8394a24910c197ea121c214', 'request_id': 'req-54a3c86b-78b8-428d-b05f-f261eb31f856'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:30.406894 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-54a3c86b-78b8-428d-b05f-f261eb31f856 admin admin] The token cache is being invalidate because project 3d44a69bb8394a24910c197ea121c214 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:22:30.407200 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-54a3c86b-78b8-428d-b05f-f261eb31f856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:30.409354 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-54a3c86b-78b8-428d-b05f-f261eb31f856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:30.413707 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1156/2335] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:22:30 2022] DELETE /identity/v3/projects/3d44a69bb8394a24910c197ea121c214 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:22:30.419216 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609f781-eeeb-4078-9823-902ef84ea94b None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:30.419804 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609f781-eeeb-4078-9823-902ef84ea94b None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:30.419804 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609f781-eeeb-4078-9823-902ef84ea94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:30.443496 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-7609f781-eeeb-4078-9823-902ef84ea94b None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:30.444733 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-7609f781-eeeb-4078-9823-902ef84ea94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:30.557300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1180/2336] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:30.566008 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5aefcb-986b-4821-8812-111618a19e5e None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:30.566343 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5aefcb-986b-4821-8812-111618a19e5e None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:30.566636 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5aefcb-986b-4821-8812-111618a19e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:30.597690 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-eb5aefcb-986b-4821-8812-111618a19e5e None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:30.599221 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-eb5aefcb-986b-4821-8812-111618a19e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:30.601539 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609f781-eeeb-4078-9823-902ef84ea94b None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:30.605145 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-7609f781-eeeb-4078-9823-902ef84ea94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:30.627864 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1157/2337] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:30.630769 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5aefcb-986b-4821-8812-111618a19e5e None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:30.651396 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5aefcb-986b-4821-8812-111618a19e5e None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:30.656952 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a444f7-88c5-49b5-98fc-069f075e3a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:30.657807 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a444f7-88c5-49b5-98fc-069f075e3a7f admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:30.658269 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a444f7-88c5-49b5-98fc-069f075e3a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:30.658589 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a444f7-88c5-49b5-98fc-069f075e3a7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:30.659607 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a444f7-88c5-49b5-98fc-069f075e3a7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:22:30.660009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a444f7-88c5-49b5-98fc-069f075e3a7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:30.662292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a444f7-88c5-49b5-98fc-069f075e3a7f admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:30.683367 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1158/2338] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:22:30.695523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a444f7-88c5-49b5-98fc-069f075e3a7f admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:30.712041 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a444f7-88c5-49b5-98fc-069f075e3a7f admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:30.730550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ee034-120e-43e7-a479-14351f024eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:30.731252 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ee034-120e-43e7-a479-14351f024eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:30.731548 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ee034-120e-43e7-a479-14351f024eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:30.731813 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ee034-120e-43e7-a479-14351f024eb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:30.732530 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ee034-120e-43e7-a479-14351f024eb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:30.734963 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ee034-120e-43e7-a479-14351f024eb5 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:30.764148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609f781-eeeb-4078-9823-902ef84ea94b None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:30.770260 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab5698-c2f3-4be5-a210-635d8852d41d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:30.771135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab5698-c2f3-4be5-a210-635d8852d41d service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:30.771445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab5698-c2f3-4be5-a210-635d8852d41d service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:30.771715 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab5698-c2f3-4be5-a210-635d8852d41d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:30.777761 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-9bab5698-c2f3-4be5-a210-635d8852d41d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:30.788097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1159/2339] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:22:30 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:22:30.794241 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ee034-120e-43e7-a479-14351f024eb5 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:30.874046 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab5698-c2f3-4be5-a210-635d8852d41d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:30.876194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab5698-c2f3-4be5-a210-635d8852d41d service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:30.889684 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1181/2340] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:22:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:22:30.901859 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ee034-120e-43e7-a479-14351f024eb5 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:30.909179 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfae18-f894-4e8b-a3bc-2d7c1caf957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:30.909903 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfae18-f894-4e8b-a3bc-2d7c1caf957d admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:30.910152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfae18-f894-4e8b-a3bc-2d7c1caf957d admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:30.910429 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfae18-f894-4e8b-a3bc-2d7c1caf957d admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:30.911232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfae18-f894-4e8b-a3bc-2d7c1caf957d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:30.913264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfae18-f894-4e8b-a3bc-2d7c1caf957d admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:30.939065 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1160/2341] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:22:30 2022] POST /identity/v3/users => generated 290 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:22:30.944448 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab5698-c2f3-4be5-a210-635d8852d41d service nova] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:30.955932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab5698-c2f3-4be5-a210-635d8852d41d service nova] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:30.960718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdded9-da2b-4d00-aef6-1a5623760c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:30.961506 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdded9-da2b-4d00-aef6-1a5623760c8b admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:30.962506 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdded9-da2b-4d00-aef6-1a5623760c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:30.962934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdded9-da2b-4d00-aef6-1a5623760c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:30.963790 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdded9-da2b-4d00-aef6-1a5623760c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:30.965507 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdded9-da2b-4d00-aef6-1a5623760c8b admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:30.976540 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1182/2342] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:22:30.983446 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfae18-f894-4e8b-a3bc-2d7c1caf957d admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:30.993790 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfae18-f894-4e8b-a3bc-2d7c1caf957d admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:30.998633 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a4ca4-647a-48b2-ab29-b198181772b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:30.999314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a4ca4-647a-48b2-ab29-b198181772b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:30.999603 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a4ca4-647a-48b2-ab29-b198181772b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:30.999886 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a4ca4-647a-48b2-ab29-b198181772b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:31.000622 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a4ca4-647a-48b2-ab29-b198181772b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:31.002304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a4ca4-647a-48b2-ab29-b198181772b0 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:31.013784 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1161/2343] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:22:31.017766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdded9-da2b-4d00-aef6-1a5623760c8b admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:31.029210 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdded9-da2b-4d00-aef6-1a5623760c8b admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:31.034370 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c60863-eca6-4719-8c90-b556496a231e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:31.035276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c60863-eca6-4719-8c90-b556496a231e admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:31.035567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c60863-eca6-4719-8c90-b556496a231e admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:31.035870 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c60863-eca6-4719-8c90-b556496a231e admin admin] PATH_INFO: `/v3/projects/241148d7f5fe4c76b027ef244bce897f/users/1286bae0b14f4ad18beed3ca971ac022/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:31.048988 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:31.056447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c60863-eca6-4719-8c90-b556496a231e admin admin] RBAC: Authorizing `identity:create_grant(project_id=241148d7f5fe4c76b027ef244bce897f, user_id=1286bae0b14f4ad18beed3ca971ac022, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:31.059459 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c60863-eca6-4719-8c90-b556496a231e admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:31.075144 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1183/2344] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:22:31 2022] PUT /identity/v3/projects/241148d7f5fe4c76b027ef244bce897f/users/1286bae0b14f4ad18beed3ca971ac022/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:22:31.085382 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad18152-21ba-4133-8ed5-215c8476b020 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:31.085674 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad18152-21ba-4133-8ed5-215c8476b020 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:31.085959 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad18152-21ba-4133-8ed5-215c8476b020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:31.112986 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-4ad18152-21ba-4133-8ed5-215c8476b020 None None] MFA Rules not processed for user `1286bae0b14f4ad18beed3ca971ac022`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:31.114337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-4ad18152-21ba-4133-8ed5-215c8476b020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:31.181626 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1162/2345] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:22:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:31.186085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c60863-eca6-4719-8c90-b556496a231e admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:31.268909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c60863-eca6-4719-8c90-b556496a231e admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:31.274084 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963a7b3-fde3-4dec-beb5-4d2969a2a670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:31.274467 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963a7b3-fde3-4dec-beb5-4d2969a2a670 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:31.274760 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963a7b3-fde3-4dec-beb5-4d2969a2a670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:31.275036 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963a7b3-fde3-4dec-beb5-4d2969a2a670 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:31.276015 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963a7b3-fde3-4dec-beb5-4d2969a2a670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:31.277679 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963a7b3-fde3-4dec-beb5-4d2969a2a670 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:31.304654 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1184/2346] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:22:31 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:22:31.309246 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad18152-21ba-4133-8ed5-215c8476b020 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:31.322409 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad18152-21ba-4133-8ed5-215c8476b020 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:31.336195 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:31.399824 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb666d2-7526-49d5-94f8-d085273fcd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:31.400553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb666d2-7526-49d5-94f8-d085273fcd18 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:31.400844 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb666d2-7526-49d5-94f8-d085273fcd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:31.401405 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb666d2-7526-49d5-94f8-d085273fcd18 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:31.402057 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb666d2-7526-49d5-94f8-d085273fcd18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:31.404092 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb666d2-7526-49d5-94f8-d085273fcd18 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:31.428372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1163/2347] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:22:31 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:22:31.432763 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963a7b3-fde3-4dec-beb5-4d2969a2a670 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:31.443986 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963a7b3-fde3-4dec-beb5-4d2969a2a670 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:31.449226 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874db3d3-5ca6-4e7b-8e17-4aea5e2a95aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:31.449905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874db3d3-5ca6-4e7b-8e17-4aea5e2a95aa admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:31.450228 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874db3d3-5ca6-4e7b-8e17-4aea5e2a95aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:31.450516 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874db3d3-5ca6-4e7b-8e17-4aea5e2a95aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:31.451247 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874db3d3-5ca6-4e7b-8e17-4aea5e2a95aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:31.452975 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874db3d3-5ca6-4e7b-8e17-4aea5e2a95aa admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:31.464451 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1185/2348] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:22:31.469012 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb666d2-7526-49d5-94f8-d085273fcd18 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:31.483066 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb666d2-7526-49d5-94f8-d085273fcd18 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:31.498513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9d0d4-fc7e-4df4-90df-b6ba9dbe757b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:31.499521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9d0d4-fc7e-4df4-90df-b6ba9dbe757b admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:31.499783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9d0d4-fc7e-4df4-90df-b6ba9dbe757b admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:31.500105 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9d0d4-fc7e-4df4-90df-b6ba9dbe757b admin admin] PATH_INFO: `/v3/projects/c80d824d6856460baf4253fa678fd251/users/8fd8b9d035984460a33d93aa9534c040/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:31.526340 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9d0d4-fc7e-4df4-90df-b6ba9dbe757b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c80d824d6856460baf4253fa678fd251, user_id=8fd8b9d035984460a33d93aa9534c040, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:31.529749 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9d0d4-fc7e-4df4-90df-b6ba9dbe757b admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:31.548124 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1164/2349] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:22:31 2022] PUT /identity/v3/projects/c80d824d6856460baf4253fa678fd251/users/8fd8b9d035984460a33d93aa9534c040/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:22:31.551922 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874db3d3-5ca6-4e7b-8e17-4aea5e2a95aa admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:31.563915 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874db3d3-5ca6-4e7b-8e17-4aea5e2a95aa admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:31.647224 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14da52-e1ba-45bf-8495-4cf1ea03dd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:31.648074 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14da52-e1ba-45bf-8495-4cf1ea03dd05 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:31.648558 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14da52-e1ba-45bf-8495-4cf1ea03dd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:31.649295 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14da52-e1ba-45bf-8495-4cf1ea03dd05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:31.650587 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14da52-e1ba-45bf-8495-4cf1ea03dd05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:31.659274 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14da52-e1ba-45bf-8495-4cf1ea03dd05 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:31.671763 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1186/2350] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:22:31.677820 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9d0d4-fc7e-4df4-90df-b6ba9dbe757b admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:31.690886 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9d0d4-fc7e-4df4-90df-b6ba9dbe757b admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:31.695695 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec154c-1f0e-47e0-9ec2-2cacf1e9ce67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:31.696693 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec154c-1f0e-47e0-9ec2-2cacf1e9ce67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:31.697036 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec154c-1f0e-47e0-9ec2-2cacf1e9ce67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:31.697332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec154c-1f0e-47e0-9ec2-2cacf1e9ce67 admin admin] PATH_INFO: `/v3/projects/c80d824d6856460baf4253fa678fd251/users/8fd8b9d035984460a33d93aa9534c040/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:31.702658 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec154c-1f0e-47e0-9ec2-2cacf1e9ce67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c80d824d6856460baf4253fa678fd251, user_id=8fd8b9d035984460a33d93aa9534c040, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:31.705256 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec154c-1f0e-47e0-9ec2-2cacf1e9ce67 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:31.722617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1165/2351] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:22:31 2022] PUT /identity/v3/projects/c80d824d6856460baf4253fa678fd251/users/8fd8b9d035984460a33d93aa9534c040/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:22:31.730371 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269fde8-ac4b-4b46-941a-cd609460bcaf None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:31.730721 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269fde8-ac4b-4b46-941a-cd609460bcaf None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:31.731010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269fde8-ac4b-4b46-941a-cd609460bcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:31.765426 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-6269fde8-ac4b-4b46-941a-cd609460bcaf None None] MFA Rules not processed for user `8fd8b9d035984460a33d93aa9534c040`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:31.770375 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-6269fde8-ac4b-4b46-941a-cd609460bcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:31.841337 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:31.867011 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1187/2352] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:22:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:31.879814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec154c-1f0e-47e0-9ec2-2cacf1e9ce67 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:31.881098 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-faec154c-1f0e-47e0-9ec2-2cacf1e9ce67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:31.982371 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec154c-1f0e-47e0-9ec2-2cacf1e9ce67 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:31.986904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ac756-a992-442b-b5a7-8a8e186322d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:31.987680 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ac756-a992-442b-b5a7-8a8e186322d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:31.988031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ac756-a992-442b-b5a7-8a8e186322d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:31.988376 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ac756-a992-442b-b5a7-8a8e186322d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:31.998859 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ac756-a992-442b-b5a7-8a8e186322d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:32.000444 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ac756-a992-442b-b5a7-8a8e186322d1 service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:32.014017 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1166/2353] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:22:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:22:32.405899 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269fde8-ac4b-4b46-941a-cd609460bcaf None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:32.407693 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-6269fde8-ac4b-4b46-941a-cd609460bcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:32.437685 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ac756-a992-442b-b5a7-8a8e186322d1 service cinder] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:32.449150 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ac756-a992-442b-b5a7-8a8e186322d1 service cinder] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:32.464438 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98977b6f-4cb0-4892-bca6-e50e15a68477 tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fd8b9d035984460a33d93aa9534c040', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c80d824d6856460baf4253fa678fd251', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:32.465329 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98977b6f-4cb0-4892-bca6-e50e15a68477 tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:32.467121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98977b6f-4cb0-4892-bca6-e50e15a68477 tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:32.467361 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98977b6f-4cb0-4892-bca6-e50e15a68477 tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:32.468552 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98977b6f-4cb0-4892-bca6-e50e15a68477 tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:22:32.469121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98977b6f-4cb0-4892-bca6-e50e15a68477 tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:32.472379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98977b6f-4cb0-4892-bca6-e50e15a68477 tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:32.489771 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1167/2354] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:22:32.495005 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98977b6f-4cb0-4892-bca6-e50e15a68477 tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:32.507475 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98977b6f-4cb0-4892-bca6-e50e15a68477 tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:32.514004 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec86f6f-7bff-4824-a990-e4023c02e19c tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fd8b9d035984460a33d93aa9534c040', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c80d824d6856460baf4253fa678fd251', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:32.515031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec86f6f-7bff-4824-a990-e4023c02e19c tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:32.515473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec86f6f-7bff-4824-a990-e4023c02e19c tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:32.515902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec86f6f-7bff-4824-a990-e4023c02e19c tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:32.518143 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec86f6f-7bff-4824-a990-e4023c02e19c tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:32.520437 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec86f6f-7bff-4824-a990-e4023c02e19c tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:32.537820 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269fde8-ac4b-4b46-941a-cd609460bcaf None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:32.545091 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4bfeb-97a0-4ddd-9864-4f691278ff3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '698828dd940f46e2b493ba55cd894eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:32.545972 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4bfeb-97a0-4ddd-9864-4f691278ff3f service placement] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:32.546195 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4bfeb-97a0-4ddd-9864-4f691278ff3f service placement] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:32.546516 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4bfeb-97a0-4ddd-9864-4f691278ff3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:32.548347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-e4d4bfeb-97a0-4ddd-9864-4f691278ff3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:32.556752 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1168/2355] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:22:32 2022] POST /identity/v3/projects => generated 353 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:22:32.560919 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec86f6f-7bff-4824-a990-e4023c02e19c tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:32.567159 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4bfeb-97a0-4ddd-9864-4f691278ff3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:32.568865 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4bfeb-97a0-4ddd-9864-4f691278ff3f service placement] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:32.597449 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1188/2356] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:22:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:22:32.603709 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:32.645126 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec86f6f-7bff-4824-a990-e4023c02e19c tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:32.650546 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c13f0-8146-437d-89d9-3d331d03bbb9 tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fd8b9d035984460a33d93aa9534c040', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c80d824d6856460baf4253fa678fd251', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:32.651515 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c13f0-8146-437d-89d9-3d331d03bbb9 tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:32.651975 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c13f0-8146-437d-89d9-3d331d03bbb9 tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:32.652425 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c13f0-8146-437d-89d9-3d331d03bbb9 tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:32.653348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c13f0-8146-437d-89d9-3d331d03bbb9 tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:22:32.653837 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c13f0-8146-437d-89d9-3d331d03bbb9 tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:32.655665 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c13f0-8146-437d-89d9-3d331d03bbb9 tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:32.678428 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1169/2357] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:22:32.714106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4bfeb-97a0-4ddd-9864-4f691278ff3f service placement] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:32.726168 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4bfeb-97a0-4ddd-9864-4f691278ff3f service placement] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:32.731951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7387e5-fee6-42b3-ae6e-c9ee1e6dbf8d tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fd8b9d035984460a33d93aa9534c040', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c80d824d6856460baf4253fa678fd251', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:32.732998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7387e5-fee6-42b3-ae6e-c9ee1e6dbf8d tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:32.733362 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7387e5-fee6-42b3-ae6e-c9ee1e6dbf8d tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:32.733850 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7387e5-fee6-42b3-ae6e-c9ee1e6dbf8d tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] PATH_INFO: `/v3/projects/7ebd72b4cfbd440fb3eddb9e155fab42` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:32.735439 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7387e5-fee6-42b3-ae6e-c9ee1e6dbf8d tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7ebd72b4cfbd440fb3eddb9e155fab42)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:32.737603 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7387e5-fee6-42b3-ae6e-c9ee1e6dbf8d tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:32.795540 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5b7387e5-fee6-42b3-ae6e-c9ee1e6dbf8d tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ebd72b4cfbd440fb3eddb9e155fab42', 'request_id': 'req-5b7387e5-fee6-42b3-ae6e-c9ee1e6dbf8d'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:32.803026 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5b7387e5-fee6-42b3-ae6e-c9ee1e6dbf8d tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ebd72b4cfbd440fb3eddb9e155fab42', 'request_id': 'req-5b7387e5-fee6-42b3-ae6e-c9ee1e6dbf8d'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:32.812878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5b7387e5-fee6-42b3-ae6e-c9ee1e6dbf8d tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ebd72b4cfbd440fb3eddb9e155fab42', 'request_id': 'req-5b7387e5-fee6-42b3-ae6e-c9ee1e6dbf8d'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:32.828351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5b7387e5-fee6-42b3-ae6e-c9ee1e6dbf8d tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] The token cache is being invalidate because project 7ebd72b4cfbd440fb3eddb9e155fab42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:22:32.829684 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5b7387e5-fee6-42b3-ae6e-c9ee1e6dbf8d tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:32.830075 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5b7387e5-fee6-42b3-ae6e-c9ee1e6dbf8d tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:32.832834 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1189/2358] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:22:32 2022] DELETE /identity/v3/projects/7ebd72b4cfbd440fb3eddb9e155fab42 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:22:33.104167 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c13f0-8146-437d-89d9-3d331d03bbb9 tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:33.107386 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-3c6c13f0-8146-437d-89d9-3d331d03bbb9 tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:33.201749 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c13f0-8146-437d-89d9-3d331d03bbb9 tempest-VolumeQuotaClassesTest-639309195 tempest-VolumeQuotaClassesTest-639309195-project-admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:33.267249 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3403b23-4d4a-4adc-be67-0c4fb59a3cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:33.268200 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3403b23-4d4a-4adc-be67-0c4fb59a3cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:33.268492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3403b23-4d4a-4adc-be67-0c4fb59a3cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:33.268781 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3403b23-4d4a-4adc-be67-0c4fb59a3cd9 admin admin] PATH_INFO: `/v3/users/1286bae0b14f4ad18beed3ca971ac022` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:33.270102 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3403b23-4d4a-4adc-be67-0c4fb59a3cd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1286bae0b14f4ad18beed3ca971ac022)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:33.272075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3403b23-4d4a-4adc-be67-0c4fb59a3cd9 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:33.330184 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d3403b23-4d4a-4adc-be67-0c4fb59a3cd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1286bae0b14f4ad18beed3ca971ac022'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:33.330956 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d3403b23-4d4a-4adc-be67-0c4fb59a3cd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1286bae0b14f4ad18beed3ca971ac022'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:33.341894 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d3403b23-4d4a-4adc-be67-0c4fb59a3cd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1286bae0b14f4ad18beed3ca971ac022'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:33.352008 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d3403b23-4d4a-4adc-be67-0c4fb59a3cd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1286bae0b14f4ad18beed3ca971ac022'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:33.364133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:33.371050 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d3403b23-4d4a-4adc-be67-0c4fb59a3cd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1286bae0b14f4ad18beed3ca971ac022'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:33.394189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1170/2359] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:22:33 2022] DELETE /identity/v3/users/1286bae0b14f4ad18beed3ca971ac022 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:22:33.398764 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09ca26-4d1f-4052-876c-25631eb72785 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:33.399056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09ca26-4d1f-4052-876c-25631eb72785 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:33.399893 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09ca26-4d1f-4052-876c-25631eb72785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:33.423577 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-3e09ca26-4d1f-4052-876c-25631eb72785 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:33.425384 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-3e09ca26-4d1f-4052-876c-25631eb72785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:33.503357 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:33.518416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1190/2360] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:33.530970 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3403b23-4d4a-4adc-be67-0c4fb59a3cd9 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:33.534144 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-d3403b23-4d4a-4adc-be67-0c4fb59a3cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:33.605377 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3403b23-4d4a-4adc-be67-0c4fb59a3cd9 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:33.609087 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23cc22-db2c-43b6-9eb3-cdca7a15e93f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:33.609758 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23cc22-db2c-43b6-9eb3-cdca7a15e93f service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:33.610044 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23cc22-db2c-43b6-9eb3-cdca7a15e93f service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:33.610356 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23cc22-db2c-43b6-9eb3-cdca7a15e93f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:33.620530 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23cc22-db2c-43b6-9eb3-cdca7a15e93f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:33.621990 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23cc22-db2c-43b6-9eb3-cdca7a15e93f service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:33.634402 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1171/2361] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:22:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:22:34.143978 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09ca26-4d1f-4052-876c-25631eb72785 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:34.145465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-3e09ca26-4d1f-4052-876c-25631eb72785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:34.160797 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09ca26-4d1f-4052-876c-25631eb72785 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:34.169280 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92abe4-7fc7-49de-b7cf-8aa25cc3b7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:34.170771 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92abe4-7fc7-49de-b7cf-8aa25cc3b7c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:34.171264 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92abe4-7fc7-49de-b7cf-8aa25cc3b7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:34.171764 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92abe4-7fc7-49de-b7cf-8aa25cc3b7c3 admin admin] PATH_INFO: `/v3/projects/241148d7f5fe4c76b027ef244bce897f` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:34.173868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92abe4-7fc7-49de-b7cf-8aa25cc3b7c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=241148d7f5fe4c76b027ef244bce897f)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:34.176603 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92abe4-7fc7-49de-b7cf-8aa25cc3b7c3 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:34.235319 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-bc92abe4-7fc7-49de-b7cf-8aa25cc3b7c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '241148d7f5fe4c76b027ef244bce897f', 'request_id': 'req-bc92abe4-7fc7-49de-b7cf-8aa25cc3b7c3'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:34.243680 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-bc92abe4-7fc7-49de-b7cf-8aa25cc3b7c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '241148d7f5fe4c76b027ef244bce897f', 'request_id': 'req-bc92abe4-7fc7-49de-b7cf-8aa25cc3b7c3'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:34.255554 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-bc92abe4-7fc7-49de-b7cf-8aa25cc3b7c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '241148d7f5fe4c76b027ef244bce897f', 'request_id': 'req-bc92abe4-7fc7-49de-b7cf-8aa25cc3b7c3'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:34.273843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-bc92abe4-7fc7-49de-b7cf-8aa25cc3b7c3 admin admin] The token cache is being invalidate because project 241148d7f5fe4c76b027ef244bce897f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:22:34.273843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-bc92abe4-7fc7-49de-b7cf-8aa25cc3b7c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:34.275148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-bc92abe4-7fc7-49de-b7cf-8aa25cc3b7c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:34.276863 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1191/2362] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:22:34 2022] DELETE /identity/v3/projects/241148d7f5fe4c76b027ef244bce897f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:22:34.281018 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23cc22-db2c-43b6-9eb3-cdca7a15e93f service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:34.295656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23cc22-db2c-43b6-9eb3-cdca7a15e93f service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:34.375886 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbdeb0-d411-44f7-b0be-931cc6d59bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:34.377390 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbdeb0-d411-44f7-b0be-931cc6d59bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:34.377390 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbdeb0-d411-44f7-b0be-931cc6d59bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:34.377589 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbdeb0-d411-44f7-b0be-931cc6d59bfa admin admin] PATH_INFO: `/v3/users/8fd8b9d035984460a33d93aa9534c040` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:34.378869 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbdeb0-d411-44f7-b0be-931cc6d59bfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fd8b9d035984460a33d93aa9534c040)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:34.381924 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbdeb0-d411-44f7-b0be-931cc6d59bfa admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:34.454982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-7fbbdeb0-d411-44f7-b0be-931cc6d59bfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fd8b9d035984460a33d93aa9534c040'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:34.455953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-7fbbdeb0-d411-44f7-b0be-931cc6d59bfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fd8b9d035984460a33d93aa9534c040'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:34.473772 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-7fbbdeb0-d411-44f7-b0be-931cc6d59bfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fd8b9d035984460a33d93aa9534c040'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:34.502453 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-7fbbdeb0-d411-44f7-b0be-931cc6d59bfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fd8b9d035984460a33d93aa9534c040'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:34.519559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-7fbbdeb0-d411-44f7-b0be-931cc6d59bfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fd8b9d035984460a33d93aa9534c040'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:34.527418 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1172/2363] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:22:34 2022] DELETE /identity/v3/users/8fd8b9d035984460a33d93aa9534c040 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:22:34.833137 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92abe4-7fc7-49de-b7cf-8aa25cc3b7c3 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:34.834658 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-bc92abe4-7fc7-49de-b7cf-8aa25cc3b7c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:34.857697 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92abe4-7fc7-49de-b7cf-8aa25cc3b7c3 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:34.932802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b08770-c47f-4c37-a147-fcfa176f8649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:34.933594 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b08770-c47f-4c37-a147-fcfa176f8649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:34.933876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b08770-c47f-4c37-a147-fcfa176f8649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:34.934180 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b08770-c47f-4c37-a147-fcfa176f8649 admin admin] PATH_INFO: `/v3/projects/c80d824d6856460baf4253fa678fd251` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:34.935849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b08770-c47f-4c37-a147-fcfa176f8649 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c80d824d6856460baf4253fa678fd251)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:34.937783 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b08770-c47f-4c37-a147-fcfa176f8649 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:35.015688 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b9b08770-c47f-4c37-a147-fcfa176f8649 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c80d824d6856460baf4253fa678fd251', 'request_id': 'req-b9b08770-c47f-4c37-a147-fcfa176f8649'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:35.025819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b9b08770-c47f-4c37-a147-fcfa176f8649 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c80d824d6856460baf4253fa678fd251', 'request_id': 'req-b9b08770-c47f-4c37-a147-fcfa176f8649'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:35.039952 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b9b08770-c47f-4c37-a147-fcfa176f8649 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c80d824d6856460baf4253fa678fd251', 'request_id': 'req-b9b08770-c47f-4c37-a147-fcfa176f8649'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:35.055922 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b9b08770-c47f-4c37-a147-fcfa176f8649 admin admin] The token cache is being invalidate because project c80d824d6856460baf4253fa678fd251 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:22:35.055922 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b9b08770-c47f-4c37-a147-fcfa176f8649 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:35.056676 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b9b08770-c47f-4c37-a147-fcfa176f8649 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:35.058271 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1192/2364] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:22:34 2022] DELETE /identity/v3/projects/c80d824d6856460baf4253fa678fd251 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:22:35.066604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902eb7eb-a30a-4ee9-a4f1-494e063e9ed9 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:35.067134 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902eb7eb-a30a-4ee9-a4f1-494e063e9ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:35.067315 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902eb7eb-a30a-4ee9-a4f1-494e063e9ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:35.092981 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-902eb7eb-a30a-4ee9-a4f1-494e063e9ed9 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:35.094817 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-902eb7eb-a30a-4ee9-a4f1-494e063e9ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:35.108508 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:35.172067 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1173/2365] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:35.181590 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1392c-10ee-433b-b5a5-48709bb28893 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:35.182148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1392c-10ee-433b-b5a5-48709bb28893 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:35.182280 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1392c-10ee-433b-b5a5-48709bb28893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:35.201961 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-a7d1392c-10ee-433b-b5a5-48709bb28893 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:35.203232 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a7d1392c-10ee-433b-b5a5-48709bb28893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:35.211358 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1193/2366] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:35.215932 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902eb7eb-a30a-4ee9-a4f1-494e063e9ed9 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:35.227924 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902eb7eb-a30a-4ee9-a4f1-494e063e9ed9 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:35.233708 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c60882-03af-404c-b9ad-dcc91a191d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:35.234025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c60882-03af-404c-b9ad-dcc91a191d1c admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:35.234627 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c60882-03af-404c-b9ad-dcc91a191d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:35.235487 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c60882-03af-404c-b9ad-dcc91a191d1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:35.235955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c60882-03af-404c-b9ad-dcc91a191d1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:22:35.236333 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c60882-03af-404c-b9ad-dcc91a191d1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:35.238136 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c60882-03af-404c-b9ad-dcc91a191d1c admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:35.257405 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1174/2367] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:22:35.259728 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1392c-10ee-433b-b5a5-48709bb28893 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:35.269760 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1392c-10ee-433b-b5a5-48709bb28893 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:35.274745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5f70b-6bb1-4847-8c0c-557bab2ba116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:35.275440 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5f70b-6bb1-4847-8c0c-557bab2ba116 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:35.275729 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5f70b-6bb1-4847-8c0c-557bab2ba116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:35.276192 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5f70b-6bb1-4847-8c0c-557bab2ba116 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:35.276906 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5f70b-6bb1-4847-8c0c-557bab2ba116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:35.278899 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5f70b-6bb1-4847-8c0c-557bab2ba116 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:35.282721 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:35.318979 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1194/2368] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:22:35 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:22:35.319667 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c60882-03af-404c-b9ad-dcc91a191d1c admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:35.331500 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c60882-03af-404c-b9ad-dcc91a191d1c admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:35.401115 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f855353-96a4-4b3d-ab75-a55bd3336c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:35.401815 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f855353-96a4-4b3d-ab75-a55bd3336c15 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:35.402100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f855353-96a4-4b3d-ab75-a55bd3336c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:35.402421 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f855353-96a4-4b3d-ab75-a55bd3336c15 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:35.403119 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f855353-96a4-4b3d-ab75-a55bd3336c15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:35.405209 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f855353-96a4-4b3d-ab75-a55bd3336c15 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:35.429163 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1175/2369] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:22:35 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:22:35.433942 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5f70b-6bb1-4847-8c0c-557bab2ba116 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:35.446382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5f70b-6bb1-4847-8c0c-557bab2ba116 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:35.455001 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcb132-08e0-4d54-8a48-3135fbb7412b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:35.455615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcb132-08e0-4d54-8a48-3135fbb7412b admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:35.455899 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcb132-08e0-4d54-8a48-3135fbb7412b admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:35.456174 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcb132-08e0-4d54-8a48-3135fbb7412b admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:35.456907 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bcb132-08e0-4d54-8a48-3135fbb7412b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:35.458854 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bcb132-08e0-4d54-8a48-3135fbb7412b admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:35.474841 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f855353-96a4-4b3d-ab75-a55bd3336c15 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:35.478270 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1195/2370] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:22:35.489686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f855353-96a4-4b3d-ab75-a55bd3336c15 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:35.496009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e06bd-66e3-4c60-8444-05004c4c0d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:35.496648 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e06bd-66e3-4c60-8444-05004c4c0d6c admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:35.496941 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e06bd-66e3-4c60-8444-05004c4c0d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:35.497229 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e06bd-66e3-4c60-8444-05004c4c0d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:35.498048 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e06bd-66e3-4c60-8444-05004c4c0d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:35.499737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e06bd-66e3-4c60-8444-05004c4c0d6c admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:35.515550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1176/2371] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:22:35.519630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcb132-08e0-4d54-8a48-3135fbb7412b admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:35.532505 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcb132-08e0-4d54-8a48-3135fbb7412b admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:35.537920 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ef5be-b221-49e3-8033-9cab0306b6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:35.538406 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ef5be-b221-49e3-8033-9cab0306b6aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:35.538690 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ef5be-b221-49e3-8033-9cab0306b6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:35.538968 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ef5be-b221-49e3-8033-9cab0306b6aa admin admin] PATH_INFO: `/v3/projects/72d271ef50d0456cadaed5c8c42568b4/users/736728f0ef3941ed8badeb2b2bd7d61c/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:35.557975 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ef5be-b221-49e3-8033-9cab0306b6aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d271ef50d0456cadaed5c8c42568b4, user_id=736728f0ef3941ed8badeb2b2bd7d61c, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:35.560691 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ef5be-b221-49e3-8033-9cab0306b6aa admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:35.575415 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1196/2372] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:22:35 2022] PUT /identity/v3/projects/72d271ef50d0456cadaed5c8c42568b4/users/736728f0ef3941ed8badeb2b2bd7d61c/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:22:35.585722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7c9e7-3f59-4015-9f75-5b617ca9070f None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:35.586513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7c9e7-3f59-4015-9f75-5b617ca9070f None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:35.587958 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7c9e7-3f59-4015-9f75-5b617ca9070f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:35.622579 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-1fe7c9e7-3f59-4015-9f75-5b617ca9070f None None] MFA Rules not processed for user `736728f0ef3941ed8badeb2b2bd7d61c`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:35.624537 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-1fe7c9e7-3f59-4015-9f75-5b617ca9070f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:35.719323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1177/2373] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:22:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:35.725034 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ef5be-b221-49e3-8033-9cab0306b6aa admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:35.807011 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ef5be-b221-49e3-8033-9cab0306b6aa admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:35.811827 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46182cb3-fef2-49cf-9518-b4c898a6b1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:35.812497 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46182cb3-fef2-49cf-9518-b4c898a6b1e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:35.812785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46182cb3-fef2-49cf-9518-b4c898a6b1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:35.813062 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46182cb3-fef2-49cf-9518-b4c898a6b1e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:35.813758 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46182cb3-fef2-49cf-9518-b4c898a6b1e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:35.815730 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46182cb3-fef2-49cf-9518-b4c898a6b1e1 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:35.847027 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1197/2374] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:22:35 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:22:35.848203 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7c9e7-3f59-4015-9f75-5b617ca9070f None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:35.859959 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7c9e7-3f59-4015-9f75-5b617ca9070f None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:35.867128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:35.932243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a6cf6-0a40-4cd2-a264-0fec4b82c6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:35.932934 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a6cf6-0a40-4cd2-a264-0fec4b82c6ce admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:35.933365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a6cf6-0a40-4cd2-a264-0fec4b82c6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:35.933788 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a6cf6-0a40-4cd2-a264-0fec4b82c6ce admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:35.934668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a6cf6-0a40-4cd2-a264-0fec4b82c6ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:35.936616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a6cf6-0a40-4cd2-a264-0fec4b82c6ce admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:35.964043 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1178/2375] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:22:35 2022] POST /identity/v3/users => generated 297 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:22:35.965324 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46182cb3-fef2-49cf-9518-b4c898a6b1e1 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:35.978354 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46182cb3-fef2-49cf-9518-b4c898a6b1e1 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:35.982959 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08b939-b5f0-4e3f-a395-4e05b3908226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:35.983638 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08b939-b5f0-4e3f-a395-4e05b3908226 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:35.983926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08b939-b5f0-4e3f-a395-4e05b3908226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:35.984209 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08b939-b5f0-4e3f-a395-4e05b3908226 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:35.985056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08b939-b5f0-4e3f-a395-4e05b3908226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:35.986703 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08b939-b5f0-4e3f-a395-4e05b3908226 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:35.998047 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1198/2376] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:22:36.002497 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a6cf6-0a40-4cd2-a264-0fec4b82c6ce admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:36.013615 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a6cf6-0a40-4cd2-a264-0fec4b82c6ce admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:36.018595 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff831d-cae7-434f-b0b1-6eb496196bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:36.019605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff831d-cae7-434f-b0b1-6eb496196bd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:36.019909 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff831d-cae7-434f-b0b1-6eb496196bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:36.020193 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff831d-cae7-434f-b0b1-6eb496196bd8 admin admin] PATH_INFO: `/v3/projects/781c017c38364635a05e919904dc071b/users/2ae05b38742a45b6a5c078ed62aa2d9f/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:36.044623 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff831d-cae7-434f-b0b1-6eb496196bd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=781c017c38364635a05e919904dc071b, user_id=2ae05b38742a45b6a5c078ed62aa2d9f, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:36.047465 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff831d-cae7-434f-b0b1-6eb496196bd8 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:36.061697 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1179/2377] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:22:36 2022] PUT /identity/v3/projects/781c017c38364635a05e919904dc071b/users/2ae05b38742a45b6a5c078ed62aa2d9f/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:22:36.065898 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08b939-b5f0-4e3f-a395-4e05b3908226 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:36.081109 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08b939-b5f0-4e3f-a395-4e05b3908226 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:36.166225 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1a412-eca2-49d9-a853-851d1d97bc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:36.166926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1a412-eca2-49d9-a853-851d1d97bc59 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:36.167215 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1a412-eca2-49d9-a853-851d1d97bc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:36.167502 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1a412-eca2-49d9-a853-851d1d97bc59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:36.168238 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1a412-eca2-49d9-a853-851d1d97bc59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:36.169938 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1a412-eca2-49d9-a853-851d1d97bc59 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:36.187492 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1199/2378] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:22:36.188694 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff831d-cae7-434f-b0b1-6eb496196bd8 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:36.200551 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff831d-cae7-434f-b0b1-6eb496196bd8 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:36.207640 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f48cd-f2b3-4a69-968e-5c8c1f20045f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:36.208566 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f48cd-f2b3-4a69-968e-5c8c1f20045f admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:36.208856 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f48cd-f2b3-4a69-968e-5c8c1f20045f admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:36.209139 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f48cd-f2b3-4a69-968e-5c8c1f20045f admin admin] PATH_INFO: `/v3/projects/781c017c38364635a05e919904dc071b/users/2ae05b38742a45b6a5c078ed62aa2d9f/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:36.211560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f48cd-f2b3-4a69-968e-5c8c1f20045f admin admin] RBAC: Authorizing `identity:create_grant(project_id=781c017c38364635a05e919904dc071b, user_id=2ae05b38742a45b6a5c078ed62aa2d9f, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:36.214954 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f48cd-f2b3-4a69-968e-5c8c1f20045f admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:36.234262 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1180/2379] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:22:36 2022] PUT /identity/v3/projects/781c017c38364635a05e919904dc071b/users/2ae05b38742a45b6a5c078ed62aa2d9f/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:22:36.239961 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec835547-6640-4b08-86a8-ff17d05b25fa None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:36.240287 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec835547-6640-4b08-86a8-ff17d05b25fa None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:36.240553 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec835547-6640-4b08-86a8-ff17d05b25fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:36.277825 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-ec835547-6640-4b08-86a8-ff17d05b25fa None None] MFA Rules not processed for user `2ae05b38742a45b6a5c078ed62aa2d9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:36.279412 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-ec835547-6640-4b08-86a8-ff17d05b25fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:36.291222 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:36.384614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1200/2380] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:22:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:36.394622 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f48cd-f2b3-4a69-968e-5c8c1f20045f admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:36.396966 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-278f48cd-f2b3-4a69-968e-5c8c1f20045f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:36.478865 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f48cd-f2b3-4a69-968e-5c8c1f20045f admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:36.485040 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf1f25-17de-48b4-af2e-7ffd0b18d442 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:36.485804 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf1f25-17de-48b4-af2e-7ffd0b18d442 service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:36.486093 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf1f25-17de-48b4-af2e-7ffd0b18d442 service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:36.486418 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf1f25-17de-48b4-af2e-7ffd0b18d442 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:36.512095 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf1f25-17de-48b4-af2e-7ffd0b18d442 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:36.513973 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf1f25-17de-48b4-af2e-7ffd0b18d442 service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:36.532063 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1181/2381] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:22:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:22:36.657660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec835547-6640-4b08-86a8-ff17d05b25fa None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:36.673029 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec835547-6640-4b08-86a8-ff17d05b25fa None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:36.694395 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a5c80-eac2-4a59-a32e-7e4760c4f572 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:36.695077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a5c80-eac2-4a59-a32e-7e4760c4f572 service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:36.695366 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a5c80-eac2-4a59-a32e-7e4760c4f572 service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:36.695647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a5c80-eac2-4a59-a32e-7e4760c4f572 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:36.765324 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a5c80-eac2-4a59-a32e-7e4760c4f572 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:36.766946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a5c80-eac2-4a59-a32e-7e4760c4f572 service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:36.778853 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1201/2382] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:22:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:22:36.988454 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf1f25-17de-48b4-af2e-7ffd0b18d442 service cinder] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:36.990170 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-a7cf1f25-17de-48b4-af2e-7ffd0b18d442 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:37.061746 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a5c80-eac2-4a59-a32e-7e4760c4f572 service cinder] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:37.064397 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-da3a5c80-eac2-4a59-a32e-7e4760c4f572 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:37.093578 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf1f25-17de-48b4-af2e-7ffd0b18d442 service cinder] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:37.104151 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c39c85-6bd1-4ad9-acd2-771a49d15b05 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '698828dd940f46e2b493ba55cd894eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:37.104830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c39c85-6bd1-4ad9-acd2-771a49d15b05 service placement] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:37.105119 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c39c85-6bd1-4ad9-acd2-771a49d15b05 service placement] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:37.105394 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c39c85-6bd1-4ad9-acd2-771a49d15b05 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:37.107519 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-74c39c85-6bd1-4ad9-acd2-771a49d15b05 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:37.116006 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:37.122424 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c39c85-6bd1-4ad9-acd2-771a49d15b05 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:37.124804 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c39c85-6bd1-4ad9-acd2-771a49d15b05 service placement] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:37.135955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1182/2383] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:22:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:22:37.136877 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c39c85-6bd1-4ad9-acd2-771a49d15b05 service placement] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:37.164322 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a5c80-eac2-4a59-a32e-7e4760c4f572 service cinder] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:37.169501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a20de-5dbc-476e-818c-7061ac130176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:37.170426 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a20de-5dbc-476e-818c-7061ac130176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:37.170710 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a20de-5dbc-476e-818c-7061ac130176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:37.170990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a20de-5dbc-476e-818c-7061ac130176 admin admin] PATH_INFO: `/v3/users/f25f35f5c4154efa967cf1c82c9f0e5b` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:37.172186 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a20de-5dbc-476e-818c-7061ac130176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f25f35f5c4154efa967cf1c82c9f0e5b)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:37.174158 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a20de-5dbc-476e-818c-7061ac130176 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:37.204033 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c39c85-6bd1-4ad9-acd2-771a49d15b05 service placement] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:37.208699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999728a-101e-4c87-8360-9a7f0406b614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:37.209580 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999728a-101e-4c87-8360-9a7f0406b614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:37.209867 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999728a-101e-4c87-8360-9a7f0406b614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:37.210176 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999728a-101e-4c87-8360-9a7f0406b614 admin admin] PATH_INFO: `/v3/users/736728f0ef3941ed8badeb2b2bd7d61c` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:37.211408 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999728a-101e-4c87-8360-9a7f0406b614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=736728f0ef3941ed8badeb2b2bd7d61c)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:37.213369 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999728a-101e-4c87-8360-9a7f0406b614 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:37.236839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:37.239347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-782a20de-5dbc-476e-818c-7061ac130176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f25f35f5c4154efa967cf1c82c9f0e5b'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:37.249669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-782a20de-5dbc-476e-818c-7061ac130176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f25f35f5c4154efa967cf1c82c9f0e5b'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:37.260454 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-782a20de-5dbc-476e-818c-7061ac130176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f25f35f5c4154efa967cf1c82c9f0e5b'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:37.261363 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-782a20de-5dbc-476e-818c-7061ac130176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f25f35f5c4154efa967cf1c82c9f0e5b'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:37.264781 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-0999728a-101e-4c87-8360-9a7f0406b614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '736728f0ef3941ed8badeb2b2bd7d61c'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:37.265449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-0999728a-101e-4c87-8360-9a7f0406b614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '736728f0ef3941ed8badeb2b2bd7d61c'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:37.273134 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-0999728a-101e-4c87-8360-9a7f0406b614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '736728f0ef3941ed8badeb2b2bd7d61c'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:37.277228 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-782a20de-5dbc-476e-818c-7061ac130176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f25f35f5c4154efa967cf1c82c9f0e5b'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:37.281129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-0999728a-101e-4c87-8360-9a7f0406b614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '736728f0ef3941ed8badeb2b2bd7d61c'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:37.283397 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1202/2384] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:22:37 2022] DELETE /identity/v3/users/f25f35f5c4154efa967cf1c82c9f0e5b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:22:37.296840 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-0999728a-101e-4c87-8360-9a7f0406b614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '736728f0ef3941ed8badeb2b2bd7d61c'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:37.307643 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1183/2385] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:22:37 2022] DELETE /identity/v3/users/736728f0ef3941ed8badeb2b2bd7d61c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:22:37.314314 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59311827-8ddf-4c0f-bb72-34ab995caa07 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:37.314845 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59311827-8ddf-4c0f-bb72-34ab995caa07 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:37.315353 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59311827-8ddf-4c0f-bb72-34ab995caa07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:37.344819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-59311827-8ddf-4c0f-bb72-34ab995caa07 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:37.347121 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-59311827-8ddf-4c0f-bb72-34ab995caa07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:37.411677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1203/2386] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:37.425620 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999728a-101e-4c87-8360-9a7f0406b614 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:37.426615 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-0999728a-101e-4c87-8360-9a7f0406b614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:37.494268 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999728a-101e-4c87-8360-9a7f0406b614 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:37.501407 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59311827-8ddf-4c0f-bb72-34ab995caa07 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:37.502946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-59311827-8ddf-4c0f-bb72-34ab995caa07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:37.504030 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6f5c5-7a3d-498c-9606-cae6158c4e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:37.504948 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6f5c5-7a3d-498c-9606-cae6158c4e6b service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:37.505327 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6f5c5-7a3d-498c-9606-cae6158c4e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:37.505617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6f5c5-7a3d-498c-9606-cae6158c4e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:37.516149 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59311827-8ddf-4c0f-bb72-34ab995caa07 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:37.523468 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a90ce-5768-4902-8ce0-18cc3cc51b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:37.524957 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a90ce-5768-4902-8ce0-18cc3cc51b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:37.525145 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6f5c5-7a3d-498c-9606-cae6158c4e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:37.525303 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a90ce-5768-4902-8ce0-18cc3cc51b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:37.525636 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a90ce-5768-4902-8ce0-18cc3cc51b1a admin admin] PATH_INFO: `/v3/projects/7f2fe3130454491384ebdfbc4ceb6679` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:37.527081 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a90ce-5768-4902-8ce0-18cc3cc51b1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f2fe3130454491384ebdfbc4ceb6679)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:37.527217 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6f5c5-7a3d-498c-9606-cae6158c4e6b service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:37.528908 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a90ce-5768-4902-8ce0-18cc3cc51b1a admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:37.540467 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1184/2387] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:22:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:22:37.598232 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b58a90ce-5768-4902-8ce0-18cc3cc51b1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f2fe3130454491384ebdfbc4ceb6679', 'request_id': 'req-b58a90ce-5768-4902-8ce0-18cc3cc51b1a'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:37.609451 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b58a90ce-5768-4902-8ce0-18cc3cc51b1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f2fe3130454491384ebdfbc4ceb6679', 'request_id': 'req-b58a90ce-5768-4902-8ce0-18cc3cc51b1a'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:37.621357 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b58a90ce-5768-4902-8ce0-18cc3cc51b1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f2fe3130454491384ebdfbc4ceb6679', 'request_id': 'req-b58a90ce-5768-4902-8ce0-18cc3cc51b1a'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:37.641181 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b58a90ce-5768-4902-8ce0-18cc3cc51b1a admin admin] The token cache is being invalidate because project 7f2fe3130454491384ebdfbc4ceb6679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:22:37.641805 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b58a90ce-5768-4902-8ce0-18cc3cc51b1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:37.642779 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b58a90ce-5768-4902-8ce0-18cc3cc51b1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:37.645563 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1204/2388] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:22:37 2022] DELETE /identity/v3/projects/7f2fe3130454491384ebdfbc4ceb6679 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:22:37.652232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6f5c5-7a3d-498c-9606-cae6158c4e6b service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:37.670725 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6f5c5-7a3d-498c-9606-cae6158c4e6b service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:37.694324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:37.746453 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03af17-31a6-49e7-bb6c-f3cab8f20218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:37.747346 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03af17-31a6-49e7-bb6c-f3cab8f20218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:37.747661 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03af17-31a6-49e7-bb6c-f3cab8f20218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:37.747941 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03af17-31a6-49e7-bb6c-f3cab8f20218 admin admin] PATH_INFO: `/v3/users/41035f7a4d95412fafd167d58ee08ced` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:37.749200 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03af17-31a6-49e7-bb6c-f3cab8f20218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41035f7a4d95412fafd167d58ee08ced)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:37.751195 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03af17-31a6-49e7-bb6c-f3cab8f20218 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:37.800956 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-5f03af17-31a6-49e7-bb6c-f3cab8f20218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41035f7a4d95412fafd167d58ee08ced'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:37.801647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-5f03af17-31a6-49e7-bb6c-f3cab8f20218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41035f7a4d95412fafd167d58ee08ced'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:37.809197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-5f03af17-31a6-49e7-bb6c-f3cab8f20218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41035f7a4d95412fafd167d58ee08ced'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:37.819185 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-5f03af17-31a6-49e7-bb6c-f3cab8f20218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41035f7a4d95412fafd167d58ee08ced'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:37.833666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-5f03af17-31a6-49e7-bb6c-f3cab8f20218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41035f7a4d95412fafd167d58ee08ced'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:37.838918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a90ce-5768-4902-8ce0-18cc3cc51b1a admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:37.840354 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-b58a90ce-5768-4902-8ce0-18cc3cc51b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:37.846188 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1185/2389] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:22:37 2022] DELETE /identity/v3/users/41035f7a4d95412fafd167d58ee08ced => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:22:37.864269 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a90ce-5768-4902-8ce0-18cc3cc51b1a admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:37.916953 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:37.937780 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a1613-4ccd-4ebb-8bb3-fb925032b462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:37.938889 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a1613-4ccd-4ebb-8bb3-fb925032b462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:37.939181 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a1613-4ccd-4ebb-8bb3-fb925032b462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:37.939842 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a1613-4ccd-4ebb-8bb3-fb925032b462 admin admin] PATH_INFO: `/v3/projects/72d271ef50d0456cadaed5c8c42568b4` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:37.941077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a1613-4ccd-4ebb-8bb3-fb925032b462 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72d271ef50d0456cadaed5c8c42568b4)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:37.943231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a1613-4ccd-4ebb-8bb3-fb925032b462 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:38.003581 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-937a1613-4ccd-4ebb-8bb3-fb925032b462 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72d271ef50d0456cadaed5c8c42568b4', 'request_id': 'req-937a1613-4ccd-4ebb-8bb3-fb925032b462'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:38.011746 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-937a1613-4ccd-4ebb-8bb3-fb925032b462 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72d271ef50d0456cadaed5c8c42568b4', 'request_id': 'req-937a1613-4ccd-4ebb-8bb3-fb925032b462'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:38.021508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-937a1613-4ccd-4ebb-8bb3-fb925032b462 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72d271ef50d0456cadaed5c8c42568b4', 'request_id': 'req-937a1613-4ccd-4ebb-8bb3-fb925032b462'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:38.036634 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-937a1613-4ccd-4ebb-8bb3-fb925032b462 admin admin] The token cache is being invalidate because project 72d271ef50d0456cadaed5c8c42568b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:22:38.036945 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-937a1613-4ccd-4ebb-8bb3-fb925032b462 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:38.037818 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-937a1613-4ccd-4ebb-8bb3-fb925032b462 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:38.041669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1205/2390] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:22:37 2022] DELETE /identity/v3/projects/72d271ef50d0456cadaed5c8c42568b4 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:22:38.044684 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03af17-31a6-49e7-bb6c-f3cab8f20218 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:38.045848 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a1613-4ccd-4ebb-8bb3-fb925032b462 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:38.046211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-5f03af17-31a6-49e7-bb6c-f3cab8f20218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:38.048098 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-937a1613-4ccd-4ebb-8bb3-fb925032b462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:38.061500 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03af17-31a6-49e7-bb6c-f3cab8f20218 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:38.126046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3318cfc-5f01-42f8-b8f6-60894c79ac87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:38.127149 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3318cfc-5f01-42f8-b8f6-60894c79ac87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:38.127368 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3318cfc-5f01-42f8-b8f6-60894c79ac87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:38.127648 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3318cfc-5f01-42f8-b8f6-60894c79ac87 admin admin] PATH_INFO: `/v3/projects/dcd4a6b1131e41b8b8aafd4cefc8eb5d` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:38.128947 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3318cfc-5f01-42f8-b8f6-60894c79ac87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcd4a6b1131e41b8b8aafd4cefc8eb5d)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:38.130926 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3318cfc-5f01-42f8-b8f6-60894c79ac87 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:38.134135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a1613-4ccd-4ebb-8bb3-fb925032b462 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:38.145318 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d566c1-caac-4004-8322-73f0a7db7341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:38.146544 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d566c1-caac-4004-8322-73f0a7db7341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:38.146834 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d566c1-caac-4004-8322-73f0a7db7341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:38.147106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d566c1-caac-4004-8322-73f0a7db7341 admin admin] PATH_INFO: `/v3/users/2ae05b38742a45b6a5c078ed62aa2d9f` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:38.148480 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d566c1-caac-4004-8322-73f0a7db7341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ae05b38742a45b6a5c078ed62aa2d9f)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:38.151426 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d566c1-caac-4004-8322-73f0a7db7341 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:38.181316 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:38.193820 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-f3318cfc-5f01-42f8-b8f6-60894c79ac87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcd4a6b1131e41b8b8aafd4cefc8eb5d', 'request_id': 'req-f3318cfc-5f01-42f8-b8f6-60894c79ac87'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:38.202942 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-f3318cfc-5f01-42f8-b8f6-60894c79ac87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcd4a6b1131e41b8b8aafd4cefc8eb5d', 'request_id': 'req-f3318cfc-5f01-42f8-b8f6-60894c79ac87'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:38.215646 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-09d566c1-caac-4004-8322-73f0a7db7341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ae05b38742a45b6a5c078ed62aa2d9f'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:38.222615 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-f3318cfc-5f01-42f8-b8f6-60894c79ac87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcd4a6b1131e41b8b8aafd4cefc8eb5d', 'request_id': 'req-f3318cfc-5f01-42f8-b8f6-60894c79ac87'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:38.225460 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-09d566c1-caac-4004-8322-73f0a7db7341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ae05b38742a45b6a5c078ed62aa2d9f'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:38.234720 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-09d566c1-caac-4004-8322-73f0a7db7341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ae05b38742a45b6a5c078ed62aa2d9f'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:38.235629 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-09d566c1-caac-4004-8322-73f0a7db7341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ae05b38742a45b6a5c078ed62aa2d9f'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:38.238779 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-f3318cfc-5f01-42f8-b8f6-60894c79ac87 admin admin] The token cache is being invalidate because project dcd4a6b1131e41b8b8aafd4cefc8eb5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:22:38.239116 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-f3318cfc-5f01-42f8-b8f6-60894c79ac87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:38.239928 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-f3318cfc-5f01-42f8-b8f6-60894c79ac87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:38.242180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1186/2391] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:22:38 2022] DELETE /identity/v3/projects/dcd4a6b1131e41b8b8aafd4cefc8eb5d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:22:38.252341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:38.255008 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-09d566c1-caac-4004-8322-73f0a7db7341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ae05b38742a45b6a5c078ed62aa2d9f'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:38.272270 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1206/2392] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:22:38 2022] DELETE /identity/v3/users/2ae05b38742a45b6a5c078ed62aa2d9f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:22:38.593962 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3318cfc-5f01-42f8-b8f6-60894c79ac87 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:38.595438 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-f3318cfc-5f01-42f8-b8f6-60894c79ac87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:38.667515 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3318cfc-5f01-42f8-b8f6-60894c79ac87 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:38.728314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f45cb-9209-4f54-91f2-f07dcb35617d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:38.729194 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f45cb-9209-4f54-91f2-f07dcb35617d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:38.729480 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f45cb-9209-4f54-91f2-f07dcb35617d admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:38.729757 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f45cb-9209-4f54-91f2-f07dcb35617d admin admin] PATH_INFO: `/v3/projects/781c017c38364635a05e919904dc071b` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:38.731085 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f45cb-9209-4f54-91f2-f07dcb35617d admin admin] RBAC: Authorizing `identity:delete_project(project_id=781c017c38364635a05e919904dc071b)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:38.733035 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f45cb-9209-4f54-91f2-f07dcb35617d admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:38.779098 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-660f45cb-9209-4f54-91f2-f07dcb35617d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '781c017c38364635a05e919904dc071b', 'request_id': 'req-660f45cb-9209-4f54-91f2-f07dcb35617d'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:38.786624 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-660f45cb-9209-4f54-91f2-f07dcb35617d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '781c017c38364635a05e919904dc071b', 'request_id': 'req-660f45cb-9209-4f54-91f2-f07dcb35617d'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:38.794256 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-660f45cb-9209-4f54-91f2-f07dcb35617d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '781c017c38364635a05e919904dc071b', 'request_id': 'req-660f45cb-9209-4f54-91f2-f07dcb35617d'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:38.805336 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-660f45cb-9209-4f54-91f2-f07dcb35617d admin admin] The token cache is being invalidate because project 781c017c38364635a05e919904dc071b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:22:38.805744 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-660f45cb-9209-4f54-91f2-f07dcb35617d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:38.806560 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-660f45cb-9209-4f54-91f2-f07dcb35617d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:38.808324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1187/2393] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:22:38 2022] DELETE /identity/v3/projects/781c017c38364635a05e919904dc071b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:22:38.813275 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f80a2-f5e9-4d75-951e-b4e189c03a51 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:38.813572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f80a2-f5e9-4d75-951e-b4e189c03a51 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:38.813887 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f80a2-f5e9-4d75-951e-b4e189c03a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:38.833076 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-d53f80a2-f5e9-4d75-951e-b4e189c03a51 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:38.834312 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-d53f80a2-f5e9-4d75-951e-b4e189c03a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:38.893481 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1207/2394] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:38.903088 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d5eba-b3cd-4140-9808-5906120bda15 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:38.903394 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d5eba-b3cd-4140-9808-5906120bda15 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:38.903680 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d5eba-b3cd-4140-9808-5906120bda15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:38.910087 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:38.927257 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-5c0d5eba-b3cd-4140-9808-5906120bda15 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:38.928638 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-5c0d5eba-b3cd-4140-9808-5906120bda15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:38.936609 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1188/2395] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:38.940917 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f80a2-f5e9-4d75-951e-b4e189c03a51 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:38.951390 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f80a2-f5e9-4d75-951e-b4e189c03a51 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:38.956058 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767dcca-55bd-4e39-822a-2398f4b52ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:38.956722 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767dcca-55bd-4e39-822a-2398f4b52ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:38.957008 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767dcca-55bd-4e39-822a-2398f4b52ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:38.957286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767dcca-55bd-4e39-822a-2398f4b52ed5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:38.958018 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767dcca-55bd-4e39-822a-2398f4b52ed5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:22:38.958353 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767dcca-55bd-4e39-822a-2398f4b52ed5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:38.960011 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767dcca-55bd-4e39-822a-2398f4b52ed5 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:38.972666 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1208/2396] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:22:38.977064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d5eba-b3cd-4140-9808-5906120bda15 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:38.986645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d5eba-b3cd-4140-9808-5906120bda15 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:38.991320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9541ee8-3e8d-4523-b730-8021f427d191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:38.991972 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9541ee8-3e8d-4523-b730-8021f427d191 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:38.992255 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9541ee8-3e8d-4523-b730-8021f427d191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:38.992530 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9541ee8-3e8d-4523-b730-8021f427d191 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:38.993215 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9541ee8-3e8d-4523-b730-8021f427d191 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:38.995176 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9541ee8-3e8d-4523-b730-8021f427d191 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:39.022715 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1189/2397] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:22:38 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:22:39.027644 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767dcca-55bd-4e39-822a-2398f4b52ed5 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:39.038236 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767dcca-55bd-4e39-822a-2398f4b52ed5 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:39.096993 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c42e1-131a-420f-8874-29cec77abf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:39.097680 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c42e1-131a-420f-8874-29cec77abf9e admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:39.097972 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c42e1-131a-420f-8874-29cec77abf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:39.098287 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c42e1-131a-420f-8874-29cec77abf9e admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:39.098986 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c42e1-131a-420f-8874-29cec77abf9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:39.100930 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c42e1-131a-420f-8874-29cec77abf9e admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:39.120825 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1209/2398] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:22:39 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:22:39.124954 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9541ee8-3e8d-4523-b730-8021f427d191 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:39.136864 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9541ee8-3e8d-4523-b730-8021f427d191 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:39.141711 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7eb7a4-35ea-4195-9a08-f7e40699e237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:39.142438 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7eb7a4-35ea-4195-9a08-f7e40699e237 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:39.142725 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7eb7a4-35ea-4195-9a08-f7e40699e237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:39.143004 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7eb7a4-35ea-4195-9a08-f7e40699e237 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:39.143733 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7eb7a4-35ea-4195-9a08-f7e40699e237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:39.145332 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7eb7a4-35ea-4195-9a08-f7e40699e237 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:39.157073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1190/2399] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:22:39.161066 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c42e1-131a-420f-8874-29cec77abf9e admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:39.171228 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c42e1-131a-420f-8874-29cec77abf9e admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:39.175879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb0831-b459-45fc-9e06-2ed02762f40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:39.176559 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb0831-b459-45fc-9e06-2ed02762f40c admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:39.176846 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb0831-b459-45fc-9e06-2ed02762f40c admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:39.177126 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb0831-b459-45fc-9e06-2ed02762f40c admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:39.177860 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb0831-b459-45fc-9e06-2ed02762f40c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:39.179521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb0831-b459-45fc-9e06-2ed02762f40c admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:39.190297 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1210/2400] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:22:39.194478 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7eb7a4-35ea-4195-9a08-f7e40699e237 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:39.205474 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7eb7a4-35ea-4195-9a08-f7e40699e237 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:39.210224 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252c9d7-1fb6-46a5-a1a2-343f73b7db0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:39.211127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252c9d7-1fb6-46a5-a1a2-343f73b7db0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:39.211420 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252c9d7-1fb6-46a5-a1a2-343f73b7db0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:39.211738 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252c9d7-1fb6-46a5-a1a2-343f73b7db0b admin admin] PATH_INFO: `/v3/projects/844e077a049845e78cb5a8249979078e/users/7921b5d1c6984bc1b9821738ba3e535e/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:39.226826 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252c9d7-1fb6-46a5-a1a2-343f73b7db0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=844e077a049845e78cb5a8249979078e, user_id=7921b5d1c6984bc1b9821738ba3e535e, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:39.229543 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252c9d7-1fb6-46a5-a1a2-343f73b7db0b admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:39.243189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1191/2401] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:22:39 2022] PUT /identity/v3/projects/844e077a049845e78cb5a8249979078e/users/7921b5d1c6984bc1b9821738ba3e535e/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:22:39.253654 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49977c-68e2-4577-acaa-dea0f5cfc967 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:39.254178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49977c-68e2-4577-acaa-dea0f5cfc967 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:39.254276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49977c-68e2-4577-acaa-dea0f5cfc967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:39.281498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-3c49977c-68e2-4577-acaa-dea0f5cfc967 None None] MFA Rules not processed for user `7921b5d1c6984bc1b9821738ba3e535e`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:39.282776 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-3c49977c-68e2-4577-acaa-dea0f5cfc967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:39.332459 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:39.351519 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1211/2402] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:22:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:22:39.362631 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252c9d7-1fb6-46a5-a1a2-343f73b7db0b admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:39.364401 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-d252c9d7-1fb6-46a5-a1a2-343f73b7db0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:39.422677 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252c9d7-1fb6-46a5-a1a2-343f73b7db0b admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:39.426516 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6db21-c961-4429-9901-c80cee0d614e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:39.427195 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6db21-c961-4429-9901-c80cee0d614e service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:39.427484 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6db21-c961-4429-9901-c80cee0d614e service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:39.427765 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6db21-c961-4429-9901-c80cee0d614e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:39.437635 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6db21-c961-4429-9901-c80cee0d614e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:39.439128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6db21-c961-4429-9901-c80cee0d614e service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:39.449362 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1192/2403] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:22:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:22:39.470245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49977c-68e2-4577-acaa-dea0f5cfc967 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:39.545544 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49977c-68e2-4577-acaa-dea0f5cfc967 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:39.550376 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fc10b-63ba-4d63-98b0-0d6e302e6a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:39.551290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fc10b-63ba-4d63-98b0-0d6e302e6a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:39.551576 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fc10b-63ba-4d63-98b0-0d6e302e6a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:39.551853 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fc10b-63ba-4d63-98b0-0d6e302e6a91 admin admin] PATH_INFO: `/v3/users/7921b5d1c6984bc1b9821738ba3e535e` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:39.553100 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fc10b-63ba-4d63-98b0-0d6e302e6a91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7921b5d1c6984bc1b9821738ba3e535e)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:39.555222 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fc10b-63ba-4d63-98b0-0d6e302e6a91 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:39.603602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-0d2fc10b-63ba-4d63-98b0-0d6e302e6a91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7921b5d1c6984bc1b9821738ba3e535e'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:39.611562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-0d2fc10b-63ba-4d63-98b0-0d6e302e6a91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7921b5d1c6984bc1b9821738ba3e535e'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:39.619541 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-0d2fc10b-63ba-4d63-98b0-0d6e302e6a91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7921b5d1c6984bc1b9821738ba3e535e'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:39.620236 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-0d2fc10b-63ba-4d63-98b0-0d6e302e6a91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7921b5d1c6984bc1b9821738ba3e535e'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:39.632677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-0d2fc10b-63ba-4d63-98b0-0d6e302e6a91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7921b5d1c6984bc1b9821738ba3e535e'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:39.639002 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1212/2404] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:22:39 2022] DELETE /identity/v3/users/7921b5d1c6984bc1b9821738ba3e535e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:22:39.643725 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9e85d-3a16-456a-be6b-1ae3755a991b None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:39.644019 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9e85d-3a16-456a-be6b-1ae3755a991b None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:39.644299 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9e85d-3a16-456a-be6b-1ae3755a991b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:39.662908 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-dfe9e85d-3a16-456a-be6b-1ae3755a991b None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:39.664132 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-dfe9e85d-3a16-456a-be6b-1ae3755a991b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:39.731561 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1193/2405] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:39.741396 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fc10b-63ba-4d63-98b0-0d6e302e6a91 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:39.742945 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-0d2fc10b-63ba-4d63-98b0-0d6e302e6a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:39.800039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fc10b-63ba-4d63-98b0-0d6e302e6a91 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:39.803649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe472a5-4ca4-4e7f-8ae9-a44c35bad970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:39.804304 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe472a5-4ca4-4e7f-8ae9-a44c35bad970 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:39.804587 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe472a5-4ca4-4e7f-8ae9-a44c35bad970 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:39.804863 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe472a5-4ca4-4e7f-8ae9-a44c35bad970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:39.814015 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe472a5-4ca4-4e7f-8ae9-a44c35bad970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:39.815540 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe472a5-4ca4-4e7f-8ae9-a44c35bad970 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:39.825705 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1213/2406] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:22:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:22:40.103968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9e85d-3a16-456a-be6b-1ae3755a991b None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:40.105449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-dfe9e85d-3a16-456a-be6b-1ae3755a991b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:40.121403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9e85d-3a16-456a-be6b-1ae3755a991b None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:40.126511 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a212ba-2208-44f8-bc0d-6d4bdc4b7565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:40.127379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a212ba-2208-44f8-bc0d-6d4bdc4b7565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:40.127685 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a212ba-2208-44f8-bc0d-6d4bdc4b7565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:40.127968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a212ba-2208-44f8-bc0d-6d4bdc4b7565 admin admin] PATH_INFO: `/v3/projects/844e077a049845e78cb5a8249979078e` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:40.129283 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a212ba-2208-44f8-bc0d-6d4bdc4b7565 admin admin] RBAC: Authorizing `identity:delete_project(project_id=844e077a049845e78cb5a8249979078e)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:40.131197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a212ba-2208-44f8-bc0d-6d4bdc4b7565 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:40.170267 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:40.179610 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-52a212ba-2208-44f8-bc0d-6d4bdc4b7565 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '844e077a049845e78cb5a8249979078e', 'request_id': 'req-52a212ba-2208-44f8-bc0d-6d4bdc4b7565'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:40.186301 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-52a212ba-2208-44f8-bc0d-6d4bdc4b7565 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '844e077a049845e78cb5a8249979078e', 'request_id': 'req-52a212ba-2208-44f8-bc0d-6d4bdc4b7565'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:40.193597 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-52a212ba-2208-44f8-bc0d-6d4bdc4b7565 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '844e077a049845e78cb5a8249979078e', 'request_id': 'req-52a212ba-2208-44f8-bc0d-6d4bdc4b7565'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:40.204792 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-52a212ba-2208-44f8-bc0d-6d4bdc4b7565 admin admin] The token cache is being invalidate because project 844e077a049845e78cb5a8249979078e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:22:40.205083 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-52a212ba-2208-44f8-bc0d-6d4bdc4b7565 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:40.205727 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-52a212ba-2208-44f8-bc0d-6d4bdc4b7565 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:40.207318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1194/2407] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:22:40 2022] DELETE /identity/v3/projects/844e077a049845e78cb5a8249979078e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:22:40.212675 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428353f-58e9-4793-8b7b-8e1ecf72e5c6 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:40.212968 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428353f-58e9-4793-8b7b-8e1ecf72e5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:40.213274 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428353f-58e9-4793-8b7b-8e1ecf72e5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:40.232340 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-a428353f-58e9-4793-8b7b-8e1ecf72e5c6 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:40.233560 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a428353f-58e9-4793-8b7b-8e1ecf72e5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:40.242108 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:40.299478 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1214/2408] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:40.307090 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899837d-4d5b-45e3-b450-1f2824ab621a None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:40.307525 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899837d-4d5b-45e3-b450-1f2824ab621a None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:40.307655 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899837d-4d5b-45e3-b450-1f2824ab621a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:40.326212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-5899837d-4d5b-45e3-b450-1f2824ab621a None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:40.327409 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-5899837d-4d5b-45e3-b450-1f2824ab621a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:40.335184 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1195/2409] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:40.340053 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428353f-58e9-4793-8b7b-8e1ecf72e5c6 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:40.349792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428353f-58e9-4793-8b7b-8e1ecf72e5c6 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:40.354411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7d381-f3c7-4927-b67d-ebcad688acd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:40.355091 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7d381-f3c7-4927-b67d-ebcad688acd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:40.355376 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7d381-f3c7-4927-b67d-ebcad688acd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:40.355654 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7d381-f3c7-4927-b67d-ebcad688acd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:40.356388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7d381-f3c7-4927-b67d-ebcad688acd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:22:40.356700 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7d381-f3c7-4927-b67d-ebcad688acd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:40.358359 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7d381-f3c7-4927-b67d-ebcad688acd1 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:40.370636 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1215/2410] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:22:40.375022 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899837d-4d5b-45e3-b450-1f2824ab621a None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:40.385087 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899837d-4d5b-45e3-b450-1f2824ab621a None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:40.389794 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfab4a-3fe2-473f-9411-6fee6c2e06e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:40.390489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfab4a-3fe2-473f-9411-6fee6c2e06e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:40.390801 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfab4a-3fe2-473f-9411-6fee6c2e06e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:40.391077 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfab4a-3fe2-473f-9411-6fee6c2e06e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:40.391759 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecfab4a-3fe2-473f-9411-6fee6c2e06e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:40.393650 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecfab4a-3fe2-473f-9411-6fee6c2e06e6 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:40.419314 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1196/2411] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:22:40 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:22:40.423596 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7d381-f3c7-4927-b67d-ebcad688acd1 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:40.437108 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7d381-f3c7-4927-b67d-ebcad688acd1 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:40.492247 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecfc17-04d9-47df-9ea3-3443e7ea215d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:40.492947 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecfc17-04d9-47df-9ea3-3443e7ea215d admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:40.493232 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecfc17-04d9-47df-9ea3-3443e7ea215d admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:40.493509 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecfc17-04d9-47df-9ea3-3443e7ea215d admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:40.494252 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecfc17-04d9-47df-9ea3-3443e7ea215d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:40.496194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecfc17-04d9-47df-9ea3-3443e7ea215d admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:40.522108 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1216/2412] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:22:40 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:22:40.526827 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfab4a-3fe2-473f-9411-6fee6c2e06e6 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:40.537397 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfab4a-3fe2-473f-9411-6fee6c2e06e6 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:40.542378 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda83bd8-9a11-48f4-ae23-a79d78a5f565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:40.543054 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda83bd8-9a11-48f4-ae23-a79d78a5f565 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:40.543342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda83bd8-9a11-48f4-ae23-a79d78a5f565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:40.543623 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda83bd8-9a11-48f4-ae23-a79d78a5f565 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:40.544354 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda83bd8-9a11-48f4-ae23-a79d78a5f565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:40.546023 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda83bd8-9a11-48f4-ae23-a79d78a5f565 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:40.556673 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1197/2413] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:22:40.560594 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecfc17-04d9-47df-9ea3-3443e7ea215d admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:40.571651 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecfc17-04d9-47df-9ea3-3443e7ea215d admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:40.576369 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e88b8b-bcbb-4927-878c-beab44731f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:40.577045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e88b8b-bcbb-4927-878c-beab44731f33 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:40.577332 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e88b8b-bcbb-4927-878c-beab44731f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:40.577618 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e88b8b-bcbb-4927-878c-beab44731f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:40.578385 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e88b8b-bcbb-4927-878c-beab44731f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:40.580002 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e88b8b-bcbb-4927-878c-beab44731f33 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:40.591004 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1217/2414] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:22:40.595125 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda83bd8-9a11-48f4-ae23-a79d78a5f565 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:40.606408 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda83bd8-9a11-48f4-ae23-a79d78a5f565 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:40.611366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdefcfd-43e5-4737-b4ce-5efa6dc2f9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:40.612272 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdefcfd-43e5-4737-b4ce-5efa6dc2f9ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:40.612587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdefcfd-43e5-4737-b4ce-5efa6dc2f9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:40.612867 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdefcfd-43e5-4737-b4ce-5efa6dc2f9ea admin admin] PATH_INFO: `/v3/projects/0c13d31e6db54be58a69e77e16a8af95/users/d0e080ed50ba4f02a76478ef164913a2/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:40.628359 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdefcfd-43e5-4737-b4ce-5efa6dc2f9ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c13d31e6db54be58a69e77e16a8af95, user_id=d0e080ed50ba4f02a76478ef164913a2, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:40.631042 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdefcfd-43e5-4737-b4ce-5efa6dc2f9ea admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:40.645160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1198/2415] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:22:40 2022] PUT /identity/v3/projects/0c13d31e6db54be58a69e77e16a8af95/users/d0e080ed50ba4f02a76478ef164913a2/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:22:40.656988 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36867e2d-fa25-499b-aab7-68cf2c719cc7 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:40.657279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36867e2d-fa25-499b-aab7-68cf2c719cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:40.657560 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36867e2d-fa25-499b-aab7-68cf2c719cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:40.685575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-36867e2d-fa25-499b-aab7-68cf2c719cc7 None None] MFA Rules not processed for user `d0e080ed50ba4f02a76478ef164913a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:40.686863 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-36867e2d-fa25-499b-aab7-68cf2c719cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:40.760333 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1218/2416] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:22:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:40.770965 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdefcfd-43e5-4737-b4ce-5efa6dc2f9ea admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:40.772682 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-2fdefcfd-43e5-4737-b4ce-5efa6dc2f9ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:40.830515 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdefcfd-43e5-4737-b4ce-5efa6dc2f9ea admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:40.834197 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230eecb-2875-4ef7-8fc7-58f175e80815 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:40.834802 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230eecb-2875-4ef7-8fc7-58f175e80815 service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:40.835092 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230eecb-2875-4ef7-8fc7-58f175e80815 service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:40.835372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230eecb-2875-4ef7-8fc7-58f175e80815 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:40.844445 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230eecb-2875-4ef7-8fc7-58f175e80815 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:40.845882 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230eecb-2875-4ef7-8fc7-58f175e80815 service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:40.855381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1199/2417] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:22:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:22:42.195914 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15650b0-db6a-4fd3-a5fa-b3315c8b823f None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:42.196448 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15650b0-db6a-4fd3-a5fa-b3315c8b823f None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:42.196567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15650b0-db6a-4fd3-a5fa-b3315c8b823f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:42.214846 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-a15650b0-db6a-4fd3-a5fa-b3315c8b823f None None] MFA Rules not processed for user `d0e080ed50ba4f02a76478ef164913a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:42.216071 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a15650b0-db6a-4fd3-a5fa-b3315c8b823f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:42.223020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1219/2418] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:22:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:42.681005 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230eecb-2875-4ef7-8fc7-58f175e80815 service cinder] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:42.682350 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-9230eecb-2875-4ef7-8fc7-58f175e80815 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:42.755399 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230eecb-2875-4ef7-8fc7-58f175e80815 service cinder] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:42.761184 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac08de4-c16e-412f-9cc0-b7a9edb4e709 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '698828dd940f46e2b493ba55cd894eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:42.761845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac08de4-c16e-412f-9cc0-b7a9edb4e709 service placement] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:42.762168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac08de4-c16e-412f-9cc0-b7a9edb4e709 service placement] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:42.762452 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac08de4-c16e-412f-9cc0-b7a9edb4e709 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:42.764240 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-9ac08de4-c16e-412f-9cc0-b7a9edb4e709 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:42.772389 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:42.777775 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac08de4-c16e-412f-9cc0-b7a9edb4e709 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:42.780021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac08de4-c16e-412f-9cc0-b7a9edb4e709 service placement] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:42.790714 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1200/2419] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:22:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:22:49.991824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15650b0-db6a-4fd3-a5fa-b3315c8b823f None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:49.993880 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a15650b0-db6a-4fd3-a5fa-b3315c8b823f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:49.998943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:50.052585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15650b0-db6a-4fd3-a5fa-b3315c8b823f None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:50.056197 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba2037-596b-4f8a-94f8-03c853d2894e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:50.056846 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba2037-596b-4f8a-94f8-03c853d2894e service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:50.057131 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba2037-596b-4f8a-94f8-03c853d2894e service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:50.057409 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba2037-596b-4f8a-94f8-03c853d2894e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:50.059214 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-d0ba2037-596b-4f8a-94f8-03c853d2894e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:50.068693 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba2037-596b-4f8a-94f8-03c853d2894e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:50.070185 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba2037-596b-4f8a-94f8-03c853d2894e service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:50.077962 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1220/2420] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:22:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:22:52.786411 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:55.821458 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb6743-7918-423b-98e8-b70b5de35b37 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:55.822011 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb6743-7918-423b-98e8-b70b5de35b37 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:55.822103 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb6743-7918-423b-98e8-b70b5de35b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:55.839794 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-9aeb6743-7918-423b-98e8-b70b5de35b37 None None] MFA Rules not processed for user `72f556aac45c460cb573498aab7590fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:55.841004 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-9aeb6743-7918-423b-98e8-b70b5de35b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:55.895721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1201/2421] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Jul 12 13:22:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:55.907372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba2037-596b-4f8a-94f8-03c853d2894e service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:55.908797 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-d0ba2037-596b-4f8a-94f8-03c853d2894e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:55.978408 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba2037-596b-4f8a-94f8-03c853d2894e service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:55.983339 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb80cd5-3ceb-4307-8398-312bdcdf18d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe10f0f42b8247c99ed5f88eff5065e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:55.983985 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb80cd5-3ceb-4307-8398-312bdcdf18d8 service swift] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:55.984273 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb80cd5-3ceb-4307-8398-312bdcdf18d8 service swift] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:55.984554 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb80cd5-3ceb-4307-8398-312bdcdf18d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:55.993161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb80cd5-3ceb-4307-8398-312bdcdf18d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:55.994792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb80cd5-3ceb-4307-8398-312bdcdf18d8 service swift] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:56.002742 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1221/2422] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Jul 12 13:22:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:22:56.493579 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac1ede-1c6e-4396-b442-8763921a866d None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:56.493903 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac1ede-1c6e-4396-b442-8763921a866d None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:56.494222 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac1ede-1c6e-4396-b442-8763921a866d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:56.512254 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-b8ac1ede-1c6e-4396-b442-8763921a866d None None] MFA Rules not processed for user `72f556aac45c460cb573498aab7590fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:56.513458 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-b8ac1ede-1c6e-4396-b442-8763921a866d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:56.520632 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1202/2423] 10.222.0.17 () {58 vars in 967 bytes} [Tue Jul 12 13:22:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:56.533289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb80cd5-3ceb-4307-8398-312bdcdf18d8 service swift] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:56.544345 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb80cd5-3ceb-4307-8398-312bdcdf18d8 service swift] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:56.544526 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac1ede-1c6e-4396-b442-8763921a866d None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:56.545751 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-b8ac1ede-1c6e-4396-b442-8763921a866d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:56.549404 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d2bab-dfa1-4e8e-b441-13a7d98a7e5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe10f0f42b8247c99ed5f88eff5065e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:56.550048 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d2bab-dfa1-4e8e-b441-13a7d98a7e5f service swift] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:56.550367 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d2bab-dfa1-4e8e-b441-13a7d98a7e5f service swift] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:56.550643 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d2bab-dfa1-4e8e-b441-13a7d98a7e5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:56.558964 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d2bab-dfa1-4e8e-b441-13a7d98a7e5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:56.560539 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d2bab-dfa1-4e8e-b441-13a7d98a7e5f service swift] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:56.568584 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1222/2424] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Jul 12 13:22:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:22:56.628464 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac1ede-1c6e-4396-b442-8763921a866d None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:56.635754 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89659ff-adb3-4e21-bd17-a6030f3b5820 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:56.636324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89659ff-adb3-4e21-bd17-a6030f3b5820 service nova] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:56.636611 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89659ff-adb3-4e21-bd17-a6030f3b5820 service nova] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:56.636890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89659ff-adb3-4e21-bd17-a6030f3b5820 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:56.638725 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-e89659ff-adb3-4e21-bd17-a6030f3b5820 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:56.708508 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89659ff-adb3-4e21-bd17-a6030f3b5820 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:56.710254 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89659ff-adb3-4e21-bd17-a6030f3b5820 service nova] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:56.721119 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1203/2425] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:22:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:22:56.769230 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdad897-29fb-4531-b038-106f300cee9f None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:56.769522 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdad897-29fb-4531-b038-106f300cee9f None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:56.769827 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdad897-29fb-4531-b038-106f300cee9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:56.788377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-ebdad897-29fb-4531-b038-106f300cee9f None None] MFA Rules not processed for user `72f556aac45c460cb573498aab7590fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:56.789618 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-ebdad897-29fb-4531-b038-106f300cee9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:56.796703 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1223/2426] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Jul 12 13:22:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:56.809353 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89659ff-adb3-4e21-bd17-a6030f3b5820 service nova] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:56.821040 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89659ff-adb3-4e21-bd17-a6030f3b5820 service nova] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:56.826247 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b47dd8-5424-4c89-8945-1b0f4ce82276 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe10f0f42b8247c99ed5f88eff5065e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:56.826902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b47dd8-5424-4c89-8945-1b0f4ce82276 service swift] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:56.827190 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b47dd8-5424-4c89-8945-1b0f4ce82276 service swift] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:56.827469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b47dd8-5424-4c89-8945-1b0f4ce82276 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:56.836580 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b47dd8-5424-4c89-8945-1b0f4ce82276 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:56.838182 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b47dd8-5424-4c89-8945-1b0f4ce82276 service swift] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:56.847163 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1204/2427] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Jul 12 13:22:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:22:57.184835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c34a8-9ab7-464b-adb0-aba45ded1cc6 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:57.185322 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c34a8-9ab7-464b-adb0-aba45ded1cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:57.185418 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c34a8-9ab7-464b-adb0-aba45ded1cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:57.203029 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-a93c34a8-9ab7-464b-adb0-aba45ded1cc6 None None] MFA Rules not processed for user `72f556aac45c460cb573498aab7590fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:57.204244 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a93c34a8-9ab7-464b-adb0-aba45ded1cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:57.216912 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1224/2428] 10.222.0.17 () {58 vars in 967 bytes} [Tue Jul 12 13:22:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:57.229619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b47dd8-5424-4c89-8945-1b0f4ce82276 service swift] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:57.240770 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b47dd8-5424-4c89-8945-1b0f4ce82276 service swift] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:57.246556 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25fff1-0987-44ee-9b63-2fd2ba319d5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe10f0f42b8247c99ed5f88eff5065e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:57.247205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25fff1-0987-44ee-9b63-2fd2ba319d5e service swift] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:57.247502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25fff1-0987-44ee-9b63-2fd2ba319d5e service swift] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:57.247786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25fff1-0987-44ee-9b63-2fd2ba319d5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:57.256801 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25fff1-0987-44ee-9b63-2fd2ba319d5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:57.258501 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25fff1-0987-44ee-9b63-2fd2ba319d5e service swift] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:57.267108 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1205/2429] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Jul 12 13:22:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:22:59.579276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c34a8-9ab7-464b-adb0-aba45ded1cc6 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:59.641968 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c34a8-9ab7-464b-adb0-aba45ded1cc6 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:59.646492 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ae866-9d97-4dcc-b1dd-cf77e385b401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:59.647365 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ae866-9d97-4dcc-b1dd-cf77e385b401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:59.647649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ae866-9d97-4dcc-b1dd-cf77e385b401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:59.647925 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ae866-9d97-4dcc-b1dd-cf77e385b401 admin admin] PATH_INFO: `/v3/users/d0e080ed50ba4f02a76478ef164913a2` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:59.650297 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ae866-9d97-4dcc-b1dd-cf77e385b401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0e080ed50ba4f02a76478ef164913a2)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:59.653455 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ae866-9d97-4dcc-b1dd-cf77e385b401 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:59.665334 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:59.707192 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b18ae866-9d97-4dcc-b1dd-cf77e385b401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0e080ed50ba4f02a76478ef164913a2'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:59.715748 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b18ae866-9d97-4dcc-b1dd-cf77e385b401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0e080ed50ba4f02a76478ef164913a2'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:59.724130 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b18ae866-9d97-4dcc-b1dd-cf77e385b401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0e080ed50ba4f02a76478ef164913a2'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:59.724876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b18ae866-9d97-4dcc-b1dd-cf77e385b401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0e080ed50ba4f02a76478ef164913a2'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:59.738338 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b18ae866-9d97-4dcc-b1dd-cf77e385b401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0e080ed50ba4f02a76478ef164913a2'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:22:59.745440 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1225/2430] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:22:59 2022] DELETE /identity/v3/users/d0e080ed50ba4f02a76478ef164913a2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:22:59.751014 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231aa48-9275-4623-b64e-5f118a732dca None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:59.751583 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231aa48-9275-4623-b64e-5f118a732dca None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:59.751676 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231aa48-9275-4623-b64e-5f118a732dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:59.773171 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-8231aa48-9275-4623-b64e-5f118a732dca None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:22:59.775143 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-8231aa48-9275-4623-b64e-5f118a732dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:59.780796 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:59.841463 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1206/2431] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:22:59.851146 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ae866-9d97-4dcc-b1dd-cf77e385b401 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:22:59.852856 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-b18ae866-9d97-4dcc-b1dd-cf77e385b401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:22:59.910382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ae866-9d97-4dcc-b1dd-cf77e385b401 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:22:59.913971 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69693b2-8914-4c9e-8226-603893e454ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:22:59.914706 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69693b2-8914-4c9e-8226-603893e454ee service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:22:59.915019 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69693b2-8914-4c9e-8226-603893e454ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:22:59.915301 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69693b2-8914-4c9e-8226-603893e454ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:22:59.924626 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69693b2-8914-4c9e-8226-603893e454ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:22:59.926151 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69693b2-8914-4c9e-8226-603893e454ee service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:22:59.936198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1226/2432] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:22:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:23:00.108928 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231aa48-9275-4623-b64e-5f118a732dca None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:00.110398 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-8231aa48-9275-4623-b64e-5f118a732dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:00.123111 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231aa48-9275-4623-b64e-5f118a732dca None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:00.127912 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90ec90-2142-4043-8793-6269cac0ebbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:00.128796 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90ec90-2142-4043-8793-6269cac0ebbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:00.134814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90ec90-2142-4043-8793-6269cac0ebbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:00.135108 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90ec90-2142-4043-8793-6269cac0ebbe admin admin] PATH_INFO: `/v3/projects/0c13d31e6db54be58a69e77e16a8af95` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:00.136406 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90ec90-2142-4043-8793-6269cac0ebbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c13d31e6db54be58a69e77e16a8af95)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:00.138865 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90ec90-2142-4043-8793-6269cac0ebbe admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:00.188629 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-3a90ec90-2142-4043-8793-6269cac0ebbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c13d31e6db54be58a69e77e16a8af95', 'request_id': 'req-3a90ec90-2142-4043-8793-6269cac0ebbe'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:00.194746 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-3a90ec90-2142-4043-8793-6269cac0ebbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c13d31e6db54be58a69e77e16a8af95', 'request_id': 'req-3a90ec90-2142-4043-8793-6269cac0ebbe'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:00.202592 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-3a90ec90-2142-4043-8793-6269cac0ebbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c13d31e6db54be58a69e77e16a8af95', 'request_id': 'req-3a90ec90-2142-4043-8793-6269cac0ebbe'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:00.214244 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-3a90ec90-2142-4043-8793-6269cac0ebbe admin admin] The token cache is being invalidate because project 0c13d31e6db54be58a69e77e16a8af95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:23:00.214537 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-3a90ec90-2142-4043-8793-6269cac0ebbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:00.215192 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-3a90ec90-2142-4043-8793-6269cac0ebbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:00.216749 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1207/2433] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:23:00 2022] DELETE /identity/v3/projects/0c13d31e6db54be58a69e77e16a8af95 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:09.931988 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:DELETE=10,keystone:SELECT=48,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:10.210424 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:10.914165 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69693b2-8914-4c9e-8226-603893e454ee service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:10.915909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-b69693b2-8914-4c9e-8226-603893e454ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:11.003048 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69693b2-8914-4c9e-8226-603893e454ee service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:11.094918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487d842-c2d5-4f35-99c6-776e043b15b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:11.095586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487d842-c2d5-4f35-99c6-776e043b15b9 service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:11.095873 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487d842-c2d5-4f35-99c6-776e043b15b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:11.096155 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487d842-c2d5-4f35-99c6-776e043b15b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:11.097994 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-e487d842-c2d5-4f35-99c6-776e043b15b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:11.112269 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487d842-c2d5-4f35-99c6-776e043b15b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:11.113992 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487d842-c2d5-4f35-99c6-776e043b15b9 service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:11.126936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1227/2434] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:23:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:23:17.002750 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90ec90-2142-4043-8793-6269cac0ebbe admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:17.004195 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-3a90ec90-2142-4043-8793-6269cac0ebbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:17.069478 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90ec90-2142-4043-8793-6269cac0ebbe admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:17.073850 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7614562-5091-4b8f-9ea6-623344948ae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:17.074550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7614562-5091-4b8f-9ea6-623344948ae7 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:17.074832 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7614562-5091-4b8f-9ea6-623344948ae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:17.075110 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7614562-5091-4b8f-9ea6-623344948ae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:17.076980 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-d7614562-5091-4b8f-9ea6-623344948ae7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:17.150881 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7614562-5091-4b8f-9ea6-623344948ae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:17.152254 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7614562-5091-4b8f-9ea6-623344948ae7 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:17.162156 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1208/2435] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:23:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:23:20.665996 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487d842-c2d5-4f35-99c6-776e043b15b9 service nova] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:20.668266 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-e487d842-c2d5-4f35-99c6-776e043b15b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:20.687548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487d842-c2d5-4f35-99c6-776e043b15b9 service nova] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:20.693458 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede33ecb-7870-4e5c-bdf9-848c45927781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:20.698753 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede33ecb-7870-4e5c-bdf9-848c45927781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:20.699099 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede33ecb-7870-4e5c-bdf9-848c45927781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:20.699382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede33ecb-7870-4e5c-bdf9-848c45927781 admin admin] PATH_INFO: `/v3/users/48f4be3ee79e42aeb67d87c06803c031` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:20.700939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede33ecb-7870-4e5c-bdf9-848c45927781 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48f4be3ee79e42aeb67d87c06803c031)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:20.703250 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede33ecb-7870-4e5c-bdf9-848c45927781 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:20.761891 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-ede33ecb-7870-4e5c-bdf9-848c45927781 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48f4be3ee79e42aeb67d87c06803c031'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:20.770523 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-ede33ecb-7870-4e5c-bdf9-848c45927781 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48f4be3ee79e42aeb67d87c06803c031'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:20.778620 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-ede33ecb-7870-4e5c-bdf9-848c45927781 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48f4be3ee79e42aeb67d87c06803c031'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:20.779298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-ede33ecb-7870-4e5c-bdf9-848c45927781 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48f4be3ee79e42aeb67d87c06803c031'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:20.790932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:20.792584 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-ede33ecb-7870-4e5c-bdf9-848c45927781 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48f4be3ee79e42aeb67d87c06803c031'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:20.801410 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1228/2436] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:23:20 2022] DELETE /identity/v3/users/48f4be3ee79e42aeb67d87c06803c031 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:20.974037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7614562-5091-4b8f-9ea6-623344948ae7 service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:20.985411 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7614562-5091-4b8f-9ea6-623344948ae7 service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:21.045201 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c5b9b-6490-460c-8520-6ffb359fd373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:21.046083 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c5b9b-6490-460c-8520-6ffb359fd373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:21.046421 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c5b9b-6490-460c-8520-6ffb359fd373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:21.046705 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c5b9b-6490-460c-8520-6ffb359fd373 admin admin] PATH_INFO: `/v3/projects/914e22799f7b4b8095acdf066cc38e1f` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:21.047929 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c5b9b-6490-460c-8520-6ffb359fd373 admin admin] RBAC: Authorizing `identity:delete_project(project_id=914e22799f7b4b8095acdf066cc38e1f)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:21.049842 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c5b9b-6490-460c-8520-6ffb359fd373 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:21.096838 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-746c5b9b-6490-460c-8520-6ffb359fd373 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '914e22799f7b4b8095acdf066cc38e1f', 'request_id': 'req-746c5b9b-6490-460c-8520-6ffb359fd373'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:21.098826 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:21.104415 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-746c5b9b-6490-460c-8520-6ffb359fd373 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '914e22799f7b4b8095acdf066cc38e1f', 'request_id': 'req-746c5b9b-6490-460c-8520-6ffb359fd373'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:21.113891 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-746c5b9b-6490-460c-8520-6ffb359fd373 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '914e22799f7b4b8095acdf066cc38e1f', 'request_id': 'req-746c5b9b-6490-460c-8520-6ffb359fd373'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:21.126285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-746c5b9b-6490-460c-8520-6ffb359fd373 admin admin] The token cache is being invalidate because project 914e22799f7b4b8095acdf066cc38e1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:23:21.126572 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-746c5b9b-6490-460c-8520-6ffb359fd373 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:21.127203 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-746c5b9b-6490-460c-8520-6ffb359fd373 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:21.128740 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1209/2437] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:23:20 2022] DELETE /identity/v3/projects/914e22799f7b4b8095acdf066cc38e1f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:21.133913 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c704a8-3f16-4645-83ef-f827ceeae150 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:21.134241 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c704a8-3f16-4645-83ef-f827ceeae150 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:21.134526 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c704a8-3f16-4645-83ef-f827ceeae150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:21.152345 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-f4c704a8-3f16-4645-83ef-f827ceeae150 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:21.153521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-f4c704a8-3f16-4645-83ef-f827ceeae150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:21.211707 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1229/2438] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:21.219830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035d88a-19f0-4c09-9640-113c52c33a26 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:21.220120 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035d88a-19f0-4c09-9640-113c52c33a26 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:21.220397 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035d88a-19f0-4c09-9640-113c52c33a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:21.238965 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-4035d88a-19f0-4c09-9640-113c52c33a26 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:21.240159 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-4035d88a-19f0-4c09-9640-113c52c33a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:21.248021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1210/2439] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:23:21.252484 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c704a8-3f16-4645-83ef-f827ceeae150 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:21.262734 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c704a8-3f16-4645-83ef-f827ceeae150 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:21.267401 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703950e-e07d-4cec-9346-9e01082d5af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:21.268091 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703950e-e07d-4cec-9346-9e01082d5af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:21.268381 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703950e-e07d-4cec-9346-9e01082d5af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:21.268661 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703950e-e07d-4cec-9346-9e01082d5af6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:21.269388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703950e-e07d-4cec-9346-9e01082d5af6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:23:21.269699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703950e-e07d-4cec-9346-9e01082d5af6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:21.271352 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703950e-e07d-4cec-9346-9e01082d5af6 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:21.283988 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1230/2440] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:23:21.288253 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035d88a-19f0-4c09-9640-113c52c33a26 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:21.298406 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035d88a-19f0-4c09-9640-113c52c33a26 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:21.303540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19073ed4-d785-4c19-8c8b-7a451ab98f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:21.304259 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19073ed4-d785-4c19-8c8b-7a451ab98f56 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:21.304488 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19073ed4-d785-4c19-8c8b-7a451ab98f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:21.304770 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19073ed4-d785-4c19-8c8b-7a451ab98f56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:21.305473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19073ed4-d785-4c19-8c8b-7a451ab98f56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:21.307513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19073ed4-d785-4c19-8c8b-7a451ab98f56 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:21.332531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1211/2441] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:23:21 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:23:21.337262 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703950e-e07d-4cec-9346-9e01082d5af6 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:21.347205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703950e-e07d-4cec-9346-9e01082d5af6 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:21.404843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0774f2b-b652-44c9-ae4b-868821b21340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:21.405527 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0774f2b-b652-44c9-ae4b-868821b21340 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:21.405815 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0774f2b-b652-44c9-ae4b-868821b21340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:21.406097 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0774f2b-b652-44c9-ae4b-868821b21340 admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:21.406821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0774f2b-b652-44c9-ae4b-868821b21340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:21.408765 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0774f2b-b652-44c9-ae4b-868821b21340 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:21.430351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1231/2442] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:23:21 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:23:21.434621 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19073ed4-d785-4c19-8c8b-7a451ab98f56 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:21.445079 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19073ed4-d785-4c19-8c8b-7a451ab98f56 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:21.449677 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed54a9-88c9-46ef-abd3-58638e92411f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:21.450388 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed54a9-88c9-46ef-abd3-58638e92411f admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:21.450672 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed54a9-88c9-46ef-abd3-58638e92411f admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:21.450956 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed54a9-88c9-46ef-abd3-58638e92411f admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:21.451667 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed54a9-88c9-46ef-abd3-58638e92411f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:21.453263 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed54a9-88c9-46ef-abd3-58638e92411f admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:21.464617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1212/2443] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:23:21.468601 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0774f2b-b652-44c9-ae4b-868821b21340 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:21.479696 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0774f2b-b652-44c9-ae4b-868821b21340 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:21.484597 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf0394-e31d-4425-b131-9c673c0bde1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:21.485282 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf0394-e31d-4425-b131-9c673c0bde1d admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:21.485570 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf0394-e31d-4425-b131-9c673c0bde1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:21.485851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf0394-e31d-4425-b131-9c673c0bde1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:21.486612 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf0394-e31d-4425-b131-9c673c0bde1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:21.488230 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf0394-e31d-4425-b131-9c673c0bde1d admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:21.498652 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1232/2444] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:23:21.502891 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed54a9-88c9-46ef-abd3-58638e92411f admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:21.513499 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed54a9-88c9-46ef-abd3-58638e92411f admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:21.520681 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621843ec-7509-406d-b5fc-a3a4682220a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:21.522218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621843ec-7509-406d-b5fc-a3a4682220a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:21.522513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621843ec-7509-406d-b5fc-a3a4682220a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:21.523284 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621843ec-7509-406d-b5fc-a3a4682220a3 admin admin] PATH_INFO: `/v3/projects/eceee18b0a274ddcb6741534c4de6476/users/15e6a9897a2d48f597fa6f8bec5daf65/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:21.541233 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621843ec-7509-406d-b5fc-a3a4682220a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eceee18b0a274ddcb6741534c4de6476, user_id=15e6a9897a2d48f597fa6f8bec5daf65, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:21.544276 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621843ec-7509-406d-b5fc-a3a4682220a3 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:21.562496 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1213/2445] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:23:21 2022] PUT /identity/v3/projects/eceee18b0a274ddcb6741534c4de6476/users/15e6a9897a2d48f597fa6f8bec5daf65/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:21.573274 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc14d8-8e8e-4ebe-8014-bd64a4abe402 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:21.573626 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc14d8-8e8e-4ebe-8014-bd64a4abe402 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:21.574024 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc14d8-8e8e-4ebe-8014-bd64a4abe402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:21.605776 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-76cc14d8-8e8e-4ebe-8014-bd64a4abe402 None None] MFA Rules not processed for user `15e6a9897a2d48f597fa6f8bec5daf65`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:21.607083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-76cc14d8-8e8e-4ebe-8014-bd64a4abe402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:21.661765 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:21.682883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1233/2446] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:21.696803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621843ec-7509-406d-b5fc-a3a4682220a3 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:21.699637 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-621843ec-7509-406d-b5fc-a3a4682220a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:21.790658 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621843ec-7509-406d-b5fc-a3a4682220a3 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:21.796814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3330c6e-ce2e-4a99-9e04-432e695b4756 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:21.797571 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3330c6e-ce2e-4a99-9e04-432e695b4756 service nova] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:21.798072 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3330c6e-ce2e-4a99-9e04-432e695b4756 service nova] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:21.798466 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3330c6e-ce2e-4a99-9e04-432e695b4756 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:21.808919 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3330c6e-ce2e-4a99-9e04-432e695b4756 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:21.810572 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3330c6e-ce2e-4a99-9e04-432e695b4756 service nova] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:21.819900 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1214/2447] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:23:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:23:22.903083 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc14d8-8e8e-4ebe-8014-bd64a4abe402 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:22.904533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-76cc14d8-8e8e-4ebe-8014-bd64a4abe402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:22.969656 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc14d8-8e8e-4ebe-8014-bd64a4abe402 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:22.973241 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146bb19-4ef8-4537-b0f7-85a8d750a49a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:22.973896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146bb19-4ef8-4537-b0f7-85a8d750a49a service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:22.974226 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146bb19-4ef8-4537-b0f7-85a8d750a49a service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:22.974510 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146bb19-4ef8-4537-b0f7-85a8d750a49a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:22.976918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-f146bb19-4ef8-4537-b0f7-85a8d750a49a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:23.039456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146bb19-4ef8-4537-b0f7-85a8d750a49a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:23.040896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146bb19-4ef8-4537-b0f7-85a8d750a49a service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:23.050749 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1234/2448] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:23:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:23:26.915622 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3330c6e-ce2e-4a99-9e04-432e695b4756 service nova] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:26.917281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-a3330c6e-ce2e-4a99-9e04-432e695b4756 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:26.941733 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3330c6e-ce2e-4a99-9e04-432e695b4756 service nova] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:26.947659 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69feb6b8-4ee1-47cf-b8c2-a1b9e1f3a874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:26.948635 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69feb6b8-4ee1-47cf-b8c2-a1b9e1f3a874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:26.948995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69feb6b8-4ee1-47cf-b8c2-a1b9e1f3a874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:26.949341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69feb6b8-4ee1-47cf-b8c2-a1b9e1f3a874 admin admin] PATH_INFO: `/v3/users/f558b5ee5b5e43f4894d350fc73df0f8` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:26.950656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69feb6b8-4ee1-47cf-b8c2-a1b9e1f3a874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f558b5ee5b5e43f4894d350fc73df0f8)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:26.952656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69feb6b8-4ee1-47cf-b8c2-a1b9e1f3a874 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:27.031093 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-69feb6b8-4ee1-47cf-b8c2-a1b9e1f3a874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f558b5ee5b5e43f4894d350fc73df0f8'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:27.031872 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-69feb6b8-4ee1-47cf-b8c2-a1b9e1f3a874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f558b5ee5b5e43f4894d350fc73df0f8'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:27.040680 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-69feb6b8-4ee1-47cf-b8c2-a1b9e1f3a874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f558b5ee5b5e43f4894d350fc73df0f8'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:27.044595 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:27.055313 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-69feb6b8-4ee1-47cf-b8c2-a1b9e1f3a874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f558b5ee5b5e43f4894d350fc73df0f8'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:27.075675 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-69feb6b8-4ee1-47cf-b8c2-a1b9e1f3a874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f558b5ee5b5e43f4894d350fc73df0f8'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:27.077729 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146bb19-4ef8-4537-b0f7-85a8d750a49a service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:27.090877 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1215/2449] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:23:26 2022] DELETE /identity/v3/users/f558b5ee5b5e43f4894d350fc73df0f8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:27.091546 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146bb19-4ef8-4537-b0f7-85a8d750a49a service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:27.157739 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d63277-224c-4e3d-a72f-87fa23f59401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:27.158829 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d63277-224c-4e3d-a72f-87fa23f59401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:27.159361 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d63277-224c-4e3d-a72f-87fa23f59401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:27.159991 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d63277-224c-4e3d-a72f-87fa23f59401 admin admin] PATH_INFO: `/v3/users/15e6a9897a2d48f597fa6f8bec5daf65` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:27.161310 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d63277-224c-4e3d-a72f-87fa23f59401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15e6a9897a2d48f597fa6f8bec5daf65)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:27.163321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d63277-224c-4e3d-a72f-87fa23f59401 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:27.167575 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2e9d5-67c7-40cd-a528-9e0d04333eb4 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:27.167863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2e9d5-67c7-40cd-a528-9e0d04333eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:27.168142 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2e9d5-67c7-40cd-a528-9e0d04333eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:27.187140 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-44c2e9d5-67c7-40cd-a528-9e0d04333eb4 None None] MFA Rules not processed for user `72f556aac45c460cb573498aab7590fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:27.188759 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-44c2e9d5-67c7-40cd-a528-9e0d04333eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:27.224924 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:27.228858 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-d3d63277-224c-4e3d-a72f-87fa23f59401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15e6a9897a2d48f597fa6f8bec5daf65'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:27.239660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-d3d63277-224c-4e3d-a72f-87fa23f59401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15e6a9897a2d48f597fa6f8bec5daf65'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:27.248561 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-d3d63277-224c-4e3d-a72f-87fa23f59401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15e6a9897a2d48f597fa6f8bec5daf65'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:27.249317 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-d3d63277-224c-4e3d-a72f-87fa23f59401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15e6a9897a2d48f597fa6f8bec5daf65'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:27.259455 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1216/2450] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Jul 12 13:23:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:23:27.272983 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-d3d63277-224c-4e3d-a72f-87fa23f59401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15e6a9897a2d48f597fa6f8bec5daf65'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:27.282195 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1235/2451] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:23:27 2022] DELETE /identity/v3/users/15e6a9897a2d48f597fa6f8bec5daf65 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:23:27.284776 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2e9d5-67c7-40cd-a528-9e0d04333eb4 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:27.286269 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-44c2e9d5-67c7-40cd-a528-9e0d04333eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:27.289730 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43ce62-beb5-4a25-b89e-116bdb22929c None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:27.289730 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43ce62-beb5-4a25-b89e-116bdb22929c None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:27.289730 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43ce62-beb5-4a25-b89e-116bdb22929c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:27.311192 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-2e43ce62-beb5-4a25-b89e-116bdb22929c None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:27.313222 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-2e43ce62-beb5-4a25-b89e-116bdb22929c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:27.359229 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2e9d5-67c7-40cd-a528-9e0d04333eb4 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:27.383376 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1236/2452] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:27.386773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43ce62-beb5-4a25-b89e-116bdb22929c None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:27.386773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-2e43ce62-beb5-4a25-b89e-116bdb22929c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:27.399377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43ce62-beb5-4a25-b89e-116bdb22929c None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:27.404545 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8a489-154b-4a79-9355-384f8753b6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:27.405547 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8a489-154b-4a79-9355-384f8753b6da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:27.405909 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8a489-154b-4a79-9355-384f8753b6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:27.406302 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8a489-154b-4a79-9355-384f8753b6da admin admin] PATH_INFO: `/v3/projects/f5db7c603326441e86a4187570bc5be6` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:27.407605 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8a489-154b-4a79-9355-384f8753b6da admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5db7c603326441e86a4187570bc5be6)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:27.409635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8a489-154b-4a79-9355-384f8753b6da admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:27.423340 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390ff0c-9df0-4d3a-821a-5a11b63e5453 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe10f0f42b8247c99ed5f88eff5065e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:27.424016 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390ff0c-9df0-4d3a-821a-5a11b63e5453 service swift] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:27.424326 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390ff0c-9df0-4d3a-821a-5a11b63e5453 service swift] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:27.424604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390ff0c-9df0-4d3a-821a-5a11b63e5453 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:27.448204 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:27.460807 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-82b8a489-154b-4a79-9355-384f8753b6da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5db7c603326441e86a4187570bc5be6', 'request_id': 'req-82b8a489-154b-4a79-9355-384f8753b6da'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:27.467166 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-82b8a489-154b-4a79-9355-384f8753b6da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5db7c603326441e86a4187570bc5be6', 'request_id': 'req-82b8a489-154b-4a79-9355-384f8753b6da'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:27.474829 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-82b8a489-154b-4a79-9355-384f8753b6da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5db7c603326441e86a4187570bc5be6', 'request_id': 'req-82b8a489-154b-4a79-9355-384f8753b6da'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:27.486904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-82b8a489-154b-4a79-9355-384f8753b6da admin admin] The token cache is being invalidate because project f5db7c603326441e86a4187570bc5be6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:23:27.487205 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-82b8a489-154b-4a79-9355-384f8753b6da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:27.487868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-82b8a489-154b-4a79-9355-384f8753b6da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:27.488005 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390ff0c-9df0-4d3a-821a-5a11b63e5453 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:27.489485 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1237/2453] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:23:27 2022] DELETE /identity/v3/projects/f5db7c603326441e86a4187570bc5be6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:27.489618 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390ff0c-9df0-4d3a-821a-5a11b63e5453 service swift] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:27.490298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8a489-154b-4a79-9355-384f8753b6da admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:27.491666 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-82b8a489-154b-4a79-9355-384f8753b6da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:27.498451 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1217/2454] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Jul 12 13:23:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:23:27.499749 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51278fac-c8de-4402-aaee-e657abbdf77f None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:27.500045 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51278fac-c8de-4402-aaee-e657abbdf77f None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:27.500408 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51278fac-c8de-4402-aaee-e657abbdf77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:27.523337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-51278fac-c8de-4402-aaee-e657abbdf77f None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:27.524719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-51278fac-c8de-4402-aaee-e657abbdf77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:27.564410 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:27.577077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8a489-154b-4a79-9355-384f8753b6da admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:27.586633 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14cae8-d005-4674-b7ef-f9ff8dbc6c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:27.587908 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14cae8-d005-4674-b7ef-f9ff8dbc6c9d service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:27.588225 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14cae8-d005-4674-b7ef-f9ff8dbc6c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:27.588501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14cae8-d005-4674-b7ef-f9ff8dbc6c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:27.592363 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-fa14cae8-d005-4674-b7ef-f9ff8dbc6c9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:27.693732 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1218/2455] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:27.696856 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e6d4b-88b9-43aa-95ac-b7b3236b59c9 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:27.697157 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e6d4b-88b9-43aa-95ac-b7b3236b59c9 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:27.697453 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e6d4b-88b9-43aa-95ac-b7b3236b59c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:27.737202 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-368e6d4b-88b9-43aa-95ac-b7b3236b59c9 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:27.738880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-368e6d4b-88b9-43aa-95ac-b7b3236b59c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:27.743678 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14cae8-d005-4674-b7ef-f9ff8dbc6c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:27.745161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14cae8-d005-4674-b7ef-f9ff8dbc6c9d service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:27.754678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1219/2456] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:23:27.757439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e6d4b-88b9-43aa-95ac-b7b3236b59c9 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:27.769586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1238/2457] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:23:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:23:27.783491 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e6d4b-88b9-43aa-95ac-b7b3236b59c9 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:27.797736 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5a8a9-3258-410b-a362-e2242b6ce55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:27.798466 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5a8a9-3258-410b-a362-e2242b6ce55b admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:27.799044 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5a8a9-3258-410b-a362-e2242b6ce55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:27.799327 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5a8a9-3258-410b-a362-e2242b6ce55b admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:27.803003 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5a8a9-3258-410b-a362-e2242b6ce55b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:23:27.816643 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5a8a9-3258-410b-a362-e2242b6ce55b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:27.818551 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5a8a9-3258-410b-a362-e2242b6ce55b admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:27.847408 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1220/2458] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:23:27.855681 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14cae8-d005-4674-b7ef-f9ff8dbc6c9d service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:27.869524 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14cae8-d005-4674-b7ef-f9ff8dbc6c9d service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:27.877707 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63d115-604f-4ae4-9415-07830e5b4dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:27.878776 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63d115-604f-4ae4-9415-07830e5b4dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:27.879138 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63d115-604f-4ae4-9415-07830e5b4dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:27.879517 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63d115-604f-4ae4-9415-07830e5b4dd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:27.880290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63d115-604f-4ae4-9415-07830e5b4dd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:27.883708 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63d115-604f-4ae4-9415-07830e5b4dd6 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:27.946375 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1239/2459] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:23:27 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:23:27.948275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5a8a9-3258-410b-a362-e2242b6ce55b admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:27.959847 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5a8a9-3258-410b-a362-e2242b6ce55b admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:28.052883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63d115-604f-4ae4-9415-07830e5b4dd6 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:28.056555 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-5f63d115-604f-4ae4-9415-07830e5b4dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:28.086054 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8efb4d-01d4-42aa-8c49-54d5a95dd6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:28.087414 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8efb4d-01d4-42aa-8c49-54d5a95dd6e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:28.087689 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8efb4d-01d4-42aa-8c49-54d5a95dd6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:28.087968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8efb4d-01d4-42aa-8c49-54d5a95dd6e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:28.089280 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8efb4d-01d4-42aa-8c49-54d5a95dd6e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:28.095463 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8efb4d-01d4-42aa-8c49-54d5a95dd6e4 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:28.146541 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1221/2460] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:23:27 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:23:28.151090 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8efb4d-01d4-42aa-8c49-54d5a95dd6e4 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:28.173028 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8efb4d-01d4-42aa-8c49-54d5a95dd6e4 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:28.187762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71912f92-9d91-4303-8754-987d7f3b6785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:28.188627 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71912f92-9d91-4303-8754-987d7f3b6785 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:28.191990 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71912f92-9d91-4303-8754-987d7f3b6785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:28.192309 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71912f92-9d91-4303-8754-987d7f3b6785 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:28.193502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71912f92-9d91-4303-8754-987d7f3b6785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:28.195247 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71912f92-9d91-4303-8754-987d7f3b6785 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:28.228741 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1222/2461] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:23:28.235646 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71912f92-9d91-4303-8754-987d7f3b6785 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:28.239282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-71912f92-9d91-4303-8754-987d7f3b6785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:28.259487 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71912f92-9d91-4303-8754-987d7f3b6785 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:28.274447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63d115-604f-4ae4-9415-07830e5b4dd6 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:28.279541 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fab3c9-eb91-4751-af65-230e3cd11c99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:28.280229 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fab3c9-eb91-4751-af65-230e3cd11c99 service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:28.280777 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fab3c9-eb91-4751-af65-230e3cd11c99 service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:28.281066 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fab3c9-eb91-4751-af65-230e3cd11c99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:28.281737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dda86-2540-4225-97a6-7a9ff7776622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:28.283587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dda86-2540-4225-97a6-7a9ff7776622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:28.283880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dda86-2540-4225-97a6-7a9ff7776622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:28.283992 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-e0fab3c9-eb91-4751-af65-230e3cd11c99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:28.284168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dda86-2540-4225-97a6-7a9ff7776622 admin admin] PATH_INFO: `/v3/projects/eceee18b0a274ddcb6741534c4de6476` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:28.286536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09dda86-2540-4225-97a6-7a9ff7776622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eceee18b0a274ddcb6741534c4de6476)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:28.290092 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09dda86-2540-4225-97a6-7a9ff7776622 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:28.302162 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fab3c9-eb91-4751-af65-230e3cd11c99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:28.308088 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fab3c9-eb91-4751-af65-230e3cd11c99 service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:28.324535 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:28.326378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1240/2462] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:23:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:23:28.327466 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fab3c9-eb91-4751-af65-230e3cd11c99 service nova] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:28.340735 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fab3c9-eb91-4751-af65-230e3cd11c99 service nova] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:28.348388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10f558-a034-4990-9403-e632b5771e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:28.349958 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10f558-a034-4990-9403-e632b5771e2a admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:28.350945 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10f558-a034-4990-9403-e632b5771e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:28.351323 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10f558-a034-4990-9403-e632b5771e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:28.352292 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10f558-a034-4990-9403-e632b5771e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:28.354201 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10f558-a034-4990-9403-e632b5771e2a admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:28.366732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1241/2463] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:23:28.372367 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10f558-a034-4990-9403-e632b5771e2a admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:28.396653 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10f558-a034-4990-9403-e632b5771e2a admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:28.404558 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-f09dda86-2540-4225-97a6-7a9ff7776622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eceee18b0a274ddcb6741534c4de6476', 'request_id': 'req-f09dda86-2540-4225-97a6-7a9ff7776622'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:28.419738 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-f09dda86-2540-4225-97a6-7a9ff7776622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eceee18b0a274ddcb6741534c4de6476', 'request_id': 'req-f09dda86-2540-4225-97a6-7a9ff7776622'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:28.432907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-f09dda86-2540-4225-97a6-7a9ff7776622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eceee18b0a274ddcb6741534c4de6476', 'request_id': 'req-f09dda86-2540-4225-97a6-7a9ff7776622'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:28.450282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-f09dda86-2540-4225-97a6-7a9ff7776622 admin admin] The token cache is being invalidate because project eceee18b0a274ddcb6741534c4de6476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:23:28.450622 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-f09dda86-2540-4225-97a6-7a9ff7776622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:28.451805 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-f09dda86-2540-4225-97a6-7a9ff7776622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:28.453966 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1223/2464] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:23:28 2022] DELETE /identity/v3/projects/eceee18b0a274ddcb6741534c4de6476 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:28.458731 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfb2b1-7e0a-4bb0-8ca9-14724fec2262 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:28.459074 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfb2b1-7e0a-4bb0-8ca9-14724fec2262 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:28.459520 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfb2b1-7e0a-4bb0-8ca9-14724fec2262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:28.479366 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:28.482973 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-ecdfb2b1-7e0a-4bb0-8ca9-14724fec2262 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:28.484336 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-ecdfb2b1-7e0a-4bb0-8ca9-14724fec2262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:28.499039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458863b-f50d-46a0-b2a0-942b6b377e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:28.500027 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458863b-f50d-46a0-b2a0-942b6b377e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:28.500227 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458863b-f50d-46a0-b2a0-942b6b377e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:28.500500 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458863b-f50d-46a0-b2a0-942b6b377e58 admin admin] PATH_INFO: `/v3/projects/fce8bc59a0da45fbb49e9771a6a7d428/users/a648f0bf695b4f7681abf488cd263b48/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:28.521010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458863b-f50d-46a0-b2a0-942b6b377e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fce8bc59a0da45fbb49e9771a6a7d428, user_id=a648f0bf695b4f7681abf488cd263b48, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:28.524531 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458863b-f50d-46a0-b2a0-942b6b377e58 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:28.544247 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1242/2465] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:23:28 2022] PUT /identity/v3/projects/fce8bc59a0da45fbb49e9771a6a7d428/users/a648f0bf695b4f7681abf488cd263b48/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:28.558428 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2761bc5-0474-4f0d-9829-c2a3580dbc29 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:28.559332 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2761bc5-0474-4f0d-9829-c2a3580dbc29 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:28.559723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2761bc5-0474-4f0d-9829-c2a3580dbc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:28.595380 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1224/2466] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:23:28.599683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef9a96-249f-446e-af34-fbd432e0574d None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:28.600329 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef9a96-249f-446e-af34-fbd432e0574d None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:28.601297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef9a96-249f-446e-af34-fbd432e0574d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:28.618044 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-a2761bc5-0474-4f0d-9829-c2a3580dbc29 None None] MFA Rules not processed for user `a648f0bf695b4f7681abf488cd263b48`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:28.619297 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a2761bc5-0474-4f0d-9829-c2a3580dbc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:28.637793 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-8aef9a96-249f-446e-af34-fbd432e0574d None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:28.639050 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-8aef9a96-249f-446e-af34-fbd432e0574d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:28.708903 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1243/2467] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:23:28.722176 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2761bc5-0474-4f0d-9829-c2a3580dbc29 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:28.726761 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a2761bc5-0474-4f0d-9829-c2a3580dbc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:28.732706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1225/2468] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:28.739154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef9a96-249f-446e-af34-fbd432e0574d None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:28.751679 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef9a96-249f-446e-af34-fbd432e0574d None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:28.767311 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ea0a3-c196-42b3-9bb5-eee869590aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:28.768006 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ea0a3-c196-42b3-9bb5-eee869590aee admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:28.768304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ea0a3-c196-42b3-9bb5-eee869590aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:28.770440 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ea0a3-c196-42b3-9bb5-eee869590aee admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:28.774216 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ea0a3-c196-42b3-9bb5-eee869590aee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:23:28.774601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ea0a3-c196-42b3-9bb5-eee869590aee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:28.776269 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ea0a3-c196-42b3-9bb5-eee869590aee admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:28.813680 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1226/2469] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:23:28.814515 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ea0a3-c196-42b3-9bb5-eee869590aee admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:28.827439 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2761bc5-0474-4f0d-9829-c2a3580dbc29 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:28.830523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ea0a3-c196-42b3-9bb5-eee869590aee admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:28.835551 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56ef78-faa2-400d-8123-aafdaf80d543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:28.838311 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56ef78-faa2-400d-8123-aafdaf80d543 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:28.838311 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56ef78-faa2-400d-8123-aafdaf80d543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:28.838311 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56ef78-faa2-400d-8123-aafdaf80d543 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:28.838311 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56ef78-faa2-400d-8123-aafdaf80d543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:28.840445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7c08f-f722-4bc5-a2bb-9b36533f9285 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:28.841114 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7c08f-f722-4bc5-a2bb-9b36533f9285 service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:28.841282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56ef78-faa2-400d-8123-aafdaf80d543 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:28.841427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7c08f-f722-4bc5-a2bb-9b36533f9285 service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:28.841688 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7c08f-f722-4bc5-a2bb-9b36533f9285 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:28.858491 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7c08f-f722-4bc5-a2bb-9b36533f9285 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:28.860621 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7c08f-f722-4bc5-a2bb-9b36533f9285 service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:28.873657 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1227/2470] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:23:28 2022] POST /identity/v3/projects => generated 403 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:23:28.877991 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56ef78-faa2-400d-8123-aafdaf80d543 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:28.885441 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1244/2471] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:23:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:23:28.899031 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:29.107818 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56ef78-faa2-400d-8123-aafdaf80d543 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:29.117022 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdffc10-8ec4-44c6-b355-cff95981b4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:29.117892 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdffc10-8ec4-44c6-b355-cff95981b4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:29.118312 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdffc10-8ec4-44c6-b355-cff95981b4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:29.118692 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdffc10-8ec4-44c6-b355-cff95981b4a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:29.119510 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdffc10-8ec4-44c6-b355-cff95981b4a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:29.122479 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdffc10-8ec4-44c6-b355-cff95981b4a6 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:29.174284 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1228/2472] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:23:28 2022] POST /identity/v3/users => generated 302 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:23:29.175741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7c08f-f722-4bc5-a2bb-9b36533f9285 service nova] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:29.199248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7c08f-f722-4bc5-a2bb-9b36533f9285 service nova] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:29.204918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03d793-59e6-41ab-a362-d612a0127c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:29.205790 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03d793-59e6-41ab-a362-d612a0127c8d admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:29.206213 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03d793-59e6-41ab-a362-d612a0127c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:29.206585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03d793-59e6-41ab-a362-d612a0127c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:29.207567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a03d793-59e6-41ab-a362-d612a0127c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:29.209355 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a03d793-59e6-41ab-a362-d612a0127c8d admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:29.228929 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1245/2473] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:23:29.234807 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdffc10-8ec4-44c6-b355-cff95981b4a6 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:29.243601 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03d793-59e6-41ab-a362-d612a0127c8d admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:29.245729 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-8a03d793-59e6-41ab-a362-d612a0127c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:29.261426 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03d793-59e6-41ab-a362-d612a0127c8d admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:29.263903 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdffc10-8ec4-44c6-b355-cff95981b4a6 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:29.267282 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648431a0-eace-4392-bc04-01c9b0342c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:29.268188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648431a0-eace-4392-bc04-01c9b0342c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:29.268479 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648431a0-eace-4392-bc04-01c9b0342c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:29.268764 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648431a0-eace-4392-bc04-01c9b0342c4d admin admin] PATH_INFO: `/v3/users/a648f0bf695b4f7681abf488cd263b48` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:29.270092 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648431a0-eace-4392-bc04-01c9b0342c4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a648f0bf695b4f7681abf488cd263b48)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:29.272524 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648431a0-eace-4392-bc04-01c9b0342c4d admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:29.273975 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227dcce-f037-46fd-9488-32e97f9d580a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:29.276032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227dcce-f037-46fd-9488-32e97f9d580a admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:29.276326 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227dcce-f037-46fd-9488-32e97f9d580a admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:29.276612 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227dcce-f037-46fd-9488-32e97f9d580a admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:29.277820 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227dcce-f037-46fd-9488-32e97f9d580a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:29.280061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227dcce-f037-46fd-9488-32e97f9d580a admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:29.305342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1229/2474] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:23:29.310245 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227dcce-f037-46fd-9488-32e97f9d580a admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:29.318534 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:29.322051 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227dcce-f037-46fd-9488-32e97f9d580a admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:29.327444 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e795cfa-4c60-41f5-ac8b-c5741bf83630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:29.328839 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e795cfa-4c60-41f5-ac8b-c5741bf83630 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:29.329143 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e795cfa-4c60-41f5-ac8b-c5741bf83630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:29.329421 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e795cfa-4c60-41f5-ac8b-c5741bf83630 admin admin] PATH_INFO: `/v3/projects/90af563c72154ef59ceb3966ac292ca8/users/43f086792ab14cd0b035b8c339304924/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:29.349456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e795cfa-4c60-41f5-ac8b-c5741bf83630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90af563c72154ef59ceb3966ac292ca8, user_id=43f086792ab14cd0b035b8c339304924, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:29.352261 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-648431a0-eace-4392-bc04-01c9b0342c4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a648f0bf695b4f7681abf488cd263b48'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:29.353865 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e795cfa-4c60-41f5-ac8b-c5741bf83630 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:29.364211 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-648431a0-eace-4392-bc04-01c9b0342c4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a648f0bf695b4f7681abf488cd263b48'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:29.371946 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1230/2475] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:23:29 2022] PUT /identity/v3/projects/90af563c72154ef59ceb3966ac292ca8/users/43f086792ab14cd0b035b8c339304924/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:29.376935 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-648431a0-eace-4392-bc04-01c9b0342c4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a648f0bf695b4f7681abf488cd263b48'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:29.377766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-648431a0-eace-4392-bc04-01c9b0342c4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a648f0bf695b4f7681abf488cd263b48'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:29.384438 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5fc77-86aa-4a81-abe8-06671365f311 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:29.384740 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5fc77-86aa-4a81-abe8-06671365f311 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:29.385027 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5fc77-86aa-4a81-abe8-06671365f311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:29.395454 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-648431a0-eace-4392-bc04-01c9b0342c4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a648f0bf695b4f7681abf488cd263b48'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:29.407709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1246/2476] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:23:29 2022] DELETE /identity/v3/users/a648f0bf695b4f7681abf488cd263b48 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:29.412691 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dbd35-816d-4560-bd71-37f70da3dae9 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:29.412990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dbd35-816d-4560-bd71-37f70da3dae9 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:29.413831 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dbd35-816d-4560-bd71-37f70da3dae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:29.425722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-69d5fc77-86aa-4a81-abe8-06671365f311 None None] MFA Rules not processed for user `43f086792ab14cd0b035b8c339304924`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:29.428145 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-69d5fc77-86aa-4a81-abe8-06671365f311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:29.434897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-7d7dbd35-816d-4560-bd71-37f70da3dae9 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:29.436178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-7d7dbd35-816d-4560-bd71-37f70da3dae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:29.523011 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1247/2477] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:29.530484 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1231/2478] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:29.532105 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7dbd35-816d-4560-bd71-37f70da3dae9 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:29.533704 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d5fc77-86aa-4a81-abe8-06671365f311 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:29.536170 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-7d7dbd35-816d-4560-bd71-37f70da3dae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:29.536333 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-69d5fc77-86aa-4a81-abe8-06671365f311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:29.554852 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d5fc77-86aa-4a81-abe8-06671365f311 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:29.561003 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cffcd1-746f-4f61-a6ae-2a4d0df60774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:29.561756 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cffcd1-746f-4f61-a6ae-2a4d0df60774 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:29.562053 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cffcd1-746f-4f61-a6ae-2a4d0df60774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:29.562365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cffcd1-746f-4f61-a6ae-2a4d0df60774 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:29.563404 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cffcd1-746f-4f61-a6ae-2a4d0df60774 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:29.566776 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cffcd1-746f-4f61-a6ae-2a4d0df60774 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:29.606782 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1232/2479] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:23:29 2022] POST /identity/v3/projects => generated 403 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:23:29.608275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cffcd1-746f-4f61-a6ae-2a4d0df60774 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:29.631284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7dbd35-816d-4560-bd71-37f70da3dae9 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:29.666458 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:29.721867 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cffcd1-746f-4f61-a6ae-2a4d0df60774 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:29.724720 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed244e-0edb-47f1-9565-369dc63fee68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:29.725374 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed244e-0edb-47f1-9565-369dc63fee68 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:29.726244 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed244e-0edb-47f1-9565-369dc63fee68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:29.726602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed244e-0edb-47f1-9565-369dc63fee68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:29.727420 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c2292-7935-498d-a349-64ec21cb4d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:29.728121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c2292-7935-498d-a349-64ec21cb4d6b admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:29.728516 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c2292-7935-498d-a349-64ec21cb4d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:29.728803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c2292-7935-498d-a349-64ec21cb4d6b admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:29.729503 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c2292-7935-498d-a349-64ec21cb4d6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:29.731486 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c2292-7935-498d-a349-64ec21cb4d6b admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:29.740482 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed244e-0edb-47f1-9565-369dc63fee68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:29.747480 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed244e-0edb-47f1-9565-369dc63fee68 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:29.763525 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1233/2480] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:23:29 2022] POST /identity/v3/users => generated 308 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:23:29.768407 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c2292-7935-498d-a349-64ec21cb4d6b admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:29.775790 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1248/2481] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:23:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:23:29.791125 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c2292-7935-498d-a349-64ec21cb4d6b admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:29.796680 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634e437-416e-4ae4-bdc9-e94a66d827e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:29.797660 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634e437-416e-4ae4-bdc9-e94a66d827e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:29.798107 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634e437-416e-4ae4-bdc9-e94a66d827e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:29.798803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634e437-416e-4ae4-bdc9-e94a66d827e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:29.800242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634e437-416e-4ae4-bdc9-e94a66d827e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:29.802749 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634e437-416e-4ae4-bdc9-e94a66d827e3 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:29.822149 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1234/2482] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:23:29.823054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed244e-0edb-47f1-9565-369dc63fee68 service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:29.829901 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:29.836970 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed244e-0edb-47f1-9565-369dc63fee68 service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:29.846912 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1eb2d-518b-489f-8323-82ea334082d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:29.848214 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1eb2d-518b-489f-8323-82ea334082d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:29.849220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1eb2d-518b-489f-8323-82ea334082d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:29.849765 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1eb2d-518b-489f-8323-82ea334082d8 admin admin] PATH_INFO: `/v3/projects/5e5c1d6013f844dfac642aa9ec66ebd3/users/ae7b70398b46474487d3735d679c378b/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:29.871307 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1eb2d-518b-489f-8323-82ea334082d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5c1d6013f844dfac642aa9ec66ebd3, user_id=ae7b70398b46474487d3735d679c378b, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:29.874286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1eb2d-518b-489f-8323-82ea334082d8 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:29.901139 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634e437-416e-4ae4-bdc9-e94a66d827e3 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:29.901605 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1249/2483] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:23:29 2022] PUT /identity/v3/projects/5e5c1d6013f844dfac642aa9ec66ebd3/users/ae7b70398b46474487d3735d679c378b/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:23:29.913341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634e437-416e-4ae4-bdc9-e94a66d827e3 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:29.997309 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6141a1-19f8-4a0a-b7be-44917e0c6fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:29.997992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6141a1-19f8-4a0a-b7be-44917e0c6fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:29.998362 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6141a1-19f8-4a0a-b7be-44917e0c6fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:29.998698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6141a1-19f8-4a0a-b7be-44917e0c6fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:30.000070 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6141a1-19f8-4a0a-b7be-44917e0c6fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:30.001057 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6141a1-19f8-4a0a-b7be-44917e0c6fb5 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:30.014259 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1235/2484] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:23:30.018802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1eb2d-518b-489f-8323-82ea334082d8 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:30.031513 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1eb2d-518b-489f-8323-82ea334082d8 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:30.043636 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7b5a5-848c-46db-972d-c039aa19b7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:30.045105 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7b5a5-848c-46db-972d-c039aa19b7e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:30.045861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7b5a5-848c-46db-972d-c039aa19b7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:30.046803 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7b5a5-848c-46db-972d-c039aa19b7e9 admin admin] PATH_INFO: `/v3/projects/5e5c1d6013f844dfac642aa9ec66ebd3/users/ae7b70398b46474487d3735d679c378b/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:30.050698 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7b5a5-848c-46db-972d-c039aa19b7e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5c1d6013f844dfac642aa9ec66ebd3, user_id=ae7b70398b46474487d3735d679c378b, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:30.054323 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7b5a5-848c-46db-972d-c039aa19b7e9 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:30.070590 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1250/2485] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:23:30 2022] PUT /identity/v3/projects/5e5c1d6013f844dfac642aa9ec66ebd3/users/ae7b70398b46474487d3735d679c378b/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:23:30.080882 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392ea9c-9967-43b6-b05e-822b724795d8 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:30.081190 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392ea9c-9967-43b6-b05e-822b724795d8 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:30.081457 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392ea9c-9967-43b6-b05e-822b724795d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:30.168290 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7b5a5-848c-46db-972d-c039aa19b7e9 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:30.170154 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-dfe7b5a5-848c-46db-972d-c039aa19b7e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:30.263588 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-5392ea9c-9967-43b6-b05e-822b724795d8 None None] MFA Rules not processed for user `ae7b70398b46474487d3735d679c378b`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:30.266050 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-5392ea9c-9967-43b6-b05e-822b724795d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:30.268851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7b5a5-848c-46db-972d-c039aa19b7e9 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:30.275934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88efa60-070a-4dbe-8163-b04a112a36df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:30.277150 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88efa60-070a-4dbe-8163-b04a112a36df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:30.277844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88efa60-070a-4dbe-8163-b04a112a36df admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:30.279814 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88efa60-070a-4dbe-8163-b04a112a36df admin admin] PATH_INFO: `/v3/projects/fce8bc59a0da45fbb49e9771a6a7d428` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:30.285069 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88efa60-070a-4dbe-8163-b04a112a36df admin admin] RBAC: Authorizing `identity:delete_project(project_id=fce8bc59a0da45fbb49e9771a6a7d428)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:30.288897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88efa60-070a-4dbe-8163-b04a112a36df admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:30.407590 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-e88efa60-070a-4dbe-8163-b04a112a36df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fce8bc59a0da45fbb49e9771a6a7d428', 'request_id': 'req-e88efa60-070a-4dbe-8163-b04a112a36df'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:30.425316 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-e88efa60-070a-4dbe-8163-b04a112a36df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fce8bc59a0da45fbb49e9771a6a7d428', 'request_id': 'req-e88efa60-070a-4dbe-8163-b04a112a36df'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:30.435018 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1236/2486] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:30 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:30.437620 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-e88efa60-070a-4dbe-8163-b04a112a36df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fce8bc59a0da45fbb49e9771a6a7d428', 'request_id': 'req-e88efa60-070a-4dbe-8163-b04a112a36df'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:30.458380 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392ea9c-9967-43b6-b05e-822b724795d8 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:30.461604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-5392ea9c-9967-43b6-b05e-822b724795d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:30.463738 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-e88efa60-070a-4dbe-8163-b04a112a36df admin admin] The token cache is being invalidate because project fce8bc59a0da45fbb49e9771a6a7d428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:23:30.464312 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-e88efa60-070a-4dbe-8163-b04a112a36df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:30.465560 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-e88efa60-070a-4dbe-8163-b04a112a36df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:30.470887 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1251/2487] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:23:30 2022] DELETE /identity/v3/projects/fce8bc59a0da45fbb49e9771a6a7d428 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:23:30.473681 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f3bac-3f26-44c4-b01d-03e52e2a96fd None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:30.474272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f3bac-3f26-44c4-b01d-03e52e2a96fd None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:30.475095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f3bac-3f26-44c4-b01d-03e52e2a96fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:30.502962 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-ae9f3bac-3f26-44c4-b01d-03e52e2a96fd None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:30.504682 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-ae9f3bac-3f26-44c4-b01d-03e52e2a96fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:30.539510 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:30.562915 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392ea9c-9967-43b6-b05e-822b724795d8 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:30.591187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:30.610369 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1252/2488] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:30.619572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cdd84-deaa-46aa-a3a9-da45b3c7d90f None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:30.619864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cdd84-deaa-46aa-a3a9-da45b3c7d90f None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:30.620135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cdd84-deaa-46aa-a3a9-da45b3c7d90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:30.634637 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d7f7f-5c0f-4d1d-9d1c-1d49943ffade service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:30.635489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d7f7f-5c0f-4d1d-9d1c-1d49943ffade service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:30.635611 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d7f7f-5c0f-4d1d-9d1c-1d49943ffade service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:30.635845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d7f7f-5c0f-4d1d-9d1c-1d49943ffade service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:30.641696 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-f83d7f7f-5c0f-4d1d-9d1c-1d49943ffade service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:30.645171 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-791cdd84-deaa-46aa-a3a9-da45b3c7d90f None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:30.646486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-791cdd84-deaa-46aa-a3a9-da45b3c7d90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:30.658616 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1253/2489] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:30.663730 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cdd84-deaa-46aa-a3a9-da45b3c7d90f None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:30.677500 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cdd84-deaa-46aa-a3a9-da45b3c7d90f None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:30.683091 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9ee76-3da6-448e-b847-3c549ad7c206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:30.683798 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9ee76-3da6-448e-b847-3c549ad7c206 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:30.684089 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9ee76-3da6-448e-b847-3c549ad7c206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:30.684378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9ee76-3da6-448e-b847-3c549ad7c206 admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:30.685125 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9ee76-3da6-448e-b847-3c549ad7c206 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:23:30.685442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9ee76-3da6-448e-b847-3c549ad7c206 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:30.687120 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9ee76-3da6-448e-b847-3c549ad7c206 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:30.702515 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1254/2490] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:23:30.708867 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9ee76-3da6-448e-b847-3c549ad7c206 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:30.728730 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9ee76-3da6-448e-b847-3c549ad7c206 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:30.740604 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df591f35-09ba-4e11-8aeb-1f542a4ba207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:30.741334 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df591f35-09ba-4e11-8aeb-1f542a4ba207 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:30.741616 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df591f35-09ba-4e11-8aeb-1f542a4ba207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:30.741897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df591f35-09ba-4e11-8aeb-1f542a4ba207 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:30.742633 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df591f35-09ba-4e11-8aeb-1f542a4ba207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:30.744809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df591f35-09ba-4e11-8aeb-1f542a4ba207 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:30.770297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d7f7f-5c0f-4d1d-9d1c-1d49943ffade service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:30.772409 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d7f7f-5c0f-4d1d-9d1c-1d49943ffade service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:30.786218 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1237/2491] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:23:30 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:23:30.790767 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1255/2492] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:23:30 2022] POST /identity/v3/projects => generated 365 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:23:30.799626 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d7f7f-5c0f-4d1d-9d1c-1d49943ffade service cinder] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:30.819040 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d7f7f-5c0f-4d1d-9d1c-1d49943ffade service cinder] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:30.910904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdc930-3967-4dc2-8075-7a29bcdea4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:30.911985 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdc930-3967-4dc2-8075-7a29bcdea4dd admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:30.912521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdc930-3967-4dc2-8075-7a29bcdea4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:30.912904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdc930-3967-4dc2-8075-7a29bcdea4dd admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:30.914546 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cdc930-3967-4dc2-8075-7a29bcdea4dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:30.916609 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cdc930-3967-4dc2-8075-7a29bcdea4dd admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:30.947015 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1238/2493] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:23:30 2022] POST /identity/v3/users => generated 283 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:23:30.951100 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df591f35-09ba-4e11-8aeb-1f542a4ba207 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:30.963397 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df591f35-09ba-4e11-8aeb-1f542a4ba207 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:30.974053 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdc930-3967-4dc2-8075-7a29bcdea4dd admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:30.976799 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bd2e0-8ff2-4dfb-b34f-b566f9958111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:30.977089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-63cdc930-3967-4dc2-8075-7a29bcdea4dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:30.977638 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bd2e0-8ff2-4dfb-b34f-b566f9958111 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:30.978016 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bd2e0-8ff2-4dfb-b34f-b566f9958111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:30.978397 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bd2e0-8ff2-4dfb-b34f-b566f9958111 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:30.979218 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95bd2e0-8ff2-4dfb-b34f-b566f9958111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:30.980906 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95bd2e0-8ff2-4dfb-b34f-b566f9958111 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:30.989262 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdc930-3967-4dc2-8075-7a29bcdea4dd admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:30.994405 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1256/2494] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:23:30.997993 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bd2e0-8ff2-4dfb-b34f-b566f9958111 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:30.998385 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d08105-9a63-4d0e-be27-5595d348dc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:30.999355 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d08105-9a63-4d0e-be27-5595d348dc8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:30.999678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d08105-9a63-4d0e-be27-5595d348dc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:31.000010 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d08105-9a63-4d0e-be27-5595d348dc8e admin admin] PATH_INFO: `/v3/users/43f086792ab14cd0b035b8c339304924` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:31.001322 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d08105-9a63-4d0e-be27-5595d348dc8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=43f086792ab14cd0b035b8c339304924)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:31.003553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d08105-9a63-4d0e-be27-5595d348dc8e admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:31.016523 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bd2e0-8ff2-4dfb-b34f-b566f9958111 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:31.030095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950336e1-19bc-4490-a101-235afca86cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:31.031006 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950336e1-19bc-4490-a101-235afca86cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:31.031395 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950336e1-19bc-4490-a101-235afca86cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:31.031772 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950336e1-19bc-4490-a101-235afca86cc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:31.032716 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950336e1-19bc-4490-a101-235afca86cc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:31.033192 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:31.036053 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950336e1-19bc-4490-a101-235afca86cc6 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:31.061307 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1257/2495] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:23:31.063233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950336e1-19bc-4490-a101-235afca86cc6 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:31.081514 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950336e1-19bc-4490-a101-235afca86cc6 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:31.086851 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-41d08105-9a63-4d0e-be27-5595d348dc8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43f086792ab14cd0b035b8c339304924'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:31.087114 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31a11e-da52-45aa-9726-118f529661eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:31.087960 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-41d08105-9a63-4d0e-be27-5595d348dc8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43f086792ab14cd0b035b8c339304924'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:31.088186 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31a11e-da52-45aa-9726-118f529661eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:31.088588 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31a11e-da52-45aa-9726-118f529661eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:31.089032 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31a11e-da52-45aa-9726-118f529661eb admin admin] PATH_INFO: `/v3/projects/9bdde5222d2349d3bc47ee7e1c83a7be/users/38a66ac0363544068a2d7fe15496f4bd/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:31.103401 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-41d08105-9a63-4d0e-be27-5595d348dc8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43f086792ab14cd0b035b8c339304924'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:31.111525 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31a11e-da52-45aa-9726-118f529661eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bdde5222d2349d3bc47ee7e1c83a7be, user_id=38a66ac0363544068a2d7fe15496f4bd, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:31.111909 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-41d08105-9a63-4d0e-be27-5595d348dc8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43f086792ab14cd0b035b8c339304924'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:31.116684 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31a11e-da52-45aa-9726-118f529661eb admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:31.130322 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-41d08105-9a63-4d0e-be27-5595d348dc8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43f086792ab14cd0b035b8c339304924'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:31.134480 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1258/2496] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:23:31 2022] PUT /identity/v3/projects/9bdde5222d2349d3bc47ee7e1c83a7be/users/38a66ac0363544068a2d7fe15496f4bd/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:23:31.141778 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1239/2497] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:23:30 2022] DELETE /identity/v3/users/43f086792ab14cd0b035b8c339304924 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:23:31.148912 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1fd24-4d76-4d4a-a87a-cfd89c8ed164 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:31.149238 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1fd24-4d76-4d4a-a87a-cfd89c8ed164 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:31.149528 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1fd24-4d76-4d4a-a87a-cfd89c8ed164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:31.149778 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43e86b-41ca-4f76-91fe-d63c0c6afb05 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:31.150202 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43e86b-41ca-4f76-91fe-d63c0c6afb05 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:31.150580 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43e86b-41ca-4f76-91fe-d63c0c6afb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:31.168905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-5ab1fd24-4d76-4d4a-a87a-cfd89c8ed164 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:31.170166 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-5ab1fd24-4d76-4d4a-a87a-cfd89c8ed164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:31.189515 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-3f43e86b-41ca-4f76-91fe-d63c0c6afb05 None None] MFA Rules not processed for user `38a66ac0363544068a2d7fe15496f4bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:31.190553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-3f43e86b-41ca-4f76-91fe-d63c0c6afb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:31.253375 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1259/2498] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:31.265541 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1fd24-4d76-4d4a-a87a-cfd89c8ed164 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:31.267494 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-5ab1fd24-4d76-4d4a-a87a-cfd89c8ed164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:31.287940 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1240/2499] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:31.293111 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43e86b-41ca-4f76-91fe-d63c0c6afb05 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:31.295427 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-3f43e86b-41ca-4f76-91fe-d63c0c6afb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:31.312060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43e86b-41ca-4f76-91fe-d63c0c6afb05 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:31.317837 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58bec5-0dc2-4e73-bac2-a4dd428897a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:31.318623 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58bec5-0dc2-4e73-bac2-a4dd428897a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:31.318916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58bec5-0dc2-4e73-bac2-a4dd428897a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:31.319194 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58bec5-0dc2-4e73-bac2-a4dd428897a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:31.319928 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58bec5-0dc2-4e73-bac2-a4dd428897a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:31.321931 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58bec5-0dc2-4e73-bac2-a4dd428897a7 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:31.363726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1241/2500] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:23:31 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:23:31.365712 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58bec5-0dc2-4e73-bac2-a4dd428897a7 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:31.369442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1fd24-4d76-4d4a-a87a-cfd89c8ed164 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:31.411082 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:31.462374 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010650a-970f-4405-b78d-c6dee3bb1f63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:31.463212 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010650a-970f-4405-b78d-c6dee3bb1f63 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:31.463618 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010650a-970f-4405-b78d-c6dee3bb1f63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:31.464269 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010650a-970f-4405-b78d-c6dee3bb1f63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:31.471679 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58bec5-0dc2-4e73-bac2-a4dd428897a7 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:31.475771 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010650a-970f-4405-b78d-c6dee3bb1f63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:31.479420 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010650a-970f-4405-b78d-c6dee3bb1f63 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:31.484726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7b20b-473a-4aea-9216-aeabd0aee570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:31.485417 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7b20b-473a-4aea-9216-aeabd0aee570 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:31.485708 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7b20b-473a-4aea-9216-aeabd0aee570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:31.485985 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7b20b-473a-4aea-9216-aeabd0aee570 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:31.486710 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7b20b-473a-4aea-9216-aeabd0aee570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:31.491441 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7b20b-473a-4aea-9216-aeabd0aee570 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:31.505173 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1260/2501] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:23:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:23:31.510729 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:31.521150 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1242/2502] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:23:31 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:23:31.525872 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010650a-970f-4405-b78d-c6dee3bb1f63 service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:31.538969 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010650a-970f-4405-b78d-c6dee3bb1f63 service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:31.545920 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaa4cf-775a-46a1-8fec-26f0f1a78d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:31.547178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaa4cf-775a-46a1-8fec-26f0f1a78d99 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:31.547469 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaa4cf-775a-46a1-8fec-26f0f1a78d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:31.547756 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaa4cf-775a-46a1-8fec-26f0f1a78d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:31.548569 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaaa4cf-775a-46a1-8fec-26f0f1a78d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:31.550548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaaa4cf-775a-46a1-8fec-26f0f1a78d99 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:31.575767 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1261/2503] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:23:31.580355 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7b20b-473a-4aea-9216-aeabd0aee570 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:31.590798 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7b20b-473a-4aea-9216-aeabd0aee570 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:31.600106 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469838e-2816-44b2-baac-509612ca1f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:31.600106 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469838e-2816-44b2-baac-509612ca1f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:31.600996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469838e-2816-44b2-baac-509612ca1f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:31.601329 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469838e-2816-44b2-baac-509612ca1f76 admin admin] PATH_INFO: `/v3/projects/2819e570e08f4e3fb513155afd08761e/users/f938872f9b924e12b7e90ae8bcdd11d7/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:31.623224 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469838e-2816-44b2-baac-509612ca1f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2819e570e08f4e3fb513155afd08761e, user_id=f938872f9b924e12b7e90ae8bcdd11d7, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:31.626242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469838e-2816-44b2-baac-509612ca1f76 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:31.658146 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1243/2504] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:23:31 2022] PUT /identity/v3/projects/2819e570e08f4e3fb513155afd08761e/users/f938872f9b924e12b7e90ae8bcdd11d7/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:31.662424 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaa4cf-775a-46a1-8fec-26f0f1a78d99 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:31.687484 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaa4cf-775a-46a1-8fec-26f0f1a78d99 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:31.844832 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fef218-9bd2-419d-a956-99ed9653e9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:31.846487 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fef218-9bd2-419d-a956-99ed9653e9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:31.848562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fef218-9bd2-419d-a956-99ed9653e9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:31.853089 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fef218-9bd2-419d-a956-99ed9653e9a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:31.854100 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fef218-9bd2-419d-a956-99ed9653e9a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:31.856124 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fef218-9bd2-419d-a956-99ed9653e9a3 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:31.872721 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1262/2505] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:23:31.877576 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469838e-2816-44b2-baac-509612ca1f76 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:31.888854 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469838e-2816-44b2-baac-509612ca1f76 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:31.895876 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa82550-2a5a-4a03-be2b-a8b75f5dba8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:31.896793 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa82550-2a5a-4a03-be2b-a8b75f5dba8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:31.897845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa82550-2a5a-4a03-be2b-a8b75f5dba8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:31.898142 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa82550-2a5a-4a03-be2b-a8b75f5dba8e admin admin] PATH_INFO: `/v3/projects/2819e570e08f4e3fb513155afd08761e/users/f938872f9b924e12b7e90ae8bcdd11d7/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:31.900215 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa82550-2a5a-4a03-be2b-a8b75f5dba8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2819e570e08f4e3fb513155afd08761e, user_id=f938872f9b924e12b7e90ae8bcdd11d7, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:31.903088 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa82550-2a5a-4a03-be2b-a8b75f5dba8e admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:31.937069 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1244/2506] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:23:31 2022] PUT /identity/v3/projects/2819e570e08f4e3fb513155afd08761e/users/f938872f9b924e12b7e90ae8bcdd11d7/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:31.939160 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cffa7-c7b3-44b0-8e17-27ba58f0a9a8 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:31.939640 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cffa7-c7b3-44b0-8e17-27ba58f0a9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:31.940079 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cffa7-c7b3-44b0-8e17-27ba58f0a9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:31.986032 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-9a4cffa7-c7b3-44b0-8e17-27ba58f0a9a8 None None] MFA Rules not processed for user `f938872f9b924e12b7e90ae8bcdd11d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:31.987647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-9a4cffa7-c7b3-44b0-8e17-27ba58f0a9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:32.051769 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa82550-2a5a-4a03-be2b-a8b75f5dba8e admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:32.053955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-8fa82550-2a5a-4a03-be2b-a8b75f5dba8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:32.115613 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1263/2507] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:31 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:32.128201 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cffa7-c7b3-44b0-8e17-27ba58f0a9a8 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:32.129464 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-9a4cffa7-c7b3-44b0-8e17-27ba58f0a9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:32.172847 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa82550-2a5a-4a03-be2b-a8b75f5dba8e admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:32.178234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1096d2-d36b-458d-9b34-ed135fcccd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:32.180631 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1096d2-d36b-458d-9b34-ed135fcccd25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:32.180918 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1096d2-d36b-458d-9b34-ed135fcccd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:32.181193 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1096d2-d36b-458d-9b34-ed135fcccd25 admin admin] PATH_INFO: `/v3/projects/90af563c72154ef59ceb3966ac292ca8` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:32.182657 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1096d2-d36b-458d-9b34-ed135fcccd25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90af563c72154ef59ceb3966ac292ca8)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:32.185029 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1096d2-d36b-458d-9b34-ed135fcccd25 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:32.203060 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:32.223204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cffa7-c7b3-44b0-8e17-27ba58f0a9a8 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:32.231661 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140698d0-4973-4169-95b9-a8df4293f4b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:32.233151 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140698d0-4973-4169-95b9-a8df4293f4b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:32.233654 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140698d0-4973-4169-95b9-a8df4293f4b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:32.233994 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140698d0-4973-4169-95b9-a8df4293f4b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:32.249756 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140698d0-4973-4169-95b9-a8df4293f4b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:32.251474 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140698d0-4973-4169-95b9-a8df4293f4b1 service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:32.271054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1264/2508] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:23:32 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:23:32.272014 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-2d1096d2-d36b-458d-9b34-ed135fcccd25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90af563c72154ef59ceb3966ac292ca8', 'request_id': 'req-2d1096d2-d36b-458d-9b34-ed135fcccd25'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:32.280550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-2d1096d2-d36b-458d-9b34-ed135fcccd25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90af563c72154ef59ceb3966ac292ca8', 'request_id': 'req-2d1096d2-d36b-458d-9b34-ed135fcccd25'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:32.291559 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-2d1096d2-d36b-458d-9b34-ed135fcccd25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90af563c72154ef59ceb3966ac292ca8', 'request_id': 'req-2d1096d2-d36b-458d-9b34-ed135fcccd25'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:32.305040 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-2d1096d2-d36b-458d-9b34-ed135fcccd25 admin admin] The token cache is being invalidate because project 90af563c72154ef59ceb3966ac292ca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:23:32.305330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-2d1096d2-d36b-458d-9b34-ed135fcccd25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:32.306009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-2d1096d2-d36b-458d-9b34-ed135fcccd25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:32.310638 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1245/2509] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:23:32 2022] DELETE /identity/v3/projects/90af563c72154ef59ceb3966ac292ca8 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:32.314612 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140698d0-4973-4169-95b9-a8df4293f4b1 service cinder] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:32.332640 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140698d0-4973-4169-95b9-a8df4293f4b1 service cinder] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:32.379048 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1096d2-d36b-458d-9b34-ed135fcccd25 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:32.381175 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-2d1096d2-d36b-458d-9b34-ed135fcccd25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:32.427614 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e405b-f328-4385-a82d-e3c17eecebff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:32.429899 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e405b-f328-4385-a82d-e3c17eecebff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:32.430387 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e405b-f328-4385-a82d-e3c17eecebff admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:32.430925 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e405b-f328-4385-a82d-e3c17eecebff admin admin] PATH_INFO: `/v3/users/ae7b70398b46474487d3735d679c378b` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:32.432617 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e405b-f328-4385-a82d-e3c17eecebff admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae7b70398b46474487d3735d679c378b)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:32.435080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e405b-f328-4385-a82d-e3c17eecebff admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:32.472503 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1096d2-d36b-458d-9b34-ed135fcccd25 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:32.478974 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f35a5-8553-49c1-9d29-fa47b95ae9f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:32.479715 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f35a5-8553-49c1-9d29-fa47b95ae9f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:32.480062 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f35a5-8553-49c1-9d29-fa47b95ae9f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:32.480602 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f35a5-8553-49c1-9d29-fa47b95ae9f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:32.483147 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-5a5f35a5-8553-49c1-9d29-fa47b95ae9f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:32.489878 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:32.520964 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-a08e405b-f328-4385-a82d-e3c17eecebff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae7b70398b46474487d3735d679c378b'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:32.535654 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-a08e405b-f328-4385-a82d-e3c17eecebff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae7b70398b46474487d3735d679c378b'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:32.546070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-a08e405b-f328-4385-a82d-e3c17eecebff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae7b70398b46474487d3735d679c378b'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:32.547931 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-a08e405b-f328-4385-a82d-e3c17eecebff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae7b70398b46474487d3735d679c378b'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:32.564687 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-a08e405b-f328-4385-a82d-e3c17eecebff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae7b70398b46474487d3735d679c378b'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:32.579059 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1265/2510] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:23:32 2022] DELETE /identity/v3/users/ae7b70398b46474487d3735d679c378b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:32.590710 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f35a5-8553-49c1-9d29-fa47b95ae9f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:32.592217 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f35a5-8553-49c1-9d29-fa47b95ae9f5 service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:32.621303 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1246/2511] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:23:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:23:33.009423 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e405b-f328-4385-a82d-e3c17eecebff admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:33.015024 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a08e405b-f328-4385-a82d-e3c17eecebff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:33.146452 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e405b-f328-4385-a82d-e3c17eecebff admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:33.152245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5b12a-09fd-4754-a234-4b1da34c6ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:33.155231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5b12a-09fd-4754-a234-4b1da34c6ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:33.155231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5b12a-09fd-4754-a234-4b1da34c6ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:33.155231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5b12a-09fd-4754-a234-4b1da34c6ed5 admin admin] PATH_INFO: `/v3/projects/5e5c1d6013f844dfac642aa9ec66ebd3` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:33.155231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5b12a-09fd-4754-a234-4b1da34c6ed5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e5c1d6013f844dfac642aa9ec66ebd3)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:33.157282 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5b12a-09fd-4754-a234-4b1da34c6ed5 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:33.160066 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:33.217507 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-cae5b12a-09fd-4754-a234-4b1da34c6ed5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e5c1d6013f844dfac642aa9ec66ebd3', 'request_id': 'req-cae5b12a-09fd-4754-a234-4b1da34c6ed5'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:33.224967 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-cae5b12a-09fd-4754-a234-4b1da34c6ed5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e5c1d6013f844dfac642aa9ec66ebd3', 'request_id': 'req-cae5b12a-09fd-4754-a234-4b1da34c6ed5'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:33.238843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-cae5b12a-09fd-4754-a234-4b1da34c6ed5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e5c1d6013f844dfac642aa9ec66ebd3', 'request_id': 'req-cae5b12a-09fd-4754-a234-4b1da34c6ed5'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:33.254544 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-cae5b12a-09fd-4754-a234-4b1da34c6ed5 admin admin] The token cache is being invalidate because project 5e5c1d6013f844dfac642aa9ec66ebd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:23:33.254987 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-cae5b12a-09fd-4754-a234-4b1da34c6ed5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:33.255745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-cae5b12a-09fd-4754-a234-4b1da34c6ed5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:33.258413 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1266/2512] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:23:33 2022] DELETE /identity/v3/projects/5e5c1d6013f844dfac642aa9ec66ebd3 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:33.263534 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd153b5a-13e4-4418-b4ba-79aeda74c5d7 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:33.263826 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd153b5a-13e4-4418-b4ba-79aeda74c5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:33.264108 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd153b5a-13e4-4418-b4ba-79aeda74c5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:33.294069 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-fd153b5a-13e4-4418-b4ba-79aeda74c5d7 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:33.298394 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-fd153b5a-13e4-4418-b4ba-79aeda74c5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:33.392857 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6b010-ed0a-4400-8296-2eb0a2e5ef43 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:33.393313 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6b010-ed0a-4400-8296-2eb0a2e5ef43 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:33.393693 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6b010-ed0a-4400-8296-2eb0a2e5ef43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:33.396951 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1247/2513] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:23:33.418382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-9bf6b010-ed0a-4400-8296-2eb0a2e5ef43 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:33.419782 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-9bf6b010-ed0a-4400-8296-2eb0a2e5ef43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:33.428482 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1267/2514] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:33.435052 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd153b5a-13e4-4418-b4ba-79aeda74c5d7 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:33.447013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd153b5a-13e4-4418-b4ba-79aeda74c5d7 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:33.451849 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864e1aa-0cbb-46a5-8243-6f72fbad02b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:33.452672 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864e1aa-0cbb-46a5-8243-6f72fbad02b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:33.453052 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864e1aa-0cbb-46a5-8243-6f72fbad02b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:33.453430 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864e1aa-0cbb-46a5-8243-6f72fbad02b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:33.456461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864e1aa-0cbb-46a5-8243-6f72fbad02b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:23:33.456799 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864e1aa-0cbb-46a5-8243-6f72fbad02b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:33.458464 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864e1aa-0cbb-46a5-8243-6f72fbad02b1 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:33.480577 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1248/2515] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:23:33.481356 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6b010-ed0a-4400-8296-2eb0a2e5ef43 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:33.491001 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6b010-ed0a-4400-8296-2eb0a2e5ef43 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:33.496046 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6efd9-c612-45bf-9c2f-3646a8f0fa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:33.497075 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6efd9-c612-45bf-9c2f-3646a8f0fa0f admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:33.497075 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6efd9-c612-45bf-9c2f-3646a8f0fa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:33.497313 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6efd9-c612-45bf-9c2f-3646a8f0fa0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:33.498310 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6efd9-c612-45bf-9c2f-3646a8f0fa0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:33.500255 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6efd9-c612-45bf-9c2f-3646a8f0fa0f admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:33.533299 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1268/2516] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:23:33 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:23:33.539986 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864e1aa-0cbb-46a5-8243-6f72fbad02b1 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:33.556940 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864e1aa-0cbb-46a5-8243-6f72fbad02b1 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:33.647292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d03ad-040b-4820-a481-905d1a43c735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:33.648543 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d03ad-040b-4820-a481-905d1a43c735 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:33.648830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d03ad-040b-4820-a481-905d1a43c735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:33.649109 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d03ad-040b-4820-a481-905d1a43c735 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:33.649871 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d03ad-040b-4820-a481-905d1a43c735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:33.651917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d03ad-040b-4820-a481-905d1a43c735 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:33.686220 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1249/2517] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:23:33 2022] POST /identity/v3/users => generated 294 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:23:33.687658 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6efd9-c612-45bf-9c2f-3646a8f0fa0f admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:33.699918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6efd9-c612-45bf-9c2f-3646a8f0fa0f admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:33.710480 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75677235-88c8-4809-923e-006558e8a3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:33.711190 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75677235-88c8-4809-923e-006558e8a3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:33.711486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75677235-88c8-4809-923e-006558e8a3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:33.711751 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75677235-88c8-4809-923e-006558e8a3f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:33.712487 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75677235-88c8-4809-923e-006558e8a3f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:33.715065 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75677235-88c8-4809-923e-006558e8a3f8 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:33.733725 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1269/2518] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:23:33.738012 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d03ad-040b-4820-a481-905d1a43c735 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:33.754253 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d03ad-040b-4820-a481-905d1a43c735 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:33.759864 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebb6df-ffc0-4136-ae88-f81a02dab9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:33.760651 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebb6df-ffc0-4136-ae88-f81a02dab9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:33.760947 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebb6df-ffc0-4136-ae88-f81a02dab9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:33.761335 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebb6df-ffc0-4136-ae88-f81a02dab9a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:33.762075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebb6df-ffc0-4136-ae88-f81a02dab9a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:33.763828 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebb6df-ffc0-4136-ae88-f81a02dab9a9 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:33.775304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1250/2519] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:23:33.779520 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75677235-88c8-4809-923e-006558e8a3f8 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:33.792839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75677235-88c8-4809-923e-006558e8a3f8 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:33.797802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb6357-2f83-4b1a-91c1-e1e422bb38fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:33.798829 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb6357-2f83-4b1a-91c1-e1e422bb38fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:33.799212 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb6357-2f83-4b1a-91c1-e1e422bb38fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:33.799564 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb6357-2f83-4b1a-91c1-e1e422bb38fe admin admin] PATH_INFO: `/v3/projects/26fe0ded1a344e439e1bc97daf058ad6/users/9f109365e75445f7b155b65adeb6adc2/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:33.817499 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb6357-2f83-4b1a-91c1-e1e422bb38fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=26fe0ded1a344e439e1bc97daf058ad6, user_id=9f109365e75445f7b155b65adeb6adc2, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:33.821346 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb6357-2f83-4b1a-91c1-e1e422bb38fe admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:33.850146 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1270/2520] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:23:33 2022] PUT /identity/v3/projects/26fe0ded1a344e439e1bc97daf058ad6/users/9f109365e75445f7b155b65adeb6adc2/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:33.852678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e53e03-f7f8-4182-b657-61b9f900c333 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:33.853905 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e53e03-f7f8-4182-b657-61b9f900c333 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:33.854702 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e53e03-f7f8-4182-b657-61b9f900c333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:33.880884 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:33.902880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-f6e53e03-f7f8-4182-b657-61b9f900c333 None None] MFA Rules not processed for user `9f109365e75445f7b155b65adeb6adc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:33.904567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-f6e53e03-f7f8-4182-b657-61b9f900c333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:33.995396 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1251/2521] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:33.999550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb6357-2f83-4b1a-91c1-e1e422bb38fe admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:34.114494 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb6357-2f83-4b1a-91c1-e1e422bb38fe admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:34.119895 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecbe9d-00c5-4def-a639-cfdce2946646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:34.120639 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecbe9d-00c5-4def-a639-cfdce2946646 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:34.120925 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecbe9d-00c5-4def-a639-cfdce2946646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:34.121204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecbe9d-00c5-4def-a639-cfdce2946646 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:34.121915 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ecbe9d-00c5-4def-a639-cfdce2946646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:34.124055 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ecbe9d-00c5-4def-a639-cfdce2946646 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:34.172293 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1271/2522] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:23:33 2022] POST /identity/v3/projects => generated 381 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:23:34.173608 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e53e03-f7f8-4182-b657-61b9f900c333 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:34.185125 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e53e03-f7f8-4182-b657-61b9f900c333 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:34.302325 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11eda9f-a049-468d-891c-4c5135505704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:34.302325 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eda9f-a049-468d-891c-4c5135505704 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:34.302325 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eda9f-a049-468d-891c-4c5135505704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:34.302325 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eda9f-a049-468d-891c-4c5135505704 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:34.303336 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11eda9f-a049-468d-891c-4c5135505704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:34.303336 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11eda9f-a049-468d-891c-4c5135505704 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:34.383599 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1252/2523] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:23:34 2022] POST /identity/v3/users => generated 297 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:23:34.387789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecbe9d-00c5-4def-a639-cfdce2946646 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:34.400631 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecbe9d-00c5-4def-a639-cfdce2946646 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:34.406701 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6a26e-9190-417d-83fc-7ad06370c838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:34.408432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6a26e-9190-417d-83fc-7ad06370c838 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:34.409086 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6a26e-9190-417d-83fc-7ad06370c838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:34.409532 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6a26e-9190-417d-83fc-7ad06370c838 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:34.410880 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6a26e-9190-417d-83fc-7ad06370c838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:34.412707 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6a26e-9190-417d-83fc-7ad06370c838 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:34.428224 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1272/2524] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:23:34.439889 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11eda9f-a049-468d-891c-4c5135505704 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:34.456459 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11eda9f-a049-468d-891c-4c5135505704 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:34.467630 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb32c4-46fa-45bb-944e-a02b6362a71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:34.471775 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb32c4-46fa-45bb-944e-a02b6362a71d admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:34.472204 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb32c4-46fa-45bb-944e-a02b6362a71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:34.472574 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb32c4-46fa-45bb-944e-a02b6362a71d admin admin] PATH_INFO: `/v3/projects/1c3d6b94b49c44a3912a1aa6e5e09d18/users/496cefae08884bc6812d7e5db4d44e78/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:34.502738 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb32c4-46fa-45bb-944e-a02b6362a71d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c3d6b94b49c44a3912a1aa6e5e09d18, user_id=496cefae08884bc6812d7e5db4d44e78, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:34.505672 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb32c4-46fa-45bb-944e-a02b6362a71d admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:34.531028 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1253/2525] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:23:34 2022] PUT /identity/v3/projects/1c3d6b94b49c44a3912a1aa6e5e09d18/users/496cefae08884bc6812d7e5db4d44e78/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:34.532327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6a26e-9190-417d-83fc-7ad06370c838 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:34.538613 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:34.546350 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6a26e-9190-417d-83fc-7ad06370c838 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:34.627691 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c63b6-176f-40b6-a46f-21d0cf64e5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:34.628300 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c63b6-176f-40b6-a46f-21d0cf64e5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:34.628638 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c63b6-176f-40b6-a46f-21d0cf64e5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:34.628929 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c63b6-176f-40b6-a46f-21d0cf64e5d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:34.629666 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c63b6-176f-40b6-a46f-21d0cf64e5d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:34.631317 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c63b6-176f-40b6-a46f-21d0cf64e5d7 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:34.646161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1273/2526] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:23:34.650033 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb32c4-46fa-45bb-944e-a02b6362a71d admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:34.661105 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb32c4-46fa-45bb-944e-a02b6362a71d admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:34.666369 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb20c9-c99a-4472-964d-5e4e65f36a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:34.667275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb20c9-c99a-4472-964d-5e4e65f36a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:34.667569 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb20c9-c99a-4472-964d-5e4e65f36a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:34.667843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb20c9-c99a-4472-964d-5e4e65f36a80 admin admin] PATH_INFO: `/v3/projects/1c3d6b94b49c44a3912a1aa6e5e09d18/users/496cefae08884bc6812d7e5db4d44e78/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:34.670476 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb20c9-c99a-4472-964d-5e4e65f36a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c3d6b94b49c44a3912a1aa6e5e09d18, user_id=496cefae08884bc6812d7e5db4d44e78, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:34.673830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb20c9-c99a-4472-964d-5e4e65f36a80 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:34.688784 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1254/2527] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:23:34 2022] PUT /identity/v3/projects/1c3d6b94b49c44a3912a1aa6e5e09d18/users/496cefae08884bc6812d7e5db4d44e78/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:34.699723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba981ec5-8d34-4d53-a3b5-f79ff02a0b1e None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:34.700037 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba981ec5-8d34-4d53-a3b5-f79ff02a0b1e None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:34.700305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba981ec5-8d34-4d53-a3b5-f79ff02a0b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:34.732834 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-ba981ec5-8d34-4d53-a3b5-f79ff02a0b1e None None] MFA Rules not processed for user `496cefae08884bc6812d7e5db4d44e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:34.734096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-ba981ec5-8d34-4d53-a3b5-f79ff02a0b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:34.830939 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1274/2528] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:34.843549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb20c9-c99a-4472-964d-5e4e65f36a80 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:34.845541 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-9abb20c9-c99a-4472-964d-5e4e65f36a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:34.921638 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb20c9-c99a-4472-964d-5e4e65f36a80 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:34.925602 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059f85f-86ab-405a-9e61-e276d8a9ac87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:34.926448 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059f85f-86ab-405a-9e61-e276d8a9ac87 service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:34.926788 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059f85f-86ab-405a-9e61-e276d8a9ac87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:34.929596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059f85f-86ab-405a-9e61-e276d8a9ac87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:34.939972 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:34.942907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059f85f-86ab-405a-9e61-e276d8a9ac87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:34.944686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059f85f-86ab-405a-9e61-e276d8a9ac87 service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:34.961008 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1255/2529] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:23:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:23:35.035210 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba981ec5-8d34-4d53-a3b5-f79ff02a0b1e None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:35.118879 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba981ec5-8d34-4d53-a3b5-f79ff02a0b1e None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:35.123970 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00949c-a71f-4dc7-ab1d-d0fc296af650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:35.124941 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00949c-a71f-4dc7-ab1d-d0fc296af650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:35.125307 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00949c-a71f-4dc7-ab1d-d0fc296af650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:35.125647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00949c-a71f-4dc7-ab1d-d0fc296af650 admin admin] PATH_INFO: `/v3/users/9f109365e75445f7b155b65adeb6adc2` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:35.127008 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00949c-a71f-4dc7-ab1d-d0fc296af650 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f109365e75445f7b155b65adeb6adc2)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:35.129419 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00949c-a71f-4dc7-ab1d-d0fc296af650 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:35.162159 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:35.190475 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-0c00949c-a71f-4dc7-ab1d-d0fc296af650 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f109365e75445f7b155b65adeb6adc2'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:35.200227 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-0c00949c-a71f-4dc7-ab1d-d0fc296af650 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f109365e75445f7b155b65adeb6adc2'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:35.214237 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-0c00949c-a71f-4dc7-ab1d-d0fc296af650 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f109365e75445f7b155b65adeb6adc2'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:35.215078 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-0c00949c-a71f-4dc7-ab1d-d0fc296af650 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f109365e75445f7b155b65adeb6adc2'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:35.231359 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-0c00949c-a71f-4dc7-ab1d-d0fc296af650 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f109365e75445f7b155b65adeb6adc2'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:35.245782 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1275/2530] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:23:35 2022] DELETE /identity/v3/users/9f109365e75445f7b155b65adeb6adc2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:35.251239 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b023f87-d3e6-48ef-ad69-0a8fc883efe5 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:35.251607 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b023f87-d3e6-48ef-ad69-0a8fc883efe5 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:35.251954 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b023f87-d3e6-48ef-ad69-0a8fc883efe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:35.273635 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-9b023f87-d3e6-48ef-ad69-0a8fc883efe5 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:35.274988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-9b023f87-d3e6-48ef-ad69-0a8fc883efe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:35.351144 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1256/2531] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:35.358148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00949c-a71f-4dc7-ab1d-d0fc296af650 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:35.359920 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-0c00949c-a71f-4dc7-ab1d-d0fc296af650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:35.429715 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00949c-a71f-4dc7-ab1d-d0fc296af650 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:35.434547 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8e336-ef06-4bf6-82dc-97a9ae8c4c4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:35.435210 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8e336-ef06-4bf6-82dc-97a9ae8c4c4b service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:35.435503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8e336-ef06-4bf6-82dc-97a9ae8c4c4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:35.435785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8e336-ef06-4bf6-82dc-97a9ae8c4c4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:35.456864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8e336-ef06-4bf6-82dc-97a9ae8c4c4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:35.458372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8e336-ef06-4bf6-82dc-97a9ae8c4c4b service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:35.471219 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1276/2532] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:23:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:23:35.909647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b023f87-d3e6-48ef-ad69-0a8fc883efe5 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:35.911556 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-9b023f87-d3e6-48ef-ad69-0a8fc883efe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:35.941285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b023f87-d3e6-48ef-ad69-0a8fc883efe5 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:35.948522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0cb33-2e17-45f0-ad45-ed9b4f44dd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:35.949716 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0cb33-2e17-45f0-ad45-ed9b4f44dd28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:35.950769 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0cb33-2e17-45f0-ad45-ed9b4f44dd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:35.951160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0cb33-2e17-45f0-ad45-ed9b4f44dd28 admin admin] PATH_INFO: `/v3/projects/26fe0ded1a344e439e1bc97daf058ad6` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:35.952756 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0cb33-2e17-45f0-ad45-ed9b4f44dd28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26fe0ded1a344e439e1bc97daf058ad6)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:35.955100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0cb33-2e17-45f0-ad45-ed9b4f44dd28 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:36.034812 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-51e0cb33-2e17-45f0-ad45-ed9b4f44dd28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26fe0ded1a344e439e1bc97daf058ad6', 'request_id': 'req-51e0cb33-2e17-45f0-ad45-ed9b4f44dd28'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:36.050579 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-51e0cb33-2e17-45f0-ad45-ed9b4f44dd28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26fe0ded1a344e439e1bc97daf058ad6', 'request_id': 'req-51e0cb33-2e17-45f0-ad45-ed9b4f44dd28'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:36.074985 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-51e0cb33-2e17-45f0-ad45-ed9b4f44dd28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26fe0ded1a344e439e1bc97daf058ad6', 'request_id': 'req-51e0cb33-2e17-45f0-ad45-ed9b4f44dd28'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:36.093026 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-51e0cb33-2e17-45f0-ad45-ed9b4f44dd28 admin admin] The token cache is being invalidate because project 26fe0ded1a344e439e1bc97daf058ad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:23:36.093362 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-51e0cb33-2e17-45f0-ad45-ed9b4f44dd28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:36.094151 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-51e0cb33-2e17-45f0-ad45-ed9b4f44dd28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:36.099178 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1257/2533] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:23:35 2022] DELETE /identity/v3/projects/26fe0ded1a344e439e1bc97daf058ad6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:36.102705 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8e336-ef06-4bf6-82dc-97a9ae8c4c4b service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:36.118731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8e336-ef06-4bf6-82dc-97a9ae8c4c4b service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:36.219865 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0b989-aead-4afe-958c-c8b7a281e4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:36.221748 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0b989-aead-4afe-958c-c8b7a281e4c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:36.222231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0b989-aead-4afe-958c-c8b7a281e4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:36.222526 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0b989-aead-4afe-958c-c8b7a281e4c4 admin admin] PATH_INFO: `/v3/users/496cefae08884bc6812d7e5db4d44e78` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:36.223860 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0b989-aead-4afe-958c-c8b7a281e4c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=496cefae08884bc6812d7e5db4d44e78)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:36.225896 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0b989-aead-4afe-958c-c8b7a281e4c4 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:36.304103 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-57f0b989-aead-4afe-958c-c8b7a281e4c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '496cefae08884bc6812d7e5db4d44e78'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:36.306364 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:36.319324 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-57f0b989-aead-4afe-958c-c8b7a281e4c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '496cefae08884bc6812d7e5db4d44e78'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:36.328855 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-57f0b989-aead-4afe-958c-c8b7a281e4c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '496cefae08884bc6812d7e5db4d44e78'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:36.329859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-57f0b989-aead-4afe-958c-c8b7a281e4c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '496cefae08884bc6812d7e5db4d44e78'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:36.355992 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-57f0b989-aead-4afe-958c-c8b7a281e4c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '496cefae08884bc6812d7e5db4d44e78'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:36.380566 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1277/2534] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:23:36 2022] DELETE /identity/v3/users/496cefae08884bc6812d7e5db4d44e78 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:36.798840 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0cb33-2e17-45f0-ad45-ed9b4f44dd28 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:36.800448 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-51e0cb33-2e17-45f0-ad45-ed9b4f44dd28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:36.834293 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0cb33-2e17-45f0-ad45-ed9b4f44dd28 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:36.945360 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486b752-110e-454b-a44e-d846e85d30fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:36.946271 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486b752-110e-454b-a44e-d846e85d30fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:36.946555 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486b752-110e-454b-a44e-d846e85d30fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:36.946830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486b752-110e-454b-a44e-d846e85d30fc admin admin] PATH_INFO: `/v3/projects/1c3d6b94b49c44a3912a1aa6e5e09d18` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:36.948016 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486b752-110e-454b-a44e-d846e85d30fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c3d6b94b49c44a3912a1aa6e5e09d18)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:36.950274 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486b752-110e-454b-a44e-d846e85d30fc admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:36.983546 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:37.019248 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-8486b752-110e-454b-a44e-d846e85d30fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c3d6b94b49c44a3912a1aa6e5e09d18', 'request_id': 'req-8486b752-110e-454b-a44e-d846e85d30fc'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:37.027538 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-8486b752-110e-454b-a44e-d846e85d30fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c3d6b94b49c44a3912a1aa6e5e09d18', 'request_id': 'req-8486b752-110e-454b-a44e-d846e85d30fc'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:37.042796 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-8486b752-110e-454b-a44e-d846e85d30fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c3d6b94b49c44a3912a1aa6e5e09d18', 'request_id': 'req-8486b752-110e-454b-a44e-d846e85d30fc'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:37.059886 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-8486b752-110e-454b-a44e-d846e85d30fc admin admin] The token cache is being invalidate because project 1c3d6b94b49c44a3912a1aa6e5e09d18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:23:37.060229 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-8486b752-110e-454b-a44e-d846e85d30fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:37.061207 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-8486b752-110e-454b-a44e-d846e85d30fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:37.070672 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21885185-b032-43d4-9bd0-fe4f4100c852 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:37.072560 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21885185-b032-43d4-9bd0-fe4f4100c852 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:37.073009 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21885185-b032-43d4-9bd0-fe4f4100c852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:37.074242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1258/2535] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:23:36 2022] DELETE /identity/v3/projects/1c3d6b94b49c44a3912a1aa6e5e09d18 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:23:37.103765 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-21885185-b032-43d4-9bd0-fe4f4100c852 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:37.107373 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-21885185-b032-43d4-9bd0-fe4f4100c852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:37.186781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1278/2536] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:37.195488 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc22e50-27d0-4eb2-8e9f-3dc466f4b64a None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:37.196289 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc22e50-27d0-4eb2-8e9f-3dc466f4b64a None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:37.196642 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc22e50-27d0-4eb2-8e9f-3dc466f4b64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:37.217862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-3bc22e50-27d0-4eb2-8e9f-3dc466f4b64a None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:37.218256 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-3bc22e50-27d0-4eb2-8e9f-3dc466f4b64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:37.227733 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1259/2537] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:37.231970 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21885185-b032-43d4-9bd0-fe4f4100c852 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:37.242647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21885185-b032-43d4-9bd0-fe4f4100c852 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:37.247699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bce39-2d95-4016-a31b-6d6775867b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:37.248491 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bce39-2d95-4016-a31b-6d6775867b08 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:37.249116 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bce39-2d95-4016-a31b-6d6775867b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:37.249508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bce39-2d95-4016-a31b-6d6775867b08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:37.250378 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bce39-2d95-4016-a31b-6d6775867b08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:23:37.250792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bce39-2d95-4016-a31b-6d6775867b08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:37.252514 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bce39-2d95-4016-a31b-6d6775867b08 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:37.270234 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1279/2538] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:23:37.275602 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc22e50-27d0-4eb2-8e9f-3dc466f4b64a None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:37.286483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc22e50-27d0-4eb2-8e9f-3dc466f4b64a None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:37.292018 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc90e58-681d-46b2-9acd-ba776c307b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:37.292708 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc90e58-681d-46b2-9acd-ba776c307b7a admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:37.293051 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc90e58-681d-46b2-9acd-ba776c307b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:37.293280 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc90e58-681d-46b2-9acd-ba776c307b7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:37.293988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc90e58-681d-46b2-9acd-ba776c307b7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:37.295992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc90e58-681d-46b2-9acd-ba776c307b7a admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:37.328282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1260/2539] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:23:37 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:23:37.331504 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bce39-2d95-4016-a31b-6d6775867b08 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:37.344025 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bce39-2d95-4016-a31b-6d6775867b08 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:37.417532 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54555ea6-2c38-4630-b76b-3e13e7dabdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:37.418265 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54555ea6-2c38-4630-b76b-3e13e7dabdf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:37.418562 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54555ea6-2c38-4630-b76b-3e13e7dabdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:37.418844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54555ea6-2c38-4630-b76b-3e13e7dabdf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:37.419551 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54555ea6-2c38-4630-b76b-3e13e7dabdf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:37.421548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54555ea6-2c38-4630-b76b-3e13e7dabdf4 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:37.443247 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1280/2540] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:23:37 2022] POST /identity/v3/users => generated 286 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:23:37.450622 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc90e58-681d-46b2-9acd-ba776c307b7a admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:37.465702 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc90e58-681d-46b2-9acd-ba776c307b7a admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:37.471116 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c6ced-6437-43a6-a132-b071275f2a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:37.471852 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c6ced-6437-43a6-a132-b071275f2a7e admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:37.472172 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c6ced-6437-43a6-a132-b071275f2a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:37.472564 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c6ced-6437-43a6-a132-b071275f2a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:37.473353 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c6ced-6437-43a6-a132-b071275f2a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:37.475055 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c6ced-6437-43a6-a132-b071275f2a7e admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:37.486604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1261/2541] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:23:37.491120 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54555ea6-2c38-4630-b76b-3e13e7dabdf4 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:37.501814 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54555ea6-2c38-4630-b76b-3e13e7dabdf4 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:37.507462 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e72cd-44f8-41f5-9379-5ff6e0bf0214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:37.508210 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e72cd-44f8-41f5-9379-5ff6e0bf0214 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:37.508555 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e72cd-44f8-41f5-9379-5ff6e0bf0214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:37.508895 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e72cd-44f8-41f5-9379-5ff6e0bf0214 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:37.509686 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e72cd-44f8-41f5-9379-5ff6e0bf0214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:37.511396 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e72cd-44f8-41f5-9379-5ff6e0bf0214 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:37.525622 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1281/2542] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:23:37.528374 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c6ced-6437-43a6-a132-b071275f2a7e admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:37.552965 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c6ced-6437-43a6-a132-b071275f2a7e admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:37.559832 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb65db-5254-4fdd-ab64-98c28b983d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:37.561538 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb65db-5254-4fdd-ab64-98c28b983d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:37.561538 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb65db-5254-4fdd-ab64-98c28b983d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:37.561538 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb65db-5254-4fdd-ab64-98c28b983d9d admin admin] PATH_INFO: `/v3/projects/8bd573b761e44f6687675ed879df5b65/users/e4bf4aabc8df4ac091dbf1f41df8d3a8/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:37.586487 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb65db-5254-4fdd-ab64-98c28b983d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd573b761e44f6687675ed879df5b65, user_id=e4bf4aabc8df4ac091dbf1f41df8d3a8, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:37.589161 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb65db-5254-4fdd-ab64-98c28b983d9d admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:37.606326 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1262/2543] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:23:37 2022] PUT /identity/v3/projects/8bd573b761e44f6687675ed879df5b65/users/e4bf4aabc8df4ac091dbf1f41df8d3a8/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:37.611526 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef31d8-e64e-4957-9166-187f239ff2f5 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:37.611821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef31d8-e64e-4957-9166-187f239ff2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:37.612125 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef31d8-e64e-4957-9166-187f239ff2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:37.632860 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-9eef31d8-e64e-4957-9166-187f239ff2f5 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:37.634077 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-9eef31d8-e64e-4957-9166-187f239ff2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:37.664289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:37.707439 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1282/2544] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:37.719341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb65db-5254-4fdd-ab64-98c28b983d9d admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:37.721201 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-25bb65db-5254-4fdd-ab64-98c28b983d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:37.791904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb65db-5254-4fdd-ab64-98c28b983d9d admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:37.795867 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef22094-f377-48a1-9e09-a740a9930686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:37.796519 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef22094-f377-48a1-9e09-a740a9930686 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:37.796800 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef22094-f377-48a1-9e09-a740a9930686 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:37.797079 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef22094-f377-48a1-9e09-a740a9930686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:37.807147 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef22094-f377-48a1-9e09-a740a9930686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:37.809287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef22094-f377-48a1-9e09-a740a9930686 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:37.820580 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1263/2545] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:23:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:23:38.633203 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4584b8b-c4e3-4c60-9cc7-1c3565a62021 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:38.633764 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4584b8b-c4e3-4c60-9cc7-1c3565a62021 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:38.633853 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4584b8b-c4e3-4c60-9cc7-1c3565a62021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:38.660533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-c4584b8b-c4e3-4c60-9cc7-1c3565a62021 None None] MFA Rules not processed for user `e4bf4aabc8df4ac091dbf1f41df8d3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:38.661781 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-c4584b8b-c4e3-4c60-9cc7-1c3565a62021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:38.738531 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1283/2546] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:38.739761 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef22094-f377-48a1-9e09-a740a9930686 service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:38.749933 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef22094-f377-48a1-9e09-a740a9930686 service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:38.754627 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57855f06-e598-48f7-936c-75e604633445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:38.755323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57855f06-e598-48f7-936c-75e604633445 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:38.755613 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57855f06-e598-48f7-936c-75e604633445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:38.755890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57855f06-e598-48f7-936c-75e604633445 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:38.756837 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57855f06-e598-48f7-936c-75e604633445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:38.758951 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57855f06-e598-48f7-936c-75e604633445 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:38.786180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1264/2547] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:23:38 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:23:38.790052 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4584b8b-c4e3-4c60-9cc7-1c3565a62021 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:38.802890 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4584b8b-c4e3-4c60-9cc7-1c3565a62021 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:38.861617 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13205c1-b0ce-47a4-83f7-ea0985bb9bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:38.862249 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13205c1-b0ce-47a4-83f7-ea0985bb9bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:38.862540 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13205c1-b0ce-47a4-83f7-ea0985bb9bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:38.862840 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13205c1-b0ce-47a4-83f7-ea0985bb9bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:38.863567 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13205c1-b0ce-47a4-83f7-ea0985bb9bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:38.865494 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13205c1-b0ce-47a4-83f7-ea0985bb9bc7 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:38.886406 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1284/2548] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:23:38 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:23:38.890413 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57855f06-e598-48f7-936c-75e604633445 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:38.901385 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57855f06-e598-48f7-936c-75e604633445 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:38.905933 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7222876-a3cc-4b7d-a3a5-7f1e305f5f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:38.906634 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7222876-a3cc-4b7d-a3a5-7f1e305f5f60 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:38.906923 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7222876-a3cc-4b7d-a3a5-7f1e305f5f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:38.907205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7222876-a3cc-4b7d-a3a5-7f1e305f5f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:38.907962 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7222876-a3cc-4b7d-a3a5-7f1e305f5f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:38.909549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7222876-a3cc-4b7d-a3a5-7f1e305f5f60 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:38.923375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1265/2549] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:23:38.924733 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13205c1-b0ce-47a4-83f7-ea0985bb9bc7 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:38.935018 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13205c1-b0ce-47a4-83f7-ea0985bb9bc7 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:38.939641 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1648b1-2e1c-495c-bbf7-9afb4193f87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:38.940529 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1648b1-2e1c-495c-bbf7-9afb4193f87b admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:38.940816 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1648b1-2e1c-495c-bbf7-9afb4193f87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:38.941095 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1648b1-2e1c-495c-bbf7-9afb4193f87b admin admin] PATH_INFO: `/v3/projects/3001be2de1a342a9ae3c875fbc611c75/users/fcf80b58a66641ceb5400dfa026f371f/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:38.956127 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1648b1-2e1c-495c-bbf7-9afb4193f87b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3001be2de1a342a9ae3c875fbc611c75, user_id=fcf80b58a66641ceb5400dfa026f371f, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:38.958844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1648b1-2e1c-495c-bbf7-9afb4193f87b admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:38.974809 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1285/2550] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:23:38 2022] PUT /identity/v3/projects/3001be2de1a342a9ae3c875fbc611c75/users/fcf80b58a66641ceb5400dfa026f371f/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:38.976066 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7222876-a3cc-4b7d-a3a5-7f1e305f5f60 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:38.986394 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7222876-a3cc-4b7d-a3a5-7f1e305f5f60 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:38.998092 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:39.048311 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd4675-03c7-4d32-970d-89333c9f44a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:39.048985 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd4675-03c7-4d32-970d-89333c9f44a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:39.049273 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd4675-03c7-4d32-970d-89333c9f44a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:39.049550 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd4675-03c7-4d32-970d-89333c9f44a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:39.050297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd4675-03c7-4d32-970d-89333c9f44a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:39.051896 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd4675-03c7-4d32-970d-89333c9f44a2 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:39.061546 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1266/2551] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:23:39.065677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1648b1-2e1c-495c-bbf7-9afb4193f87b admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:39.076328 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1648b1-2e1c-495c-bbf7-9afb4193f87b admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:39.080877 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7f50b-e6fe-4e53-9a7e-210a37480630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:39.081767 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7f50b-e6fe-4e53-9a7e-210a37480630 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:39.082055 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7f50b-e6fe-4e53-9a7e-210a37480630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:39.082364 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7f50b-e6fe-4e53-9a7e-210a37480630 admin admin] PATH_INFO: `/v3/projects/3001be2de1a342a9ae3c875fbc611c75/users/fcf80b58a66641ceb5400dfa026f371f/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:39.084351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7f50b-e6fe-4e53-9a7e-210a37480630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3001be2de1a342a9ae3c875fbc611c75, user_id=fcf80b58a66641ceb5400dfa026f371f, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:39.087653 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7f50b-e6fe-4e53-9a7e-210a37480630 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:39.098100 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1286/2552] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:23:39 2022] PUT /identity/v3/projects/3001be2de1a342a9ae3c875fbc611c75/users/fcf80b58a66641ceb5400dfa026f371f/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:39.575207 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd4675-03c7-4d32-970d-89333c9f44a2 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:39.577300 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-40dd4675-03c7-4d32-970d-89333c9f44a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:39.591902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd4675-03c7-4d32-970d-89333c9f44a2 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:39.651795 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bfddd-0eeb-49f8-9076-4541a4052279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:39.652712 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bfddd-0eeb-49f8-9076-4541a4052279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:39.652999 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bfddd-0eeb-49f8-9076-4541a4052279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:39.653277 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bfddd-0eeb-49f8-9076-4541a4052279 admin admin] PATH_INFO: `/v3/users/38a66ac0363544068a2d7fe15496f4bd` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:39.654654 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244bfddd-0eeb-49f8-9076-4541a4052279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a66ac0363544068a2d7fe15496f4bd)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:39.656742 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244bfddd-0eeb-49f8-9076-4541a4052279 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:39.727880 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-244bfddd-0eeb-49f8-9076-4541a4052279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a66ac0363544068a2d7fe15496f4bd'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:39.728872 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-244bfddd-0eeb-49f8-9076-4541a4052279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a66ac0363544068a2d7fe15496f4bd'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:39.740117 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-244bfddd-0eeb-49f8-9076-4541a4052279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a66ac0363544068a2d7fe15496f4bd'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:39.754057 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-244bfddd-0eeb-49f8-9076-4541a4052279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a66ac0363544068a2d7fe15496f4bd'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:39.771624 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-244bfddd-0eeb-49f8-9076-4541a4052279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a66ac0363544068a2d7fe15496f4bd'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:39.779331 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1267/2553] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:23:39 2022] DELETE /identity/v3/users/38a66ac0363544068a2d7fe15496f4bd => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:39.784917 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80138018-1376-4e7d-a653-ef52aa77c68e None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:39.785435 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80138018-1376-4e7d-a653-ef52aa77c68e None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:39.785800 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80138018-1376-4e7d-a653-ef52aa77c68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:39.816642 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-80138018-1376-4e7d-a653-ef52aa77c68e None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:39.819731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-80138018-1376-4e7d-a653-ef52aa77c68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:39.847018 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:39.849324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69c738-94e8-4678-ad10-95a1fd72f122 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:39.849483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69c738-94e8-4678-ad10-95a1fd72f122 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:39.849734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69c738-94e8-4678-ad10-95a1fd72f122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:39.879905 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-bf69c738-94e8-4678-ad10-95a1fd72f122 None None] MFA Rules not processed for user `fcf80b58a66641ceb5400dfa026f371f`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:39.881135 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-bf69c738-94e8-4678-ad10-95a1fd72f122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:39.901983 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:39.915574 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1287/2554] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:39.923559 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80138018-1376-4e7d-a653-ef52aa77c68e None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:39.925255 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-80138018-1376-4e7d-a653-ef52aa77c68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:39.964517 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1268/2555] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:39 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:23:39.976563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035e676-ad46-432f-9358-2f99c79e4493 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:39.976849 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035e676-ad46-432f-9358-2f99c79e4493 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:39.977133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035e676-ad46-432f-9358-2f99c79e4493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:40.002319 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-9035e676-ad46-432f-9358-2f99c79e4493 None None] MFA Rules not processed for user `e4bf4aabc8df4ac091dbf1f41df8d3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:40.003603 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80138018-1376-4e7d-a653-ef52aa77c68e None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:40.003783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-9035e676-ad46-432f-9358-2f99c79e4493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:40.008150 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9d381-3e41-4836-a3d9-6d18d496e24c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:40.009014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9d381-3e41-4836-a3d9-6d18d496e24c service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:40.009373 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9d381-3e41-4836-a3d9-6d18d496e24c service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:40.009864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9d381-3e41-4836-a3d9-6d18d496e24c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:40.027771 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9d381-3e41-4836-a3d9-6d18d496e24c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:40.029503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9d381-3e41-4836-a3d9-6d18d496e24c service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:40.047985 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1288/2556] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:23:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:23:40.126589 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1269/2557] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:23:40.138349 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9d381-3e41-4836-a3d9-6d18d496e24c service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:40.139808 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-34f9d381-3e41-4836-a3d9-6d18d496e24c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:40.244802 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9d381-3e41-4836-a3d9-6d18d496e24c service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:40.252660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fb6f1-5a50-45b3-bed4-dac2e05f44ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:40.253824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fb6f1-5a50-45b3-bed4-dac2e05f44ca service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:40.254367 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fb6f1-5a50-45b3-bed4-dac2e05f44ca service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:40.254874 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fb6f1-5a50-45b3-bed4-dac2e05f44ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:40.259016 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-0c0fb6f1-5a50-45b3-bed4-dac2e05f44ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:40.275272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0fb6f1-5a50-45b3-bed4-dac2e05f44ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:40.277174 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0fb6f1-5a50-45b3-bed4-dac2e05f44ca service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:40.288532 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1289/2558] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:23:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:23:40.371012 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035e676-ad46-432f-9358-2f99c79e4493 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:40.372605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-9035e676-ad46-432f-9358-2f99c79e4493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:40.386168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035e676-ad46-432f-9358-2f99c79e4493 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:40.390735 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a94b5f-ecf6-4f6c-ba88-55036dfaf94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:40.391616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a94b5f-ecf6-4f6c-ba88-55036dfaf94b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:40.391900 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a94b5f-ecf6-4f6c-ba88-55036dfaf94b admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:40.392178 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a94b5f-ecf6-4f6c-ba88-55036dfaf94b admin admin] PATH_INFO: `/v3/projects/9bdde5222d2349d3bc47ee7e1c83a7be` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:40.393352 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a94b5f-ecf6-4f6c-ba88-55036dfaf94b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bdde5222d2349d3bc47ee7e1c83a7be)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:40.395501 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a94b5f-ecf6-4f6c-ba88-55036dfaf94b admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:40.448600 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-39a94b5f-ecf6-4f6c-ba88-55036dfaf94b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bdde5222d2349d3bc47ee7e1c83a7be', 'request_id': 'req-39a94b5f-ecf6-4f6c-ba88-55036dfaf94b'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:40.455037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-39a94b5f-ecf6-4f6c-ba88-55036dfaf94b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bdde5222d2349d3bc47ee7e1c83a7be', 'request_id': 'req-39a94b5f-ecf6-4f6c-ba88-55036dfaf94b'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:40.464043 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-39a94b5f-ecf6-4f6c-ba88-55036dfaf94b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bdde5222d2349d3bc47ee7e1c83a7be', 'request_id': 'req-39a94b5f-ecf6-4f6c-ba88-55036dfaf94b'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:40.474802 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-39a94b5f-ecf6-4f6c-ba88-55036dfaf94b admin admin] The token cache is being invalidate because project 9bdde5222d2349d3bc47ee7e1c83a7be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:23:40.475098 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-39a94b5f-ecf6-4f6c-ba88-55036dfaf94b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:40.475791 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-39a94b5f-ecf6-4f6c-ba88-55036dfaf94b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:40.477563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1270/2559] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:23:40 2022] DELETE /identity/v3/projects/9bdde5222d2349d3bc47ee7e1c83a7be => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:40.481284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fb6f1-5a50-45b3-bed4-dac2e05f44ca service nova] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:40.492256 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fb6f1-5a50-45b3-bed4-dac2e05f44ca service nova] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:40.536714 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:40.549180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a94b5f-ecf6-4f6c-ba88-55036dfaf94b admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:40.551645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-39a94b5f-ecf6-4f6c-ba88-55036dfaf94b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:40.564572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18314515-dc60-4f1b-b86e-dcb418342317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:40.565570 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18314515-dc60-4f1b-b86e-dcb418342317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:40.565973 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18314515-dc60-4f1b-b86e-dcb418342317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:40.566401 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18314515-dc60-4f1b-b86e-dcb418342317 admin admin] PATH_INFO: `/v3/users/f938872f9b924e12b7e90ae8bcdd11d7` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:40.568053 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18314515-dc60-4f1b-b86e-dcb418342317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f938872f9b924e12b7e90ae8bcdd11d7)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:40.570751 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18314515-dc60-4f1b-b86e-dcb418342317 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:40.605686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:40.621357 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a94b5f-ecf6-4f6c-ba88-55036dfaf94b admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:40.623279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-18314515-dc60-4f1b-b86e-dcb418342317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f938872f9b924e12b7e90ae8bcdd11d7'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:40.626282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342160a5-c8ab-4660-a1ff-b8eff3d37162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:40.627316 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342160a5-c8ab-4660-a1ff-b8eff3d37162 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:40.627607 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342160a5-c8ab-4660-a1ff-b8eff3d37162 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:40.627911 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342160a5-c8ab-4660-a1ff-b8eff3d37162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:40.629955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-342160a5-c8ab-4660-a1ff-b8eff3d37162 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:40.632396 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-18314515-dc60-4f1b-b86e-dcb418342317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f938872f9b924e12b7e90ae8bcdd11d7'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:40.639859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-18314515-dc60-4f1b-b86e-dcb418342317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f938872f9b924e12b7e90ae8bcdd11d7'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:40.640548 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-18314515-dc60-4f1b-b86e-dcb418342317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f938872f9b924e12b7e90ae8bcdd11d7'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:40.641129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342160a5-c8ab-4660-a1ff-b8eff3d37162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:40.642606 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342160a5-c8ab-4660-a1ff-b8eff3d37162 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:40.651712 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1271/2560] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:23:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:23:40.653133 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-18314515-dc60-4f1b-b86e-dcb418342317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f938872f9b924e12b7e90ae8bcdd11d7'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:40.659220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1290/2561] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:23:40 2022] DELETE /identity/v3/users/f938872f9b924e12b7e90ae8bcdd11d7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:23:40.955355 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342160a5-c8ab-4660-a1ff-b8eff3d37162 service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:40.956867 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-342160a5-c8ab-4660-a1ff-b8eff3d37162 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:41.006898 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342160a5-c8ab-4660-a1ff-b8eff3d37162 service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:41.084460 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b08649-41b1-400d-8834-90958cb63f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:41.085983 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b08649-41b1-400d-8834-90958cb63f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:41.086303 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b08649-41b1-400d-8834-90958cb63f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:41.086700 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b08649-41b1-400d-8834-90958cb63f52 admin admin] PATH_INFO: `/v3/projects/2819e570e08f4e3fb513155afd08761e` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:41.088193 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b08649-41b1-400d-8834-90958cb63f52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2819e570e08f4e3fb513155afd08761e)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:41.090412 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b08649-41b1-400d-8834-90958cb63f52 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:41.140957 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d2b08649-41b1-400d-8834-90958cb63f52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2819e570e08f4e3fb513155afd08761e', 'request_id': 'req-d2b08649-41b1-400d-8834-90958cb63f52'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:41.147733 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d2b08649-41b1-400d-8834-90958cb63f52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2819e570e08f4e3fb513155afd08761e', 'request_id': 'req-d2b08649-41b1-400d-8834-90958cb63f52'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:41.157123 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d2b08649-41b1-400d-8834-90958cb63f52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2819e570e08f4e3fb513155afd08761e', 'request_id': 'req-d2b08649-41b1-400d-8834-90958cb63f52'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:41.169674 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d2b08649-41b1-400d-8834-90958cb63f52 admin admin] The token cache is being invalidate because project 2819e570e08f4e3fb513155afd08761e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:23:41.169970 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d2b08649-41b1-400d-8834-90958cb63f52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:41.170665 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d2b08649-41b1-400d-8834-90958cb63f52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:41.172216 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1272/2562] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:23:40 2022] DELETE /identity/v3/projects/2819e570e08f4e3fb513155afd08761e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:41.177838 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5863d3b-7a0c-401d-bb03-1062d2a85ebd None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:41.178428 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5863d3b-7a0c-401d-bb03-1062d2a85ebd None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:41.178641 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5863d3b-7a0c-401d-bb03-1062d2a85ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:41.199624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-d5863d3b-7a0c-401d-bb03-1062d2a85ebd None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:41.200751 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-d5863d3b-7a0c-401d-bb03-1062d2a85ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:41.266908 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1291/2563] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:41.275462 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c6e81-bfdf-49c6-b71a-b9f5091f4be4 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:41.275832 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c6e81-bfdf-49c6-b71a-b9f5091f4be4 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:41.276206 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c6e81-bfdf-49c6-b71a-b9f5091f4be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:41.295131 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-8f3c6e81-bfdf-49c6-b71a-b9f5091f4be4 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:41.296526 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-8f3c6e81-bfdf-49c6-b71a-b9f5091f4be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:41.305575 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1273/2564] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:41.309966 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5863d3b-7a0c-401d-bb03-1062d2a85ebd None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:41.321493 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5863d3b-7a0c-401d-bb03-1062d2a85ebd None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:41.327495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d529d-57f8-4d9e-b266-8bb50944129b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:41.328179 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d529d-57f8-4d9e-b266-8bb50944129b admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:41.328469 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d529d-57f8-4d9e-b266-8bb50944129b admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:41.328745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d529d-57f8-4d9e-b266-8bb50944129b admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:41.329483 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d529d-57f8-4d9e-b266-8bb50944129b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:23:41.329793 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d529d-57f8-4d9e-b266-8bb50944129b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:41.332028 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d529d-57f8-4d9e-b266-8bb50944129b admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:41.347041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1292/2565] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:23:41.351638 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c6e81-bfdf-49c6-b71a-b9f5091f4be4 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:41.362030 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c6e81-bfdf-49c6-b71a-b9f5091f4be4 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:41.367412 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f912b-2de6-47c3-bc37-91fe57d0721c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:41.368092 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f912b-2de6-47c3-bc37-91fe57d0721c admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:41.368380 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f912b-2de6-47c3-bc37-91fe57d0721c admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:41.368661 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f912b-2de6-47c3-bc37-91fe57d0721c admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:41.369353 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f912b-2de6-47c3-bc37-91fe57d0721c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:41.371305 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f912b-2de6-47c3-bc37-91fe57d0721c admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:41.399177 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1274/2566] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:23:41 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:23:41.403375 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d529d-57f8-4d9e-b266-8bb50944129b admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:41.413475 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d529d-57f8-4d9e-b266-8bb50944129b admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:41.458225 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:41.471663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0ac70-465d-4e41-ba01-e1508abb5fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:41.472349 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0ac70-465d-4e41-ba01-e1508abb5fbf admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:41.472640 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0ac70-465d-4e41-ba01-e1508abb5fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:41.472926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0ac70-465d-4e41-ba01-e1508abb5fbf admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:41.473666 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0ac70-465d-4e41-ba01-e1508abb5fbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:41.475661 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0ac70-465d-4e41-ba01-e1508abb5fbf admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:41.495753 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1293/2567] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:23:41 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:23:41.501173 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f912b-2de6-47c3-bc37-91fe57d0721c admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:41.515661 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f912b-2de6-47c3-bc37-91fe57d0721c admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:41.521387 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b7338-a4f1-4525-a6b7-6456cd9baffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:41.522064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b7338-a4f1-4525-a6b7-6456cd9baffe admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:41.522385 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b7338-a4f1-4525-a6b7-6456cd9baffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:41.522666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b7338-a4f1-4525-a6b7-6456cd9baffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:41.523792 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b7338-a4f1-4525-a6b7-6456cd9baffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:41.525963 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b7338-a4f1-4525-a6b7-6456cd9baffe admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:41.542273 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1275/2568] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:23:41.543520 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0ac70-465d-4e41-ba01-e1508abb5fbf admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:41.554596 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0ac70-465d-4e41-ba01-e1508abb5fbf admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:41.559387 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b28be-8176-4666-828d-57211743aa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:41.560099 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b28be-8176-4666-828d-57211743aa77 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:41.560563 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b28be-8176-4666-828d-57211743aa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:41.560858 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b28be-8176-4666-828d-57211743aa77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:41.561608 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b28be-8176-4666-828d-57211743aa77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:41.563287 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b28be-8176-4666-828d-57211743aa77 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:41.577905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1294/2569] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:23:41.579169 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b7338-a4f1-4525-a6b7-6456cd9baffe admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:41.590333 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b7338-a4f1-4525-a6b7-6456cd9baffe admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:41.595781 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b7c88-592a-4a94-a1f2-200b9c5d692a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:41.596787 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b7c88-592a-4a94-a1f2-200b9c5d692a admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:41.597147 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b7c88-592a-4a94-a1f2-200b9c5d692a admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:41.597486 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b7c88-592a-4a94-a1f2-200b9c5d692a admin admin] PATH_INFO: `/v3/projects/f5991201c69e4bb182d823f8d1c7040f/users/f4854c96d99b4e0b87806654fe7db330/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:41.614628 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b7c88-592a-4a94-a1f2-200b9c5d692a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5991201c69e4bb182d823f8d1c7040f, user_id=f4854c96d99b4e0b87806654fe7db330, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:41.617861 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b7c88-592a-4a94-a1f2-200b9c5d692a admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:41.634522 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1276/2570] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:23:41 2022] PUT /identity/v3/projects/f5991201c69e4bb182d823f8d1c7040f/users/f4854c96d99b4e0b87806654fe7db330/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:41.645888 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e2b62-6a4a-4827-a363-aaf1b040dd40 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:41.646211 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e2b62-6a4a-4827-a363-aaf1b040dd40 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:41.646501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e2b62-6a4a-4827-a363-aaf1b040dd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:41.675381 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-6c6e2b62-6a4a-4827-a363-aaf1b040dd40 None None] MFA Rules not processed for user `f4854c96d99b4e0b87806654fe7db330`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:41.676728 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-6c6e2b62-6a4a-4827-a363-aaf1b040dd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:41.750035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1295/2571] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:41.751192 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b7c88-592a-4a94-a1f2-200b9c5d692a admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:41.767070 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:41.826776 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b7c88-592a-4a94-a1f2-200b9c5d692a admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:41.832750 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5316a-ebd4-4f01-a279-c50cfce97c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:41.833416 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5316a-ebd4-4f01-a279-c50cfce97c94 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:41.833715 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5316a-ebd4-4f01-a279-c50cfce97c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:41.833975 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5316a-ebd4-4f01-a279-c50cfce97c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:41.834884 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5316a-ebd4-4f01-a279-c50cfce97c94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:41.837137 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5316a-ebd4-4f01-a279-c50cfce97c94 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:41.873286 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1277/2572] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:23:41 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:23:41.877746 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e2b62-6a4a-4827-a363-aaf1b040dd40 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:41.895821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e2b62-6a4a-4827-a363-aaf1b040dd40 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:41.963162 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815190d9-4178-4343-90a4-dffb0e030e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:41.963349 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815190d9-4178-4343-90a4-dffb0e030e06 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:41.963534 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815190d9-4178-4343-90a4-dffb0e030e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:41.963808 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815190d9-4178-4343-90a4-dffb0e030e06 admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:41.964508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815190d9-4178-4343-90a4-dffb0e030e06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:41.967206 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815190d9-4178-4343-90a4-dffb0e030e06 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:41.990701 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1296/2573] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:23:41 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:23:41.995295 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5316a-ebd4-4f01-a279-c50cfce97c94 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:42.008521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5316a-ebd4-4f01-a279-c50cfce97c94 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:42.014553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549637d-2f3c-491f-8de4-8122c38a9e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:42.015374 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549637d-2f3c-491f-8de4-8122c38a9e26 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:42.017245 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549637d-2f3c-491f-8de4-8122c38a9e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:42.017245 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549637d-2f3c-491f-8de4-8122c38a9e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:42.017245 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549637d-2f3c-491f-8de4-8122c38a9e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:42.018626 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549637d-2f3c-491f-8de4-8122c38a9e26 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:42.032675 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1278/2574] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:23:42.037048 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815190d9-4178-4343-90a4-dffb0e030e06 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:42.051288 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815190d9-4178-4343-90a4-dffb0e030e06 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:42.060848 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c022cf-8b48-4fe8-b015-edc799d3f3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:42.062317 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c022cf-8b48-4fe8-b015-edc799d3f3fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:42.062764 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c022cf-8b48-4fe8-b015-edc799d3f3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:42.063219 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c022cf-8b48-4fe8-b015-edc799d3f3fa admin admin] PATH_INFO: `/v3/projects/a423df8445104d6d963e2449e1e64458/users/f80489b2ac8047859dccb7f2160dfee9/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:42.084178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c022cf-8b48-4fe8-b015-edc799d3f3fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a423df8445104d6d963e2449e1e64458, user_id=f80489b2ac8047859dccb7f2160dfee9, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:42.087340 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c022cf-8b48-4fe8-b015-edc799d3f3fa admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:42.106965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1297/2575] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:23:42 2022] PUT /identity/v3/projects/a423df8445104d6d963e2449e1e64458/users/f80489b2ac8047859dccb7f2160dfee9/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:42.110976 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549637d-2f3c-491f-8de4-8122c38a9e26 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:42.123300 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549637d-2f3c-491f-8de4-8122c38a9e26 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:42.208950 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14d381-17a1-478c-9f7f-5aecff02b564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:42.210320 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14d381-17a1-478c-9f7f-5aecff02b564 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:42.210715 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14d381-17a1-478c-9f7f-5aecff02b564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:42.211113 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14d381-17a1-478c-9f7f-5aecff02b564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:42.211955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14d381-17a1-478c-9f7f-5aecff02b564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:42.213772 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14d381-17a1-478c-9f7f-5aecff02b564 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:42.227283 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1279/2576] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:23:42.231197 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c022cf-8b48-4fe8-b015-edc799d3f3fa admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:42.242049 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c022cf-8b48-4fe8-b015-edc799d3f3fa admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:42.246868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21c41b-7ae0-4118-a363-2e0999e1bd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:42.247910 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21c41b-7ae0-4118-a363-2e0999e1bd1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:42.248204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21c41b-7ae0-4118-a363-2e0999e1bd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:42.248504 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21c41b-7ae0-4118-a363-2e0999e1bd1e admin admin] PATH_INFO: `/v3/projects/a423df8445104d6d963e2449e1e64458/users/f80489b2ac8047859dccb7f2160dfee9/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:42.250571 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21c41b-7ae0-4118-a363-2e0999e1bd1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a423df8445104d6d963e2449e1e64458, user_id=f80489b2ac8047859dccb7f2160dfee9, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:42.253525 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21c41b-7ae0-4118-a363-2e0999e1bd1e admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:42.266084 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1298/2577] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:23:42 2022] PUT /identity/v3/projects/a423df8445104d6d963e2449e1e64458/users/f80489b2ac8047859dccb7f2160dfee9/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:23:42.276846 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576d437-125c-4929-a5f9-e24421a6ee39 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:42.277219 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576d437-125c-4929-a5f9-e24421a6ee39 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:42.277566 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576d437-125c-4929-a5f9-e24421a6ee39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:42.314341 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-7576d437-125c-4929-a5f9-e24421a6ee39 None None] MFA Rules not processed for user `f80489b2ac8047859dccb7f2160dfee9`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:42.315588 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-7576d437-125c-4929-a5f9-e24421a6ee39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:42.417563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1280/2578] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:42.425817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21c41b-7ae0-4118-a363-2e0999e1bd1e admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:42.427825 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-3a21c41b-7ae0-4118-a363-2e0999e1bd1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:42.451043 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:42.531131 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21c41b-7ae0-4118-a363-2e0999e1bd1e admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:42.536659 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f002978-5fda-4185-9edf-3482216ff198 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:42.537623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f002978-5fda-4185-9edf-3482216ff198 service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:42.538776 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f002978-5fda-4185-9edf-3482216ff198 service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:42.539504 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f002978-5fda-4185-9edf-3482216ff198 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:42.622997 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f002978-5fda-4185-9edf-3482216ff198 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:42.625281 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f002978-5fda-4185-9edf-3482216ff198 service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:42.636056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1299/2579] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:23:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:23:44.088911 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576d437-125c-4929-a5f9-e24421a6ee39 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:44.098690 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576d437-125c-4929-a5f9-e24421a6ee39 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:44.102908 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c856f5-9306-40a0-ac6d-afbff6f14cb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:44.103575 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c856f5-9306-40a0-ac6d-afbff6f14cb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:44.103857 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c856f5-9306-40a0-ac6d-afbff6f14cb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:44.104132 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c856f5-9306-40a0-ac6d-afbff6f14cb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:44.114070 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c856f5-9306-40a0-ac6d-afbff6f14cb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:44.116405 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c856f5-9306-40a0-ac6d-afbff6f14cb6 service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:44.120774 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:44.127353 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1281/2580] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:23:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:23:44.898993 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f002978-5fda-4185-9edf-3482216ff198 service cinder] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:44.900471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-1f002978-5fda-4185-9edf-3482216ff198 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:44.975237 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f002978-5fda-4185-9edf-3482216ff198 service cinder] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:44.980495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3807f1-5b06-4bdd-af43-d20b901b45c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:44.981252 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3807f1-5b06-4bdd-af43-d20b901b45c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:44.981539 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3807f1-5b06-4bdd-af43-d20b901b45c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:44.981813 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3807f1-5b06-4bdd-af43-d20b901b45c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:44.983797 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-8b3807f1-5b06-4bdd-af43-d20b901b45c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:45.047396 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3807f1-5b06-4bdd-af43-d20b901b45c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:45.048842 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3807f1-5b06-4bdd-af43-d20b901b45c9 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:45.058486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1300/2581] 10.222.0.17 () {60 vars in 1396 bytes} [Tue Jul 12 13:23:44 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:23:45.951459 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbde573-3602-48c8-b3c5-9d0dbdb05329 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:45.952001 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbde573-3602-48c8-b3c5-9d0dbdb05329 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:45.952101 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbde573-3602-48c8-b3c5-9d0dbdb05329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:45.969884 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-1bbde573-3602-48c8-b3c5-9d0dbdb05329 None None] MFA Rules not processed for user `72f556aac45c460cb573498aab7590fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:45.971135 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-1bbde573-3602-48c8-b3c5-9d0dbdb05329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:46.037219 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1282/2582] 10.222.0.17 () {58 vars in 1009 bytes} [Tue Jul 12 13:23:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:46.049560 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3807f1-5b06-4bdd-af43-d20b901b45c9 service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:46.051030 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-8b3807f1-5b06-4bdd-af43-d20b901b45c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:46.074288 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:46.128323 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3807f1-5b06-4bdd-af43-d20b901b45c9 service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:46.134729 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f9e14-56ed-49b7-b350-a448bbf219d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe10f0f42b8247c99ed5f88eff5065e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:46.135817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f9e14-56ed-49b7-b350-a448bbf219d1 service swift] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:46.135817 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f9e14-56ed-49b7-b350-a448bbf219d1 service swift] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:46.136053 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f9e14-56ed-49b7-b350-a448bbf219d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:46.145415 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f9e14-56ed-49b7-b350-a448bbf219d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:46.147165 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f9e14-56ed-49b7-b350-a448bbf219d1 service swift] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:46.157445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1301/2583] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Jul 12 13:23:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:23:47.908452 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbde573-3602-48c8-b3c5-9d0dbdb05329 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:48.010486 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbde573-3602-48c8-b3c5-9d0dbdb05329 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:48.021284 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca077ad-452c-4e0c-8414-0ca23776e78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:48.023043 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca077ad-452c-4e0c-8414-0ca23776e78b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:48.023493 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca077ad-452c-4e0c-8414-0ca23776e78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:48.023865 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca077ad-452c-4e0c-8414-0ca23776e78b admin admin] PATH_INFO: `/v3/users/f4854c96d99b4e0b87806654fe7db330` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:48.025301 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca077ad-452c-4e0c-8414-0ca23776e78b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4854c96d99b4e0b87806654fe7db330)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:48.027479 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca077ad-452c-4e0c-8414-0ca23776e78b admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:48.111364 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-7ca077ad-452c-4e0c-8414-0ca23776e78b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4854c96d99b4e0b87806654fe7db330'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:48.111994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-7ca077ad-452c-4e0c-8414-0ca23776e78b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4854c96d99b4e0b87806654fe7db330'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:48.122917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-7ca077ad-452c-4e0c-8414-0ca23776e78b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4854c96d99b4e0b87806654fe7db330'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:48.132028 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-7ca077ad-452c-4e0c-8414-0ca23776e78b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4854c96d99b4e0b87806654fe7db330'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:48.145390 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-7ca077ad-452c-4e0c-8414-0ca23776e78b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4854c96d99b4e0b87806654fe7db330'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:48.151877 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1283/2584] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:23:47 2022] DELETE /identity/v3/users/f4854c96d99b4e0b87806654fe7db330 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:48.156444 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750328c-b094-4a48-9aa6-eb8a42bd42b7 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:48.156946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750328c-b094-4a48-9aa6-eb8a42bd42b7 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:48.157045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750328c-b094-4a48-9aa6-eb8a42bd42b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:48.302317 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-3750328c-b094-4a48-9aa6-eb8a42bd42b7 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:48.303597 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-3750328c-b094-4a48-9aa6-eb8a42bd42b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:48.369528 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1302/2585] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:48.378764 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca077ad-452c-4e0c-8414-0ca23776e78b admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:48.380279 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-7ca077ad-452c-4e0c-8414-0ca23776e78b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:48.418497 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:48.487324 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca077ad-452c-4e0c-8414-0ca23776e78b admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:48.491426 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcf02f-ff5b-4359-aac7-1d4dd726391f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:48.492315 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcf02f-ff5b-4359-aac7-1d4dd726391f service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:48.493020 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcf02f-ff5b-4359-aac7-1d4dd726391f service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:48.493466 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcf02f-ff5b-4359-aac7-1d4dd726391f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:48.504159 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bcf02f-ff5b-4359-aac7-1d4dd726391f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:48.505986 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bcf02f-ff5b-4359-aac7-1d4dd726391f service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:48.518950 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1284/2586] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:23:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:23:49.062326 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750328c-b094-4a48-9aa6-eb8a42bd42b7 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:49.064061 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-3750328c-b094-4a48-9aa6-eb8a42bd42b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:49.079232 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750328c-b094-4a48-9aa6-eb8a42bd42b7 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:49.084087 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2ab41-382d-48e8-b60b-65049339d3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:49.085534 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2ab41-382d-48e8-b60b-65049339d3fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:49.085824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2ab41-382d-48e8-b60b-65049339d3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:49.086107 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2ab41-382d-48e8-b60b-65049339d3fb admin admin] PATH_INFO: `/v3/projects/f5991201c69e4bb182d823f8d1c7040f` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:49.087471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2ab41-382d-48e8-b60b-65049339d3fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5991201c69e4bb182d823f8d1c7040f)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:49.089426 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2ab41-382d-48e8-b60b-65049339d3fb admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:49.148745 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f7e2ab41-382d-48e8-b60b-65049339d3fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5991201c69e4bb182d823f8d1c7040f', 'request_id': 'req-f7e2ab41-382d-48e8-b60b-65049339d3fb'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:49.155821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f7e2ab41-382d-48e8-b60b-65049339d3fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5991201c69e4bb182d823f8d1c7040f', 'request_id': 'req-f7e2ab41-382d-48e8-b60b-65049339d3fb'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:49.166886 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f7e2ab41-382d-48e8-b60b-65049339d3fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5991201c69e4bb182d823f8d1c7040f', 'request_id': 'req-f7e2ab41-382d-48e8-b60b-65049339d3fb'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:49.180890 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f7e2ab41-382d-48e8-b60b-65049339d3fb admin admin] The token cache is being invalidate because project f5991201c69e4bb182d823f8d1c7040f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:23:49.181092 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f7e2ab41-382d-48e8-b60b-65049339d3fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:49.181890 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f7e2ab41-382d-48e8-b60b-65049339d3fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:49.183720 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1303/2587] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:23:49 2022] DELETE /identity/v3/projects/f5991201c69e4bb182d823f8d1c7040f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:49.187735 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcf02f-ff5b-4359-aac7-1d4dd726391f service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:49.198471 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcf02f-ff5b-4359-aac7-1d4dd726391f service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:49.274390 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c11ed-984c-4657-83e7-20aeb1664d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:49.275282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c11ed-984c-4657-83e7-20aeb1664d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:49.275567 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c11ed-984c-4657-83e7-20aeb1664d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:49.275844 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c11ed-984c-4657-83e7-20aeb1664d49 admin admin] PATH_INFO: `/v3/users/f80489b2ac8047859dccb7f2160dfee9` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:49.277039 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c11ed-984c-4657-83e7-20aeb1664d49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80489b2ac8047859dccb7f2160dfee9)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:49.278994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c11ed-984c-4657-83e7-20aeb1664d49 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:49.334823 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-bf4c11ed-984c-4657-83e7-20aeb1664d49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80489b2ac8047859dccb7f2160dfee9'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:49.335580 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-bf4c11ed-984c-4657-83e7-20aeb1664d49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80489b2ac8047859dccb7f2160dfee9'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:49.347689 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-bf4c11ed-984c-4657-83e7-20aeb1664d49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80489b2ac8047859dccb7f2160dfee9'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:49.356625 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-bf4c11ed-984c-4657-83e7-20aeb1664d49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80489b2ac8047859dccb7f2160dfee9'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:49.369308 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-bf4c11ed-984c-4657-83e7-20aeb1664d49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80489b2ac8047859dccb7f2160dfee9'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:49.377089 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1285/2588] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:23:49 2022] DELETE /identity/v3/users/f80489b2ac8047859dccb7f2160dfee9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:49.682170 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2ab41-382d-48e8-b60b-65049339d3fb admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:49.691206 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-f7e2ab41-382d-48e8-b60b-65049339d3fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:49.724669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2ab41-382d-48e8-b60b-65049339d3fb admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:49.770321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:49.801650 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bc07c-ddfd-44e3-9d0e-f2edf0026b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:49.802629 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bc07c-ddfd-44e3-9d0e-f2edf0026b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:49.802908 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bc07c-ddfd-44e3-9d0e-f2edf0026b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:49.803213 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bc07c-ddfd-44e3-9d0e-f2edf0026b35 admin admin] PATH_INFO: `/v3/projects/a423df8445104d6d963e2449e1e64458` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:49.804401 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bc07c-ddfd-44e3-9d0e-f2edf0026b35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a423df8445104d6d963e2449e1e64458)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:49.806435 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bc07c-ddfd-44e3-9d0e-f2edf0026b35 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:49.860275 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-9b0bc07c-ddfd-44e3-9d0e-f2edf0026b35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a423df8445104d6d963e2449e1e64458', 'request_id': 'req-9b0bc07c-ddfd-44e3-9d0e-f2edf0026b35'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:49.867782 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-9b0bc07c-ddfd-44e3-9d0e-f2edf0026b35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a423df8445104d6d963e2449e1e64458', 'request_id': 'req-9b0bc07c-ddfd-44e3-9d0e-f2edf0026b35'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:49.889833 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-9b0bc07c-ddfd-44e3-9d0e-f2edf0026b35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a423df8445104d6d963e2449e1e64458', 'request_id': 'req-9b0bc07c-ddfd-44e3-9d0e-f2edf0026b35'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:49.916408 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-9b0bc07c-ddfd-44e3-9d0e-f2edf0026b35 admin admin] The token cache is being invalidate because project a423df8445104d6d963e2449e1e64458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:23:49.916943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-9b0bc07c-ddfd-44e3-9d0e-f2edf0026b35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:49.917865 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-9b0bc07c-ddfd-44e3-9d0e-f2edf0026b35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:49.920040 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1304/2589] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:23:49 2022] DELETE /identity/v3/projects/a423df8445104d6d963e2449e1e64458 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:49.925943 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1efde-01fc-48b3-bf09-69099743fffc None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:49.926446 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1efde-01fc-48b3-bf09-69099743fffc None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:49.926893 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1efde-01fc-48b3-bf09-69099743fffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:49.955991 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-4ed1efde-01fc-48b3-bf09-69099743fffc None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:49.957211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-4ed1efde-01fc-48b3-bf09-69099743fffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:50.069352 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:50.099266 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1286/2590] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:50.110177 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682345ff-e2e1-4b70-840f-a065ee93e36d None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:50.110560 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682345ff-e2e1-4b70-840f-a065ee93e36d None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:50.110974 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682345ff-e2e1-4b70-840f-a065ee93e36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:50.152723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-682345ff-e2e1-4b70-840f-a065ee93e36d None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:50.154177 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-682345ff-e2e1-4b70-840f-a065ee93e36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:50.185996 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1305/2591] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:23:50.188801 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1efde-01fc-48b3-bf09-69099743fffc None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:50.204570 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1efde-01fc-48b3-bf09-69099743fffc None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:50.212508 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65167205-5335-4949-827e-2f61edca2dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:50.214545 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65167205-5335-4949-827e-2f61edca2dea admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:50.218720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65167205-5335-4949-827e-2f61edca2dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:50.219015 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65167205-5335-4949-827e-2f61edca2dea admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:50.223080 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65167205-5335-4949-827e-2f61edca2dea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:23:50.223449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65167205-5335-4949-827e-2f61edca2dea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:50.225668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65167205-5335-4949-827e-2f61edca2dea admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:50.263922 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1287/2592] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:23:50.265369 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682345ff-e2e1-4b70-840f-a065ee93e36d None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:50.277943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682345ff-e2e1-4b70-840f-a065ee93e36d None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:50.291037 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cac73f-adba-4c47-b0de-4b4a3ca25ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:50.291887 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cac73f-adba-4c47-b0de-4b4a3ca25ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:50.292234 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cac73f-adba-4c47-b0de-4b4a3ca25ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:50.292555 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cac73f-adba-4c47-b0de-4b4a3ca25ab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:50.293539 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cac73f-adba-4c47-b0de-4b4a3ca25ab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:50.295612 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cac73f-adba-4c47-b0de-4b4a3ca25ab4 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:50.357024 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1306/2593] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:23:50 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:23:50.360792 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65167205-5335-4949-827e-2f61edca2dea admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:50.380874 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65167205-5335-4949-827e-2f61edca2dea admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:50.475652 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dea5a2-1402-4431-992e-a3a2a0859ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:50.477068 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dea5a2-1402-4431-992e-a3a2a0859ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:50.477558 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dea5a2-1402-4431-992e-a3a2a0859ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:50.478093 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dea5a2-1402-4431-992e-a3a2a0859ff2 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:50.479021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dea5a2-1402-4431-992e-a3a2a0859ff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:50.481367 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dea5a2-1402-4431-992e-a3a2a0859ff2 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:50.509595 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1288/2594] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:23:50 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:23:50.513555 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cac73f-adba-4c47-b0de-4b4a3ca25ab4 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:50.525721 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cac73f-adba-4c47-b0de-4b4a3ca25ab4 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:50.532829 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afff149-b913-4ec9-8023-f08fa4d81ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:50.533465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afff149-b913-4ec9-8023-f08fa4d81ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:50.534729 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afff149-b913-4ec9-8023-f08fa4d81ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:50.534729 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afff149-b913-4ec9-8023-f08fa4d81ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:50.538656 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afff149-b913-4ec9-8023-f08fa4d81ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:50.538656 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afff149-b913-4ec9-8023-f08fa4d81ff6 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:50.551604 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1307/2595] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:23:50.555475 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dea5a2-1402-4431-992e-a3a2a0859ff2 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:50.567006 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dea5a2-1402-4431-992e-a3a2a0859ff2 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:50.572473 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa6923-95d2-4591-b42f-4d7b9276ecfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:50.573363 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa6923-95d2-4591-b42f-4d7b9276ecfd admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:50.573752 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa6923-95d2-4591-b42f-4d7b9276ecfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:50.574157 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa6923-95d2-4591-b42f-4d7b9276ecfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:50.575053 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa6923-95d2-4591-b42f-4d7b9276ecfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:50.576884 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa6923-95d2-4591-b42f-4d7b9276ecfd admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:50.589674 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1289/2596] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:23:50.595112 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afff149-b913-4ec9-8023-f08fa4d81ff6 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:50.605416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afff149-b913-4ec9-8023-f08fa4d81ff6 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:50.614237 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ccd37-ff29-458d-b18b-2f935f231311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:50.615776 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ccd37-ff29-458d-b18b-2f935f231311 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:50.616084 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ccd37-ff29-458d-b18b-2f935f231311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:50.616524 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ccd37-ff29-458d-b18b-2f935f231311 admin admin] PATH_INFO: `/v3/projects/c8e7ac30908543a2ac3f9026db33279f/users/359abd4e47ad45f59c5b87fe43650000/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:50.636265 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ccd37-ff29-458d-b18b-2f935f231311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e7ac30908543a2ac3f9026db33279f, user_id=359abd4e47ad45f59c5b87fe43650000, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:50.639035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ccd37-ff29-458d-b18b-2f935f231311 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:50.660218 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1308/2597] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:23:50 2022] PUT /identity/v3/projects/c8e7ac30908543a2ac3f9026db33279f/users/359abd4e47ad45f59c5b87fe43650000/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:50.672173 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9310b-e4db-48f4-b8d8-a783a3961d98 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:50.672594 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9310b-e4db-48f4-b8d8-a783a3961d98 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:50.672942 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9310b-e4db-48f4-b8d8-a783a3961d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:50.712376 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-09e9310b-e4db-48f4-b8d8-a783a3961d98 None None] MFA Rules not processed for user `359abd4e47ad45f59c5b87fe43650000`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:50.714822 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-09e9310b-e4db-48f4-b8d8-a783a3961d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:50.788775 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1290/2598] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:50.793413 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ccd37-ff29-458d-b18b-2f935f231311 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:50.856207 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:50.860423 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ccd37-ff29-458d-b18b-2f935f231311 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:50.867023 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f4235-6bf3-44c0-9091-c452d6ae871f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:50.868063 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f4235-6bf3-44c0-9091-c452d6ae871f admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:50.868477 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f4235-6bf3-44c0-9091-c452d6ae871f admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:50.868754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f4235-6bf3-44c0-9091-c452d6ae871f admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:50.869491 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f4235-6bf3-44c0-9091-c452d6ae871f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:50.871784 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f4235-6bf3-44c0-9091-c452d6ae871f admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:50.908908 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1309/2599] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:23:50 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:23:50.910500 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9310b-e4db-48f4-b8d8-a783a3961d98 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:50.923830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9310b-e4db-48f4-b8d8-a783a3961d98 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:50.963672 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:50.996288 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f0139-a433-4aca-b526-db9c07ef072a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:50.997240 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f0139-a433-4aca-b526-db9c07ef072a admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:50.997789 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f0139-a433-4aca-b526-db9c07ef072a admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:50.998235 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f0139-a433-4aca-b526-db9c07ef072a admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:50.999422 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f0139-a433-4aca-b526-db9c07ef072a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:51.002073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f0139-a433-4aca-b526-db9c07ef072a admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:51.030156 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1291/2600] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:23:50 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:23:51.032340 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f4235-6bf3-44c0-9091-c452d6ae871f admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:51.050539 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f4235-6bf3-44c0-9091-c452d6ae871f admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:51.055899 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adbed1-4840-40e5-a96f-0c61037a39f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:51.056587 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adbed1-4840-40e5-a96f-0c61037a39f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:51.056885 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adbed1-4840-40e5-a96f-0c61037a39f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:51.057167 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adbed1-4840-40e5-a96f-0c61037a39f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:51.057905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adbed1-4840-40e5-a96f-0c61037a39f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:51.059578 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adbed1-4840-40e5-a96f-0c61037a39f0 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:51.072309 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1310/2601] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:23:51.076221 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f0139-a433-4aca-b526-db9c07ef072a admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:51.088009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f0139-a433-4aca-b526-db9c07ef072a admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:51.092672 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be919a75-6f9c-4fbb-b76c-330cd596575a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:51.093336 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be919a75-6f9c-4fbb-b76c-330cd596575a admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:51.093619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be919a75-6f9c-4fbb-b76c-330cd596575a admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:51.093931 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be919a75-6f9c-4fbb-b76c-330cd596575a admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:51.094680 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be919a75-6f9c-4fbb-b76c-330cd596575a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:51.096265 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be919a75-6f9c-4fbb-b76c-330cd596575a admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:51.107702 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1292/2602] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:23:51.112267 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adbed1-4840-40e5-a96f-0c61037a39f0 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:51.125119 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adbed1-4840-40e5-a96f-0c61037a39f0 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:51.131868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108b340-d91d-43b9-82be-106f02eaaadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:51.133033 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108b340-d91d-43b9-82be-106f02eaaadc admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:51.133391 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108b340-d91d-43b9-82be-106f02eaaadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:51.133741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108b340-d91d-43b9-82be-106f02eaaadc admin admin] PATH_INFO: `/v3/projects/319bedfd24a846ce9ec04bb4a40c5f77/users/8a3dbf5a9bf049dfa883096d91989cf7/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:51.152086 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108b340-d91d-43b9-82be-106f02eaaadc admin admin] RBAC: Authorizing `identity:create_grant(project_id=319bedfd24a846ce9ec04bb4a40c5f77, user_id=8a3dbf5a9bf049dfa883096d91989cf7, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:51.154907 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108b340-d91d-43b9-82be-106f02eaaadc admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:51.167922 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1311/2603] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:23:51 2022] PUT /identity/v3/projects/319bedfd24a846ce9ec04bb4a40c5f77/users/8a3dbf5a9bf049dfa883096d91989cf7/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:51.179066 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c7162-0da1-498c-93ba-c21ee0bd6f10 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:51.179397 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c7162-0da1-498c-93ba-c21ee0bd6f10 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:51.179680 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c7162-0da1-498c-93ba-c21ee0bd6f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:51.233952 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-596c7162-0da1-498c-93ba-c21ee0bd6f10 None None] MFA Rules not processed for user `8a3dbf5a9bf049dfa883096d91989cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:51.235223 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-596c7162-0da1-498c-93ba-c21ee0bd6f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:51.379877 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1293/2604] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:51.380189 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108b340-d91d-43b9-82be-106f02eaaadc admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:51.469189 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108b340-d91d-43b9-82be-106f02eaaadc admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:51.480125 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ced663-1544-4caa-b1f2-81ddae2310a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:51.485822 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ced663-1544-4caa-b1f2-81ddae2310a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:51.486327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ced663-1544-4caa-b1f2-81ddae2310a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:51.486730 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ced663-1544-4caa-b1f2-81ddae2310a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:51.487713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ced663-1544-4caa-b1f2-81ddae2310a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:51.489755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ced663-1544-4caa-b1f2-81ddae2310a7 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:51.568463 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1312/2605] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:23:51 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:23:51.572873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c7162-0da1-498c-93ba-c21ee0bd6f10 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:51.593480 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c7162-0da1-498c-93ba-c21ee0bd6f10 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:51.719722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94150564-b7d3-4de5-9d1e-22f412096935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:51.720713 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94150564-b7d3-4de5-9d1e-22f412096935 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:51.720999 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94150564-b7d3-4de5-9d1e-22f412096935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:51.721278 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94150564-b7d3-4de5-9d1e-22f412096935 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:51.721972 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94150564-b7d3-4de5-9d1e-22f412096935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:51.723976 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94150564-b7d3-4de5-9d1e-22f412096935 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:51.754706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1294/2606] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:23:51 2022] POST /identity/v3/users => generated 299 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:23:51.758739 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ced663-1544-4caa-b1f2-81ddae2310a7 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:51.773662 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ced663-1544-4caa-b1f2-81ddae2310a7 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:51.778742 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a16c59-eb08-4c30-b93e-2c4d96c292fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:51.779705 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a16c59-eb08-4c30-b93e-2c4d96c292fe admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:51.780228 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a16c59-eb08-4c30-b93e-2c4d96c292fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:51.780571 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a16c59-eb08-4c30-b93e-2c4d96c292fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:51.781534 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a16c59-eb08-4c30-b93e-2c4d96c292fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:51.783403 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a16c59-eb08-4c30-b93e-2c4d96c292fe admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:51.796758 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1313/2607] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:23:51.801211 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94150564-b7d3-4de5-9d1e-22f412096935 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:51.813834 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94150564-b7d3-4de5-9d1e-22f412096935 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:51.819466 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45dca4-838b-4939-95c6-7ce9ee665ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:51.820402 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45dca4-838b-4939-95c6-7ce9ee665ecf admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:51.820704 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45dca4-838b-4939-95c6-7ce9ee665ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:51.820986 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45dca4-838b-4939-95c6-7ce9ee665ecf admin admin] PATH_INFO: `/v3/projects/79c4979ec49849ffb30ae4f324807c9f/users/4cc181dfd2754cfcacef0f79b0803324/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:51.838674 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45dca4-838b-4939-95c6-7ce9ee665ecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c4979ec49849ffb30ae4f324807c9f, user_id=4cc181dfd2754cfcacef0f79b0803324, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:51.841347 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45dca4-838b-4939-95c6-7ce9ee665ecf admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:51.861074 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1295/2608] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:23:51 2022] PUT /identity/v3/projects/79c4979ec49849ffb30ae4f324807c9f/users/4cc181dfd2754cfcacef0f79b0803324/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:51.862599 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a16c59-eb08-4c30-b93e-2c4d96c292fe admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:51.873432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a16c59-eb08-4c30-b93e-2c4d96c292fe admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:51.942678 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52090793-2038-4810-bd20-f9a5d457da78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:51.943371 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52090793-2038-4810-bd20-f9a5d457da78 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:51.943705 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52090793-2038-4810-bd20-f9a5d457da78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:51.944232 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52090793-2038-4810-bd20-f9a5d457da78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:51.945320 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52090793-2038-4810-bd20-f9a5d457da78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:51.947214 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52090793-2038-4810-bd20-f9a5d457da78 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:51.959026 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1314/2609] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:23:51.963844 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45dca4-838b-4939-95c6-7ce9ee665ecf admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:51.974549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45dca4-838b-4939-95c6-7ce9ee665ecf admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:51.983846 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3458c-8a6c-430a-b98b-c429df705ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:51.985027 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3458c-8a6c-430a-b98b-c429df705ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:51.985450 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3458c-8a6c-430a-b98b-c429df705ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:51.985926 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3458c-8a6c-430a-b98b-c429df705ad3 admin admin] PATH_INFO: `/v3/projects/79c4979ec49849ffb30ae4f324807c9f/users/4cc181dfd2754cfcacef0f79b0803324/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:51.988463 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3458c-8a6c-430a-b98b-c429df705ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c4979ec49849ffb30ae4f324807c9f, user_id=4cc181dfd2754cfcacef0f79b0803324, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:51.991908 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3458c-8a6c-430a-b98b-c429df705ad3 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:52.000163 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:52.013520 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1296/2610] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:23:51 2022] PUT /identity/v3/projects/79c4979ec49849ffb30ae4f324807c9f/users/4cc181dfd2754cfcacef0f79b0803324/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:23:52.024692 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78536c66-9f09-4f32-bbba-534e87b22e6f None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:52.025058 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78536c66-9f09-4f32-bbba-534e87b22e6f None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:52.025434 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78536c66-9f09-4f32-bbba-534e87b22e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:52.064694 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-78536c66-9f09-4f32-bbba-534e87b22e6f None None] MFA Rules not processed for user `4cc181dfd2754cfcacef0f79b0803324`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:52.066791 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-78536c66-9f09-4f32-bbba-534e87b22e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:52.075738 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:52.164876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1315/2611] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:52.165990 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3458c-8a6c-430a-b98b-c429df705ad3 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:52.168056 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-c6d3458c-8a6c-430a-b98b-c429df705ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:52.229772 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3458c-8a6c-430a-b98b-c429df705ad3 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:52.233557 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92c3e1-77a3-4db8-9a61-2920863ca75d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:52.234234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92c3e1-77a3-4db8-9a61-2920863ca75d service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:52.234885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92c3e1-77a3-4db8-9a61-2920863ca75d service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:52.234885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92c3e1-77a3-4db8-9a61-2920863ca75d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:52.299708 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92c3e1-77a3-4db8-9a61-2920863ca75d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:52.301160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92c3e1-77a3-4db8-9a61-2920863ca75d service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:52.310939 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1297/2612] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:23:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:23:53.896148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78536c66-9f09-4f32-bbba-534e87b22e6f None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:53.898523 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-78536c66-9f09-4f32-bbba-534e87b22e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:53.911647 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78536c66-9f09-4f32-bbba-534e87b22e6f None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:53.915892 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0609a-9770-408d-b59b-1a5d57596e1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:53.916617 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0609a-9770-408d-b59b-1a5d57596e1f service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:53.917017 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0609a-9770-408d-b59b-1a5d57596e1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:53.917395 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0609a-9770-408d-b59b-1a5d57596e1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:53.977308 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0609a-9770-408d-b59b-1a5d57596e1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:53.978789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0609a-9770-408d-b59b-1a5d57596e1f service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:53.987857 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1316/2613] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:23:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:23:54.528747 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92c3e1-77a3-4db8-9a61-2920863ca75d service cinder] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:54.538546 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92c3e1-77a3-4db8-9a61-2920863ca75d service cinder] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:54.542403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170a3c4-12d9-49a4-b596-6e12fc37ebe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:54.543053 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170a3c4-12d9-49a4-b596-6e12fc37ebe4 service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:54.543334 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170a3c4-12d9-49a4-b596-6e12fc37ebe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:54.543609 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170a3c4-12d9-49a4-b596-6e12fc37ebe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:54.553000 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7170a3c4-12d9-49a4-b596-6e12fc37ebe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:54.554438 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7170a3c4-12d9-49a4-b596-6e12fc37ebe4 service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:54.563836 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1298/2614] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:23:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:23:58.491886 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0609a-9770-408d-b59b-1a5d57596e1f service cinder] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:58.558835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0609a-9770-408d-b59b-1a5d57596e1f service cinder] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:58.563324 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04931c5e-bf86-47e5-8c1b-59d9f72cbbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:58.564220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04931c5e-bf86-47e5-8c1b-59d9f72cbbe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:58.564505 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04931c5e-bf86-47e5-8c1b-59d9f72cbbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:58.564778 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04931c5e-bf86-47e5-8c1b-59d9f72cbbe3 admin admin] PATH_INFO: `/v3/users/359abd4e47ad45f59c5b87fe43650000` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:58.566041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04931c5e-bf86-47e5-8c1b-59d9f72cbbe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=359abd4e47ad45f59c5b87fe43650000)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:58.568179 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04931c5e-bf86-47e5-8c1b-59d9f72cbbe3 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:58.618704 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:58.621613 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-04931c5e-bf86-47e5-8c1b-59d9f72cbbe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '359abd4e47ad45f59c5b87fe43650000'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:58.630450 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-04931c5e-bf86-47e5-8c1b-59d9f72cbbe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '359abd4e47ad45f59c5b87fe43650000'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:58.638450 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-04931c5e-bf86-47e5-8c1b-59d9f72cbbe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '359abd4e47ad45f59c5b87fe43650000'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:58.639100 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-04931c5e-bf86-47e5-8c1b-59d9f72cbbe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '359abd4e47ad45f59c5b87fe43650000'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:58.653462 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-04931c5e-bf86-47e5-8c1b-59d9f72cbbe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '359abd4e47ad45f59c5b87fe43650000'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:58.660051 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1317/2615] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:23:58 2022] DELETE /identity/v3/users/359abd4e47ad45f59c5b87fe43650000 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:58.664456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b680d26-cb6b-47d2-9806-72fb494da227 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:58.664953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b680d26-cb6b-47d2-9806-72fb494da227 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:58.665048 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b680d26-cb6b-47d2-9806-72fb494da227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:58.685052 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-0b680d26-cb6b-47d2-9806-72fb494da227 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:58.687510 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-0b680d26-cb6b-47d2-9806-72fb494da227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:58.789735 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04931c5e-bf86-47e5-8c1b-59d9f72cbbe3 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:58.791721 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-04931c5e-bf86-47e5-8c1b-59d9f72cbbe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:58.804439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1299/2616] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:23:58.817594 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b680d26-cb6b-47d2-9806-72fb494da227 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:58.820053 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-0b680d26-cb6b-47d2-9806-72fb494da227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:58.861283 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04931c5e-bf86-47e5-8c1b-59d9f72cbbe3 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:58.862954 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:58.866575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1fdc7-0699-4dad-8b7d-1c292900177b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:58.867352 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1fdc7-0699-4dad-8b7d-1c292900177b service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:58.867735 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1fdc7-0699-4dad-8b7d-1c292900177b service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:58.868122 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1fdc7-0699-4dad-8b7d-1c292900177b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:58.869994 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-bdb1fdc7-0699-4dad-8b7d-1c292900177b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:58.877423 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b680d26-cb6b-47d2-9806-72fb494da227 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:58.881897 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca68bda-2d9c-4981-a9dc-54c341ce0f47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:58.882666 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca68bda-2d9c-4981-a9dc-54c341ce0f47 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:58.882956 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca68bda-2d9c-4981-a9dc-54c341ce0f47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:58.883238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca68bda-2d9c-4981-a9dc-54c341ce0f47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:58.892512 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca68bda-2d9c-4981-a9dc-54c341ce0f47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:58.893947 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca68bda-2d9c-4981-a9dc-54c341ce0f47 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:58.903483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1300/2617] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:23:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:23:58.939221 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1fdc7-0699-4dad-8b7d-1c292900177b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:58.940677 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1fdc7-0699-4dad-8b7d-1c292900177b service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:58.952529 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1318/2618] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:23:58 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:23:59.193309 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca68bda-2d9c-4981-a9dc-54c341ce0f47 service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:59.195259 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-dca68bda-2d9c-4981-a9dc-54c341ce0f47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:59.210348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca68bda-2d9c-4981-a9dc-54c341ce0f47 service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:59.215922 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a75413-5ef6-4579-ac7e-59ee728e1b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:59.216804 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a75413-5ef6-4579-ac7e-59ee728e1b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:59.217701 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a75413-5ef6-4579-ac7e-59ee728e1b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:59.218049 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a75413-5ef6-4579-ac7e-59ee728e1b1b admin admin] PATH_INFO: `/v3/projects/c8e7ac30908543a2ac3f9026db33279f` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:59.219819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a75413-5ef6-4579-ac7e-59ee728e1b1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8e7ac30908543a2ac3f9026db33279f)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:59.221789 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a75413-5ef6-4579-ac7e-59ee728e1b1b admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:59.268991 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-c3a75413-5ef6-4579-ac7e-59ee728e1b1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8e7ac30908543a2ac3f9026db33279f', 'request_id': 'req-c3a75413-5ef6-4579-ac7e-59ee728e1b1b'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:59.275989 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-c3a75413-5ef6-4579-ac7e-59ee728e1b1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8e7ac30908543a2ac3f9026db33279f', 'request_id': 'req-c3a75413-5ef6-4579-ac7e-59ee728e1b1b'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:59.283923 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-c3a75413-5ef6-4579-ac7e-59ee728e1b1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8e7ac30908543a2ac3f9026db33279f', 'request_id': 'req-c3a75413-5ef6-4579-ac7e-59ee728e1b1b'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:59.296529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-c3a75413-5ef6-4579-ac7e-59ee728e1b1b admin admin] The token cache is being invalidate because project c8e7ac30908543a2ac3f9026db33279f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:23:59.297268 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-c3a75413-5ef6-4579-ac7e-59ee728e1b1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:59.298004 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-c3a75413-5ef6-4579-ac7e-59ee728e1b1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:59.299629 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1301/2619] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:23:59 2022] DELETE /identity/v3/projects/c8e7ac30908543a2ac3f9026db33279f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:59.303626 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1fdc7-0699-4dad-8b7d-1c292900177b service cinder] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:59.314572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1fdc7-0699-4dad-8b7d-1c292900177b service cinder] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:59.382624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f05fad-9c18-4d19-9378-a2c382b5c186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:59.383509 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f05fad-9c18-4d19-9378-a2c382b5c186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:59.383791 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f05fad-9c18-4d19-9378-a2c382b5c186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:59.384064 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f05fad-9c18-4d19-9378-a2c382b5c186 admin admin] PATH_INFO: `/v3/users/8a3dbf5a9bf049dfa883096d91989cf7` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:59.385294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f05fad-9c18-4d19-9378-a2c382b5c186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a3dbf5a9bf049dfa883096d91989cf7)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:59.387256 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f05fad-9c18-4d19-9378-a2c382b5c186 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:59.401510 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:59.457019 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eac067-9494-4c51-9c7c-21406b69772f None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:59.457330 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eac067-9494-4c51-9c7c-21406b69772f None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:59.457657 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eac067-9494-4c51-9c7c-21406b69772f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:59.467511 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-40f05fad-9c18-4d19-9378-a2c382b5c186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a3dbf5a9bf049dfa883096d91989cf7'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:59.477723 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-66eac067-9494-4c51-9c7c-21406b69772f None None] MFA Rules not processed for user `72f556aac45c460cb573498aab7590fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:23:59.479465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-40f05fad-9c18-4d19-9378-a2c382b5c186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a3dbf5a9bf049dfa883096d91989cf7'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:59.479617 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-66eac067-9494-4c51-9c7c-21406b69772f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:59.487411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-40f05fad-9c18-4d19-9378-a2c382b5c186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a3dbf5a9bf049dfa883096d91989cf7'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:59.488142 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-40f05fad-9c18-4d19-9378-a2c382b5c186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a3dbf5a9bf049dfa883096d91989cf7'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:59.504905 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-40f05fad-9c18-4d19-9378-a2c382b5c186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a3dbf5a9bf049dfa883096d91989cf7'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:23:59.513801 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1319/2620] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:23:59 2022] DELETE /identity/v3/users/8a3dbf5a9bf049dfa883096d91989cf7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:23:59.556335 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1302/2621] 10.222.0.17 () {58 vars in 967 bytes} [Tue Jul 12 13:23:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:23:59.570598 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f05fad-9c18-4d19-9378-a2c382b5c186 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:59.573823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-40f05fad-9c18-4d19-9378-a2c382b5c186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:59.664138 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f05fad-9c18-4d19-9378-a2c382b5c186 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:59.671045 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d3989-dadc-4f81-b04b-88f3b18d8f93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe10f0f42b8247c99ed5f88eff5065e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:59.671794 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d3989-dadc-4f81-b04b-88f3b18d8f93 service swift] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:59.674370 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d3989-dadc-4f81-b04b-88f3b18d8f93 service swift] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:59.675072 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d3989-dadc-4f81-b04b-88f3b18d8f93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:59.754957 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d3989-dadc-4f81-b04b-88f3b18d8f93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:59.757138 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d3989-dadc-4f81-b04b-88f3b18d8f93 service swift] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:23:59.767426 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1320/2622] 10.222.0.17 () {60 vars in 1384 bytes} [Tue Jul 12 13:23:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:23:59.884945 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eac067-9494-4c51-9c7c-21406b69772f None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:23:59.887210 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-66eac067-9494-4c51-9c7c-21406b69772f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:23:59.918496 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eac067-9494-4c51-9c7c-21406b69772f None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:23:59.988597 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92262a34-f941-488b-97f5-2b6b4f71cdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:23:59.989485 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92262a34-f941-488b-97f5-2b6b4f71cdfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:23:59.989803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92262a34-f941-488b-97f5-2b6b4f71cdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:23:59.990053 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92262a34-f941-488b-97f5-2b6b4f71cdfb admin admin] PATH_INFO: `/v3/projects/319bedfd24a846ce9ec04bb4a40c5f77` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:23:59.991377 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92262a34-f941-488b-97f5-2b6b4f71cdfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=319bedfd24a846ce9ec04bb4a40c5f77)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:23:59.993329 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92262a34-f941-488b-97f5-2b6b4f71cdfb admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:00.005790 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:00.059067 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-92262a34-f941-488b-97f5-2b6b4f71cdfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '319bedfd24a846ce9ec04bb4a40c5f77', 'request_id': 'req-92262a34-f941-488b-97f5-2b6b4f71cdfb'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:00.067525 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-92262a34-f941-488b-97f5-2b6b4f71cdfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '319bedfd24a846ce9ec04bb4a40c5f77', 'request_id': 'req-92262a34-f941-488b-97f5-2b6b4f71cdfb'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:00.077194 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-92262a34-f941-488b-97f5-2b6b4f71cdfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '319bedfd24a846ce9ec04bb4a40c5f77', 'request_id': 'req-92262a34-f941-488b-97f5-2b6b4f71cdfb'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:00.091508 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-92262a34-f941-488b-97f5-2b6b4f71cdfb admin admin] The token cache is being invalidate because project 319bedfd24a846ce9ec04bb4a40c5f77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:24:00.091802 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-92262a34-f941-488b-97f5-2b6b4f71cdfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:00.092481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-92262a34-f941-488b-97f5-2b6b4f71cdfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:00.094080 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1303/2623] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:23:59 2022] DELETE /identity/v3/projects/319bedfd24a846ce9ec04bb4a40c5f77 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:24:00.098358 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d3989-dadc-4f81-b04b-88f3b18d8f93 service swift] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:00.111190 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d3989-dadc-4f81-b04b-88f3b18d8f93 service swift] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:00.145506 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:00.179404 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55c1cf-7d9b-4bf5-8cde-3b7331c56fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:00.180292 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55c1cf-7d9b-4bf5-8cde-3b7331c56fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:00.180575 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55c1cf-7d9b-4bf5-8cde-3b7331c56fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:00.180851 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55c1cf-7d9b-4bf5-8cde-3b7331c56fc7 admin admin] PATH_INFO: `/v3/users/4cc181dfd2754cfcacef0f79b0803324` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:00.182042 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55c1cf-7d9b-4bf5-8cde-3b7331c56fc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cc181dfd2754cfcacef0f79b0803324)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:00.184001 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55c1cf-7d9b-4bf5-8cde-3b7331c56fc7 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:00.234456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-7a55c1cf-7d9b-4bf5-8cde-3b7331c56fc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cc181dfd2754cfcacef0f79b0803324'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:00.242039 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-7a55c1cf-7d9b-4bf5-8cde-3b7331c56fc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cc181dfd2754cfcacef0f79b0803324'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:00.249732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-7a55c1cf-7d9b-4bf5-8cde-3b7331c56fc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cc181dfd2754cfcacef0f79b0803324'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:00.250444 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-7a55c1cf-7d9b-4bf5-8cde-3b7331c56fc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cc181dfd2754cfcacef0f79b0803324'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:00.265223 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-7a55c1cf-7d9b-4bf5-8cde-3b7331c56fc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cc181dfd2754cfcacef0f79b0803324'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:00.271240 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1321/2624] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:24:00 2022] DELETE /identity/v3/users/4cc181dfd2754cfcacef0f79b0803324 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:24:00.570970 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92262a34-f941-488b-97f5-2b6b4f71cdfb admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:00.572545 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-92262a34-f941-488b-97f5-2b6b4f71cdfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:00.597607 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92262a34-f941-488b-97f5-2b6b4f71cdfb admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:00.667685 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18efbe3-f1a3-4f18-9400-3b2ad1eac275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:00.668563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18efbe3-f1a3-4f18-9400-3b2ad1eac275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:00.668944 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18efbe3-f1a3-4f18-9400-3b2ad1eac275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:00.669171 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18efbe3-f1a3-4f18-9400-3b2ad1eac275 admin admin] PATH_INFO: `/v3/projects/79c4979ec49849ffb30ae4f324807c9f` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:00.670343 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18efbe3-f1a3-4f18-9400-3b2ad1eac275 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79c4979ec49849ffb30ae4f324807c9f)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:00.672292 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18efbe3-f1a3-4f18-9400-3b2ad1eac275 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:00.724646 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-e18efbe3-f1a3-4f18-9400-3b2ad1eac275 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79c4979ec49849ffb30ae4f324807c9f', 'request_id': 'req-e18efbe3-f1a3-4f18-9400-3b2ad1eac275'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:00.732110 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-e18efbe3-f1a3-4f18-9400-3b2ad1eac275 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79c4979ec49849ffb30ae4f324807c9f', 'request_id': 'req-e18efbe3-f1a3-4f18-9400-3b2ad1eac275'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:00.739698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-e18efbe3-f1a3-4f18-9400-3b2ad1eac275 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79c4979ec49849ffb30ae4f324807c9f', 'request_id': 'req-e18efbe3-f1a3-4f18-9400-3b2ad1eac275'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:00.750684 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-e18efbe3-f1a3-4f18-9400-3b2ad1eac275 admin admin] The token cache is being invalidate because project 79c4979ec49849ffb30ae4f324807c9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:24:00.750977 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-e18efbe3-f1a3-4f18-9400-3b2ad1eac275 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:00.751636 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-e18efbe3-f1a3-4f18-9400-3b2ad1eac275 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:00.753290 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1304/2625] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:24:00 2022] DELETE /identity/v3/projects/79c4979ec49849ffb30ae4f324807c9f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:24:00.758975 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bc2f2-5a38-444d-8d10-a8dcd2d232a5 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:00.759441 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bc2f2-5a38-444d-8d10-a8dcd2d232a5 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:00.759539 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bc2f2-5a38-444d-8d10-a8dcd2d232a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:00.780989 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-492bc2f2-5a38-444d-8d10-a8dcd2d232a5 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:24:00.782240 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-492bc2f2-5a38-444d-8d10-a8dcd2d232a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:00.842262 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1322/2626] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:24:00.850215 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b6264-b393-4552-b8b7-fced73f4aaaf None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:00.850513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b6264-b393-4552-b8b7-fced73f4aaaf None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:00.850799 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b6264-b393-4552-b8b7-fced73f4aaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:00.870656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-602b6264-b393-4552-b8b7-fced73f4aaaf None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:24:00.871888 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-602b6264-b393-4552-b8b7-fced73f4aaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:00.879953 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1305/2627] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:24:00.884958 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bc2f2-5a38-444d-8d10-a8dcd2d232a5 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:00.894920 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bc2f2-5a38-444d-8d10-a8dcd2d232a5 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:00.900591 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde70a0-bcb9-44a0-8901-9937a575f22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:00.901265 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde70a0-bcb9-44a0-8901-9937a575f22a admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:00.901555 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde70a0-bcb9-44a0-8901-9937a575f22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:00.901835 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde70a0-bcb9-44a0-8901-9937a575f22a admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:00.902601 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde70a0-bcb9-44a0-8901-9937a575f22a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:24:00.902919 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde70a0-bcb9-44a0-8901-9937a575f22a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:00.904537 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde70a0-bcb9-44a0-8901-9937a575f22a admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:00.916707 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1323/2628] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:24:00.921100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b6264-b393-4552-b8b7-fced73f4aaaf None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:00.931319 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b6264-b393-4552-b8b7-fced73f4aaaf None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:00.936049 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819de13c-773c-4f50-95c7-ee7df38b703c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:00.936708 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819de13c-773c-4f50-95c7-ee7df38b703c admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:00.937004 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819de13c-773c-4f50-95c7-ee7df38b703c admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:00.937345 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819de13c-773c-4f50-95c7-ee7df38b703c admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:00.937977 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819de13c-773c-4f50-95c7-ee7df38b703c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:00.939917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819de13c-773c-4f50-95c7-ee7df38b703c admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:00.970326 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1306/2629] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:24:00 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:24:00.974514 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde70a0-bcb9-44a0-8901-9937a575f22a admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:00.984923 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde70a0-bcb9-44a0-8901-9937a575f22a admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:01.044385 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:01.084296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd2f7d-861c-4884-8e01-eb0a528c325c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:01.084984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd2f7d-861c-4884-8e01-eb0a528c325c admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:01.085274 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd2f7d-861c-4884-8e01-eb0a528c325c admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:01.085555 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd2f7d-861c-4884-8e01-eb0a528c325c admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:01.086331 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd2f7d-861c-4884-8e01-eb0a528c325c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:01.088301 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd2f7d-861c-4884-8e01-eb0a528c325c admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:01.116215 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1324/2630] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:24:00 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:24:01.120234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819de13c-773c-4f50-95c7-ee7df38b703c admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:01.125640 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:01.132618 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819de13c-773c-4f50-95c7-ee7df38b703c admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:01.143087 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5b8ad-1aa2-431f-af81-9608ee8b5e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:01.143087 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5b8ad-1aa2-431f-af81-9608ee8b5e4d admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:01.143087 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5b8ad-1aa2-431f-af81-9608ee8b5e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:01.143087 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5b8ad-1aa2-431f-af81-9608ee8b5e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:01.143593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5b8ad-1aa2-431f-af81-9608ee8b5e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:01.143593 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5b8ad-1aa2-431f-af81-9608ee8b5e4d admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:01.155104 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1307/2631] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:24:01.161776 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd2f7d-861c-4884-8e01-eb0a528c325c admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:01.171937 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd2f7d-861c-4884-8e01-eb0a528c325c admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:01.176710 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a833e34-d1b9-439a-891d-a2e9e8528e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:01.177363 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a833e34-d1b9-439a-891d-a2e9e8528e93 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:01.177648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a833e34-d1b9-439a-891d-a2e9e8528e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:01.178498 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a833e34-d1b9-439a-891d-a2e9e8528e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:01.179231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a833e34-d1b9-439a-891d-a2e9e8528e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:01.180826 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a833e34-d1b9-439a-891d-a2e9e8528e93 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:01.191621 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1325/2632] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:24:01.196581 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5b8ad-1aa2-431f-af81-9608ee8b5e4d admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:01.206916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5b8ad-1aa2-431f-af81-9608ee8b5e4d admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:01.211657 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e4727-ac40-4d14-92f2-37a47a8a838b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:01.212541 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e4727-ac40-4d14-92f2-37a47a8a838b admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:01.212826 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e4727-ac40-4d14-92f2-37a47a8a838b admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:01.213228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e4727-ac40-4d14-92f2-37a47a8a838b admin admin] PATH_INFO: `/v3/projects/32f21dedc48547b7904588af40b08763/users/f107492e7e5945d69a9ca774b49784ad/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:01.231547 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e4727-ac40-4d14-92f2-37a47a8a838b admin admin] RBAC: Authorizing `identity:create_grant(project_id=32f21dedc48547b7904588af40b08763, user_id=f107492e7e5945d69a9ca774b49784ad, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:01.234235 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e4727-ac40-4d14-92f2-37a47a8a838b admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:01.248629 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1308/2633] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:24:01 2022] PUT /identity/v3/projects/32f21dedc48547b7904588af40b08763/users/f107492e7e5945d69a9ca774b49784ad/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:24:01.259870 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990ba0d-89db-4db4-98ed-5a908d363979 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:01.260162 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990ba0d-89db-4db4-98ed-5a908d363979 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:01.260443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990ba0d-89db-4db4-98ed-5a908d363979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:01.287636 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-a990ba0d-89db-4db4-98ed-5a908d363979 None None] MFA Rules not processed for user `f107492e7e5945d69a9ca774b49784ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:24:01.288897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a990ba0d-89db-4db4-98ed-5a908d363979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:01.369816 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1326/2634] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:24:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:24:01.385501 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e4727-ac40-4d14-92f2-37a47a8a838b admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:01.387491 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-8a0e4727-ac40-4d14-92f2-37a47a8a838b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:01.448561 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e4727-ac40-4d14-92f2-37a47a8a838b admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:01.453699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462cf1d-11cb-43cd-bc07-16930ced0aa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:01.454724 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462cf1d-11cb-43cd-bc07-16930ced0aa2 service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:01.455158 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462cf1d-11cb-43cd-bc07-16930ced0aa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:01.455585 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462cf1d-11cb-43cd-bc07-16930ced0aa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:01.466047 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462cf1d-11cb-43cd-bc07-16930ced0aa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:01.467523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462cf1d-11cb-43cd-bc07-16930ced0aa2 service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:01.477689 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1309/2635] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:24:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:24:04.088423 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990ba0d-89db-4db4-98ed-5a908d363979 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:04.148858 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990ba0d-89db-4db4-98ed-5a908d363979 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:04.153266 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a073ab6-c5b4-4407-bec6-f0ed2794c329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:04.154153 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a073ab6-c5b4-4407-bec6-f0ed2794c329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:04.154440 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a073ab6-c5b4-4407-bec6-f0ed2794c329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:04.154716 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a073ab6-c5b4-4407-bec6-f0ed2794c329 admin admin] PATH_INFO: `/v3/users/f107492e7e5945d69a9ca774b49784ad` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:04.155888 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a073ab6-c5b4-4407-bec6-f0ed2794c329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f107492e7e5945d69a9ca774b49784ad)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:04.157788 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a073ab6-c5b4-4407-bec6-f0ed2794c329 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:04.204409 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-6a073ab6-c5b4-4407-bec6-f0ed2794c329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f107492e7e5945d69a9ca774b49784ad'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:04.206061 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:04.212784 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-6a073ab6-c5b4-4407-bec6-f0ed2794c329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f107492e7e5945d69a9ca774b49784ad'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:04.220469 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-6a073ab6-c5b4-4407-bec6-f0ed2794c329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f107492e7e5945d69a9ca774b49784ad'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:04.221120 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-6a073ab6-c5b4-4407-bec6-f0ed2794c329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f107492e7e5945d69a9ca774b49784ad'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:04.233463 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-6a073ab6-c5b4-4407-bec6-f0ed2794c329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f107492e7e5945d69a9ca774b49784ad'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:04.239212 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1327/2636] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:24:04 2022] DELETE /identity/v3/users/f107492e7e5945d69a9ca774b49784ad => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:24:04.243722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c7103-d099-41c8-b567-2acda18ead9c None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:04.244186 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c7103-d099-41c8-b567-2acda18ead9c None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:04.244282 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c7103-d099-41c8-b567-2acda18ead9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:04.262228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-4e1c7103-d099-41c8-b567-2acda18ead9c None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:24:04.263451 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-4e1c7103-d099-41c8-b567-2acda18ead9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:04.322672 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1310/2637] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:24:04.332256 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a073ab6-c5b4-4407-bec6-f0ed2794c329 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:04.333755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-6a073ab6-c5b4-4407-bec6-f0ed2794c329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:04.391604 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a073ab6-c5b4-4407-bec6-f0ed2794c329 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:04.395277 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e09ea9-2a05-46fc-8c2d-41cc1879f7ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:04.395936 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e09ea9-2a05-46fc-8c2d-41cc1879f7ee service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:04.396222 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e09ea9-2a05-46fc-8c2d-41cc1879f7ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:04.396502 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e09ea9-2a05-46fc-8c2d-41cc1879f7ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:04.405811 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e09ea9-2a05-46fc-8c2d-41cc1879f7ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:04.407279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e09ea9-2a05-46fc-8c2d-41cc1879f7ee service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:04.417430 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1328/2638] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:24:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:24:04.701509 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c7103-d099-41c8-b567-2acda18ead9c None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:04.703183 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-4e1c7103-d099-41c8-b567-2acda18ead9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:04.716523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c7103-d099-41c8-b567-2acda18ead9c None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:04.721191 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520173e-a418-4707-a738-258845493bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:04.722078 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520173e-a418-4707-a738-258845493bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:04.722401 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520173e-a418-4707-a738-258845493bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:04.723008 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520173e-a418-4707-a738-258845493bbd admin admin] PATH_INFO: `/v3/projects/32f21dedc48547b7904588af40b08763` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:04.723899 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520173e-a418-4707-a738-258845493bbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=32f21dedc48547b7904588af40b08763)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:04.726652 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520173e-a418-4707-a738-258845493bbd admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:04.778581 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-b520173e-a418-4707-a738-258845493bbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32f21dedc48547b7904588af40b08763', 'request_id': 'req-b520173e-a418-4707-a738-258845493bbd'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:04.786573 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-b520173e-a418-4707-a738-258845493bbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32f21dedc48547b7904588af40b08763', 'request_id': 'req-b520173e-a418-4707-a738-258845493bbd'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:04.795570 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-b520173e-a418-4707-a738-258845493bbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32f21dedc48547b7904588af40b08763', 'request_id': 'req-b520173e-a418-4707-a738-258845493bbd'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:04.802072 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:04.813994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-b520173e-a418-4707-a738-258845493bbd admin admin] The token cache is being invalidate because project 32f21dedc48547b7904588af40b08763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:24:04.814415 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-b520173e-a418-4707-a738-258845493bbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:04.815326 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-b520173e-a418-4707-a738-258845493bbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:04.816904 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1311/2639] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:24:04 2022] DELETE /identity/v3/projects/32f21dedc48547b7904588af40b08763 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:24:04.822574 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1aea74-77dc-427d-a718-1f39b42db9bf None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:04.822859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1aea74-77dc-427d-a718-1f39b42db9bf None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:04.823134 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1aea74-77dc-427d-a718-1f39b42db9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:04.846859 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-9b1aea74-77dc-427d-a718-1f39b42db9bf None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:24:04.848143 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-9b1aea74-77dc-427d-a718-1f39b42db9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:04.912869 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1329/2640] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:24:04.921737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb686b-152f-4c0d-9300-70c116d5d5ee None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:04.922025 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb686b-152f-4c0d-9300-70c116d5d5ee None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:04.922337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb686b-152f-4c0d-9300-70c116d5d5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:04.941075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-38bb686b-152f-4c0d-9300-70c116d5d5ee None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:24:04.942316 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-38bb686b-152f-4c0d-9300-70c116d5d5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:04.952087 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1312/2641] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:24:04.956477 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1aea74-77dc-427d-a718-1f39b42db9bf None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:04.966594 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1aea74-77dc-427d-a718-1f39b42db9bf None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:04.971283 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467991a0-1bfa-4985-97c1-241fe3a1d0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:04.971948 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467991a0-1bfa-4985-97c1-241fe3a1d0be admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:04.972235 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467991a0-1bfa-4985-97c1-241fe3a1d0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:04.972513 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467991a0-1bfa-4985-97c1-241fe3a1d0be admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:04.973298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467991a0-1bfa-4985-97c1-241fe3a1d0be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:24:04.973610 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467991a0-1bfa-4985-97c1-241fe3a1d0be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:04.975335 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467991a0-1bfa-4985-97c1-241fe3a1d0be admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:04.987551 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1330/2642] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:24:04.992496 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb686b-152f-4c0d-9300-70c116d5d5ee None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:05.002789 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb686b-152f-4c0d-9300-70c116d5d5ee None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:05.008721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7752afa-2595-4ce0-ab22-3ddf66d9ab9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:05.009401 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7752afa-2595-4ce0-ab22-3ddf66d9ab9c admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:05.009687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7752afa-2595-4ce0-ab22-3ddf66d9ab9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:05.009986 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7752afa-2595-4ce0-ab22-3ddf66d9ab9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:05.010737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7752afa-2595-4ce0-ab22-3ddf66d9ab9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:05.012642 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7752afa-2595-4ce0-ab22-3ddf66d9ab9c admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:05.038675 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1313/2643] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:24:04 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:24:05.042988 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467991a0-1bfa-4985-97c1-241fe3a1d0be admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:05.053994 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467991a0-1bfa-4985-97c1-241fe3a1d0be admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:05.106411 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:05.113862 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae95e7-480d-4b2f-ad7a-bb4a966cbd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:05.114798 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae95e7-480d-4b2f-ad7a-bb4a966cbd14 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:05.115195 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae95e7-480d-4b2f-ad7a-bb4a966cbd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:05.116172 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae95e7-480d-4b2f-ad7a-bb4a966cbd14 admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:05.117279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae95e7-480d-4b2f-ad7a-bb4a966cbd14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:05.119244 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae95e7-480d-4b2f-ad7a-bb4a966cbd14 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:05.139427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1331/2644] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:24:05 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:24:05.143566 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7752afa-2595-4ce0-ab22-3ddf66d9ab9c admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:05.153931 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7752afa-2595-4ce0-ab22-3ddf66d9ab9c admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:05.158685 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea5cea-02c3-48ec-8b1e-849e75893b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:05.159356 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea5cea-02c3-48ec-8b1e-849e75893b07 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:05.159645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea5cea-02c3-48ec-8b1e-849e75893b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:05.159928 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea5cea-02c3-48ec-8b1e-849e75893b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:05.160661 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea5cea-02c3-48ec-8b1e-849e75893b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:05.162786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea5cea-02c3-48ec-8b1e-849e75893b07 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:05.173600 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1314/2645] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:24:05.178375 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae95e7-480d-4b2f-ad7a-bb4a966cbd14 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:05.188750 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae95e7-480d-4b2f-ad7a-bb4a966cbd14 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:05.194080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa90ddf-6ce6-4a6f-b2bb-dc3cc767de8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:05.194791 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa90ddf-6ce6-4a6f-b2bb-dc3cc767de8d admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:05.195079 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa90ddf-6ce6-4a6f-b2bb-dc3cc767de8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:05.195359 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa90ddf-6ce6-4a6f-b2bb-dc3cc767de8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:05.196088 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa90ddf-6ce6-4a6f-b2bb-dc3cc767de8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:05.197691 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa90ddf-6ce6-4a6f-b2bb-dc3cc767de8d admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:05.207975 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1332/2646] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:24:05.212166 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea5cea-02c3-48ec-8b1e-849e75893b07 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:05.222241 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea5cea-02c3-48ec-8b1e-849e75893b07 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:05.227294 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87873b64-62dc-4d0b-9440-7d64c511ac0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:05.228173 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87873b64-62dc-4d0b-9440-7d64c511ac0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:05.228458 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87873b64-62dc-4d0b-9440-7d64c511ac0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:05.228734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87873b64-62dc-4d0b-9440-7d64c511ac0c admin admin] PATH_INFO: `/v3/projects/5914dcc23b444f5293c33646e28df089/users/a9a7c49fe8994ac18ffa55ca552afb6b/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:05.243537 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87873b64-62dc-4d0b-9440-7d64c511ac0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5914dcc23b444f5293c33646e28df089, user_id=a9a7c49fe8994ac18ffa55ca552afb6b, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:05.246190 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87873b64-62dc-4d0b-9440-7d64c511ac0c admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:05.260060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1315/2647] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:24:05 2022] PUT /identity/v3/projects/5914dcc23b444f5293c33646e28df089/users/a9a7c49fe8994ac18ffa55ca552afb6b/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:24:05.323721 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7730803-77ac-43b8-815e-afba68b9b187 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:05.324015 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7730803-77ac-43b8-815e-afba68b9b187 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:05.324295 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7730803-77ac-43b8-815e-afba68b9b187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:05.350670 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-c7730803-77ac-43b8-815e-afba68b9b187 None None] MFA Rules not processed for user `a9a7c49fe8994ac18ffa55ca552afb6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:24:05.351884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-c7730803-77ac-43b8-815e-afba68b9b187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:05.414635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1333/2648] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:24:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:24:05.425706 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87873b64-62dc-4d0b-9440-7d64c511ac0c admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:05.427437 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-87873b64-62dc-4d0b-9440-7d64c511ac0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:05.484114 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87873b64-62dc-4d0b-9440-7d64c511ac0c admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:05.487785 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67deec34-762e-4d26-b962-accb79272082 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:05.488432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67deec34-762e-4d26-b962-accb79272082 service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:05.488719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67deec34-762e-4d26-b962-accb79272082 service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:05.488996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67deec34-762e-4d26-b962-accb79272082 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:05.497950 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67deec34-762e-4d26-b962-accb79272082 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:05.499420 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67deec34-762e-4d26-b962-accb79272082 service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:05.509406 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1316/2649] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:24:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:24:05.550491 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7730803-77ac-43b8-815e-afba68b9b187 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:05.612289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7730803-77ac-43b8-815e-afba68b9b187 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:05.617356 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dd420-87c5-467a-8617-04901a8737a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:05.618252 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dd420-87c5-467a-8617-04901a8737a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:05.618539 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dd420-87c5-467a-8617-04901a8737a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:05.618815 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dd420-87c5-467a-8617-04901a8737a8 admin admin] PATH_INFO: `/v3/users/a9a7c49fe8994ac18ffa55ca552afb6b` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:05.620008 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8dd420-87c5-467a-8617-04901a8737a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9a7c49fe8994ac18ffa55ca552afb6b)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:05.621940 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8dd420-87c5-467a-8617-04901a8737a8 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:05.668799 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-3b8dd420-87c5-467a-8617-04901a8737a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9a7c49fe8994ac18ffa55ca552afb6b'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:05.675953 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-3b8dd420-87c5-467a-8617-04901a8737a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9a7c49fe8994ac18ffa55ca552afb6b'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:05.683596 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-3b8dd420-87c5-467a-8617-04901a8737a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9a7c49fe8994ac18ffa55ca552afb6b'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:05.684286 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-3b8dd420-87c5-467a-8617-04901a8737a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9a7c49fe8994ac18ffa55ca552afb6b'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:05.686285 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:05.698978 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-3b8dd420-87c5-467a-8617-04901a8737a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9a7c49fe8994ac18ffa55ca552afb6b'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:05.705116 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1334/2650] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:24:05 2022] DELETE /identity/v3/users/a9a7c49fe8994ac18ffa55ca552afb6b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:24:05.709637 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66275a9c-ff6b-4357-8f61-51d9deb79390 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:05.709928 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66275a9c-ff6b-4357-8f61-51d9deb79390 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:05.710241 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66275a9c-ff6b-4357-8f61-51d9deb79390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:05.727346 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-66275a9c-ff6b-4357-8f61-51d9deb79390 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:24:05.728545 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-66275a9c-ff6b-4357-8f61-51d9deb79390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:05.789626 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1317/2651] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:24:05.799365 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dd420-87c5-467a-8617-04901a8737a8 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:05.800821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-3b8dd420-87c5-467a-8617-04901a8737a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:05.863521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dd420-87c5-467a-8617-04901a8737a8 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:05.867563 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b484deb-36e8-47ef-bac1-01e924a87e36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:05.868221 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b484deb-36e8-47ef-bac1-01e924a87e36 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:05.868534 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b484deb-36e8-47ef-bac1-01e924a87e36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:05.868815 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b484deb-36e8-47ef-bac1-01e924a87e36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:05.878332 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b484deb-36e8-47ef-bac1-01e924a87e36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:05.879842 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b484deb-36e8-47ef-bac1-01e924a87e36 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:05.890965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1335/2652] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:24:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:24:06.184476 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66275a9c-ff6b-4357-8f61-51d9deb79390 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:06.186783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-66275a9c-ff6b-4357-8f61-51d9deb79390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:06.201927 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66275a9c-ff6b-4357-8f61-51d9deb79390 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:06.206925 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da5f5d-4bc4-47c3-8aa7-ba2707fcfb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:06.207810 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da5f5d-4bc4-47c3-8aa7-ba2707fcfb80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:06.208099 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da5f5d-4bc4-47c3-8aa7-ba2707fcfb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:06.208379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da5f5d-4bc4-47c3-8aa7-ba2707fcfb80 admin admin] PATH_INFO: `/v3/projects/5914dcc23b444f5293c33646e28df089` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:06.209590 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da5f5d-4bc4-47c3-8aa7-ba2707fcfb80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5914dcc23b444f5293c33646e28df089)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:06.212379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da5f5d-4bc4-47c3-8aa7-ba2707fcfb80 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:06.248147 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:06.266323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-09da5f5d-4bc4-47c3-8aa7-ba2707fcfb80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5914dcc23b444f5293c33646e28df089', 'request_id': 'req-09da5f5d-4bc4-47c3-8aa7-ba2707fcfb80'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:06.272671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-09da5f5d-4bc4-47c3-8aa7-ba2707fcfb80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5914dcc23b444f5293c33646e28df089', 'request_id': 'req-09da5f5d-4bc4-47c3-8aa7-ba2707fcfb80'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:06.280335 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-09da5f5d-4bc4-47c3-8aa7-ba2707fcfb80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5914dcc23b444f5293c33646e28df089', 'request_id': 'req-09da5f5d-4bc4-47c3-8aa7-ba2707fcfb80'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:06.290547 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-09da5f5d-4bc4-47c3-8aa7-ba2707fcfb80 admin admin] The token cache is being invalidate because project 5914dcc23b444f5293c33646e28df089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:24:06.290838 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-09da5f5d-4bc4-47c3-8aa7-ba2707fcfb80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:06.291479 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-09da5f5d-4bc4-47c3-8aa7-ba2707fcfb80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:06.293105 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1318/2653] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:24:06 2022] DELETE /identity/v3/projects/5914dcc23b444f5293c33646e28df089 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:24:15.886997 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=32,keystone:DELETE=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:16.287674 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=14,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:18.851870 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b484deb-36e8-47ef-bac1-01e924a87e36 service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:18.853743 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-4b484deb-36e8-47ef-bac1-01e924a87e36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:18.867786 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b484deb-36e8-47ef-bac1-01e924a87e36 service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:18.929550 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23acc90-e860-47d1-aebb-beb7983fd042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:18.930476 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23acc90-e860-47d1-aebb-beb7983fd042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:18.930757 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23acc90-e860-47d1-aebb-beb7983fd042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:18.931037 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23acc90-e860-47d1-aebb-beb7983fd042 admin admin] PATH_INFO: `/v3/users/e4bf4aabc8df4ac091dbf1f41df8d3a8` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:18.932416 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23acc90-e860-47d1-aebb-beb7983fd042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4bf4aabc8df4ac091dbf1f41df8d3a8)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:18.934511 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23acc90-e860-47d1-aebb-beb7983fd042 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:18.979904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f23acc90-e860-47d1-aebb-beb7983fd042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4bf4aabc8df4ac091dbf1f41df8d3a8'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:18.986396 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f23acc90-e860-47d1-aebb-beb7983fd042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4bf4aabc8df4ac091dbf1f41df8d3a8'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:18.993732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f23acc90-e860-47d1-aebb-beb7983fd042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4bf4aabc8df4ac091dbf1f41df8d3a8'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:18.994402 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f23acc90-e860-47d1-aebb-beb7983fd042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4bf4aabc8df4ac091dbf1f41df8d3a8'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:19.007049 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f23acc90-e860-47d1-aebb-beb7983fd042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4bf4aabc8df4ac091dbf1f41df8d3a8'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:19.012872 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1336/2654] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:24:18 2022] DELETE /identity/v3/users/e4bf4aabc8df4ac091dbf1f41df8d3a8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:24:19.183137 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da5f5d-4bc4-47c3-8aa7-ba2707fcfb80 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:19.184634 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-09da5f5d-4bc4-47c3-8aa7-ba2707fcfb80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:19.202397 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da5f5d-4bc4-47c3-8aa7-ba2707fcfb80 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:19.259645 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006756a0-97fb-402f-a31a-4700beee8656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:19.260563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006756a0-97fb-402f-a31a-4700beee8656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:19.260869 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006756a0-97fb-402f-a31a-4700beee8656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:19.261254 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006756a0-97fb-402f-a31a-4700beee8656 admin admin] PATH_INFO: `/v3/projects/8bd573b761e44f6687675ed879df5b65` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:19.262489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006756a0-97fb-402f-a31a-4700beee8656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bd573b761e44f6687675ed879df5b65)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:19.264403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006756a0-97fb-402f-a31a-4700beee8656 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:19.311679 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-006756a0-97fb-402f-a31a-4700beee8656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bd573b761e44f6687675ed879df5b65', 'request_id': 'req-006756a0-97fb-402f-a31a-4700beee8656'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:19.317870 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-006756a0-97fb-402f-a31a-4700beee8656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bd573b761e44f6687675ed879df5b65', 'request_id': 'req-006756a0-97fb-402f-a31a-4700beee8656'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:19.326439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-006756a0-97fb-402f-a31a-4700beee8656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bd573b761e44f6687675ed879df5b65', 'request_id': 'req-006756a0-97fb-402f-a31a-4700beee8656'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:19.336843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-006756a0-97fb-402f-a31a-4700beee8656 admin admin] The token cache is being invalidate because project 8bd573b761e44f6687675ed879df5b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:24:19.337129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-006756a0-97fb-402f-a31a-4700beee8656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:19.337759 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-006756a0-97fb-402f-a31a-4700beee8656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:19.339306 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1319/2655] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:24:19 2022] DELETE /identity/v3/projects/8bd573b761e44f6687675ed879df5b65 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:24:19.343276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23acc90-e860-47d1-aebb-beb7983fd042 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:19.344690 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-f23acc90-e860-47d1-aebb-beb7983fd042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:19.357719 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23acc90-e860-47d1-aebb-beb7983fd042 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:19.413987 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f268d5-e0a9-4858-ad6f-96dad0eff5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:19.414947 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f268d5-e0a9-4858-ad6f-96dad0eff5e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:19.415275 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f268d5-e0a9-4858-ad6f-96dad0eff5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:19.415556 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f268d5-e0a9-4858-ad6f-96dad0eff5e0 admin admin] PATH_INFO: `/v3/users/fcf80b58a66641ceb5400dfa026f371f` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:19.416748 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f268d5-e0a9-4858-ad6f-96dad0eff5e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcf80b58a66641ceb5400dfa026f371f)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:19.418703 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f268d5-e0a9-4858-ad6f-96dad0eff5e0 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:19.440151 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:19.464114 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-c9f268d5-e0a9-4858-ad6f-96dad0eff5e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcf80b58a66641ceb5400dfa026f371f'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:19.471384 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-c9f268d5-e0a9-4858-ad6f-96dad0eff5e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcf80b58a66641ceb5400dfa026f371f'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:19.478942 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-c9f268d5-e0a9-4858-ad6f-96dad0eff5e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcf80b58a66641ceb5400dfa026f371f'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:19.479583 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-c9f268d5-e0a9-4858-ad6f-96dad0eff5e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcf80b58a66641ceb5400dfa026f371f'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:19.491978 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-c9f268d5-e0a9-4858-ad6f-96dad0eff5e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcf80b58a66641ceb5400dfa026f371f'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:19.497858 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1337/2656] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:24:19 2022] DELETE /identity/v3/users/fcf80b58a66641ceb5400dfa026f371f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:24:19.676539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006756a0-97fb-402f-a31a-4700beee8656 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:19.678807 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-006756a0-97fb-402f-a31a-4700beee8656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:19.694198 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006756a0-97fb-402f-a31a-4700beee8656 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:19.752062 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918ec35-d975-447a-bf73-47a2eb48579d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:19.752923 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918ec35-d975-447a-bf73-47a2eb48579d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:19.753206 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918ec35-d975-447a-bf73-47a2eb48579d admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:19.753481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918ec35-d975-447a-bf73-47a2eb48579d admin admin] PATH_INFO: `/v3/projects/3001be2de1a342a9ae3c875fbc611c75` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:19.754673 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918ec35-d975-447a-bf73-47a2eb48579d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3001be2de1a342a9ae3c875fbc611c75)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:19.756847 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918ec35-d975-447a-bf73-47a2eb48579d admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:19.791152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:19.804591 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-3918ec35-d975-447a-bf73-47a2eb48579d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3001be2de1a342a9ae3c875fbc611c75', 'request_id': 'req-3918ec35-d975-447a-bf73-47a2eb48579d'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:19.810613 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-3918ec35-d975-447a-bf73-47a2eb48579d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3001be2de1a342a9ae3c875fbc611c75', 'request_id': 'req-3918ec35-d975-447a-bf73-47a2eb48579d'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:19.817797 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-3918ec35-d975-447a-bf73-47a2eb48579d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3001be2de1a342a9ae3c875fbc611c75', 'request_id': 'req-3918ec35-d975-447a-bf73-47a2eb48579d'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:19.827783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-3918ec35-d975-447a-bf73-47a2eb48579d admin admin] The token cache is being invalidate because project 3001be2de1a342a9ae3c875fbc611c75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:24:19.828068 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-3918ec35-d975-447a-bf73-47a2eb48579d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:19.828700 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-3918ec35-d975-447a-bf73-47a2eb48579d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:19.830253 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1320/2657] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:24:19 2022] DELETE /identity/v3/projects/3001be2de1a342a9ae3c875fbc611c75 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:24:19.835568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117506a8-5455-4d99-8227-b31d5db57c3f None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:19.835876 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117506a8-5455-4d99-8227-b31d5db57c3f None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:19.836155 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117506a8-5455-4d99-8227-b31d5db57c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:19.854715 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-117506a8-5455-4d99-8227-b31d5db57c3f None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:24:19.856040 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-117506a8-5455-4d99-8227-b31d5db57c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:19.914252 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1338/2658] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:24:19.921956 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93189ffa-a696-4e37-9250-6f7a9a442359 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:19.922275 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93189ffa-a696-4e37-9250-6f7a9a442359 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:19.922551 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93189ffa-a696-4e37-9250-6f7a9a442359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:19.940424 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-93189ffa-a696-4e37-9250-6f7a9a442359 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:24:19.941619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-93189ffa-a696-4e37-9250-6f7a9a442359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:19.949395 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1321/2659] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:24:19.953610 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117506a8-5455-4d99-8227-b31d5db57c3f None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:19.964059 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117506a8-5455-4d99-8227-b31d5db57c3f None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:19.968774 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead081c-6cd1-47e7-8d7d-198aee79fc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:19.969438 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead081c-6cd1-47e7-8d7d-198aee79fc31 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:19.969724 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead081c-6cd1-47e7-8d7d-198aee79fc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:19.970022 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead081c-6cd1-47e7-8d7d-198aee79fc31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:19.970806 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead081c-6cd1-47e7-8d7d-198aee79fc31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:24:19.971113 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead081c-6cd1-47e7-8d7d-198aee79fc31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:19.972728 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead081c-6cd1-47e7-8d7d-198aee79fc31 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:19.985084 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1339/2660] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:24:19.989319 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93189ffa-a696-4e37-9250-6f7a9a442359 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:19.998514 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93189ffa-a696-4e37-9250-6f7a9a442359 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:20.003155 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7879a0d-b109-4264-aa36-0b91d62000ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:20.003802 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7879a0d-b109-4264-aa36-0b91d62000ea admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:20.004083 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7879a0d-b109-4264-aa36-0b91d62000ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:20.004358 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7879a0d-b109-4264-aa36-0b91d62000ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:20.005046 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7879a0d-b109-4264-aa36-0b91d62000ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:20.007232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7879a0d-b109-4264-aa36-0b91d62000ea admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:20.032190 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1322/2661] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:24:19 2022] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:24:20.036365 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead081c-6cd1-47e7-8d7d-198aee79fc31 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:20.046865 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead081c-6cd1-47e7-8d7d-198aee79fc31 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:20.103523 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60415779-0307-4d73-9725-eb68308460a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:20.104121 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60415779-0307-4d73-9725-eb68308460a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:20.104446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60415779-0307-4d73-9725-eb68308460a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:20.104724 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60415779-0307-4d73-9725-eb68308460a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:20.105432 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60415779-0307-4d73-9725-eb68308460a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:20.107393 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60415779-0307-4d73-9725-eb68308460a6 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:20.128110 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1340/2662] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:24:20 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:24:20.135160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7879a0d-b109-4264-aa36-0b91d62000ea admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:20.145403 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7879a0d-b109-4264-aa36-0b91d62000ea admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:20.150771 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11a4a2-17e3-4c71-985a-bc803fbb136d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:20.151436 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11a4a2-17e3-4c71-985a-bc803fbb136d admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:20.151722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11a4a2-17e3-4c71-985a-bc803fbb136d admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:20.151997 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11a4a2-17e3-4c71-985a-bc803fbb136d admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:20.152717 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11a4a2-17e3-4c71-985a-bc803fbb136d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:20.154331 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11a4a2-17e3-4c71-985a-bc803fbb136d admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:20.164815 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1323/2663] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:24:20.168766 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60415779-0307-4d73-9725-eb68308460a6 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:20.179376 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60415779-0307-4d73-9725-eb68308460a6 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:20.184060 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35c7c9-b118-48f7-96ce-7dee6f516d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:20.184750 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35c7c9-b118-48f7-96ce-7dee6f516d83 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:20.185032 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35c7c9-b118-48f7-96ce-7dee6f516d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:20.185306 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35c7c9-b118-48f7-96ce-7dee6f516d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:20.186032 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35c7c9-b118-48f7-96ce-7dee6f516d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:20.187644 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35c7c9-b118-48f7-96ce-7dee6f516d83 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:20.198200 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1341/2664] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:24:20.202466 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11a4a2-17e3-4c71-985a-bc803fbb136d admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:20.213375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11a4a2-17e3-4c71-985a-bc803fbb136d admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:20.218180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da424c-7c59-4640-b61e-02fdf11bc09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:20.219071 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da424c-7c59-4640-b61e-02fdf11bc09f admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:20.219355 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da424c-7c59-4640-b61e-02fdf11bc09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:20.219633 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da424c-7c59-4640-b61e-02fdf11bc09f admin admin] PATH_INFO: `/v3/projects/5aea993f963747dfba56ac94784df418/users/564ac90b4e9d4e4cbdd0cd53204b6ebe/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:20.234048 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da424c-7c59-4640-b61e-02fdf11bc09f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aea993f963747dfba56ac94784df418, user_id=564ac90b4e9d4e4cbdd0cd53204b6ebe, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:20.236719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da424c-7c59-4640-b61e-02fdf11bc09f admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:20.249277 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1324/2665] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:24:20 2022] PUT /identity/v3/projects/5aea993f963747dfba56ac94784df418/users/564ac90b4e9d4e4cbdd0cd53204b6ebe/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:24:20.260858 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53a456-6940-4fb3-9768-dc08b1294e79 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:20.261154 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53a456-6940-4fb3-9768-dc08b1294e79 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:20.261435 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53a456-6940-4fb3-9768-dc08b1294e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:20.268150 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:20.289092 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-1b53a456-6940-4fb3-9768-dc08b1294e79 None None] MFA Rules not processed for user `564ac90b4e9d4e4cbdd0cd53204b6ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:24:20.290348 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-1b53a456-6940-4fb3-9768-dc08b1294e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:20.353096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1342/2666] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:24:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:24:20.364909 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da424c-7c59-4640-b61e-02fdf11bc09f admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:20.366686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-91da424c-7c59-4640-b61e-02fdf11bc09f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:20.423582 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da424c-7c59-4640-b61e-02fdf11bc09f admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:20.427805 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872d5fd-2ccc-4016-b026-a4cb1c4512a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7af0259f7f24dfdafbdfc1f613ebb42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:20.428456 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872d5fd-2ccc-4016-b026-a4cb1c4512a4 service glance] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:20.428742 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872d5fd-2ccc-4016-b026-a4cb1c4512a4 service glance] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:20.429027 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872d5fd-2ccc-4016-b026-a4cb1c4512a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:20.437374 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872d5fd-2ccc-4016-b026-a4cb1c4512a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:20.438828 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872d5fd-2ccc-4016-b026-a4cb1c4512a4 service glance] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:20.447562 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1325/2667] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:24:20 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:24:30.350179 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=30 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:30.443573 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=65,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:38.997312 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53a456-6940-4fb3-9768-dc08b1294e79 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:38.998762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-1b53a456-6940-4fb3-9768-dc08b1294e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:39.059527 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53a456-6940-4fb3-9768-dc08b1294e79 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:39.068388 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fca025-d481-4d72-aa6d-7c88256e7136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:39.069058 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fca025-d481-4d72-aa6d-7c88256e7136 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:39.069343 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fca025-d481-4d72-aa6d-7c88256e7136 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:39.069624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fca025-d481-4d72-aa6d-7c88256e7136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:39.071444 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-36fca025-d481-4d72-aa6d-7c88256e7136 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:39.135605 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fca025-d481-4d72-aa6d-7c88256e7136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:39.137053 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fca025-d481-4d72-aa6d-7c88256e7136 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:39.147490 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1343/2668] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:24:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:24:42.421555 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872d5fd-2ccc-4016-b026-a4cb1c4512a4 service glance] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:42.423093 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-9872d5fd-2ccc-4016-b026-a4cb1c4512a4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:42.439087 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872d5fd-2ccc-4016-b026-a4cb1c4512a4 service glance] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:42.444970 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d5813-b0b7-40e1-8284-cac9b22af1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:42.445854 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d5813-b0b7-40e1-8284-cac9b22af1f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:42.446161 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d5813-b0b7-40e1-8284-cac9b22af1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:42.446442 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d5813-b0b7-40e1-8284-cac9b22af1f3 admin admin] PATH_INFO: `/v3/users/4b2049d18bab4b0794d47cea6c7bf323` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:42.448009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d5813-b0b7-40e1-8284-cac9b22af1f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b2049d18bab4b0794d47cea6c7bf323)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:42.450066 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d5813-b0b7-40e1-8284-cac9b22af1f3 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:42.503336 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-127d5813-b0b7-40e1-8284-cac9b22af1f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b2049d18bab4b0794d47cea6c7bf323'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:42.504129 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-127d5813-b0b7-40e1-8284-cac9b22af1f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b2049d18bab4b0794d47cea6c7bf323'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:42.519513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-127d5813-b0b7-40e1-8284-cac9b22af1f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b2049d18bab4b0794d47cea6c7bf323'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:42.527461 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-127d5813-b0b7-40e1-8284-cac9b22af1f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b2049d18bab4b0794d47cea6c7bf323'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:42.546062 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-127d5813-b0b7-40e1-8284-cac9b22af1f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b2049d18bab4b0794d47cea6c7bf323'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:42.553695 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1326/2669] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:24:42 2022] DELETE /identity/v3/users/4b2049d18bab4b0794d47cea6c7bf323 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:24:42.731549 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fca025-d481-4d72-aa6d-7c88256e7136 service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:42.748906 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fca025-d481-4d72-aa6d-7c88256e7136 service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:42.808075 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b9eeb-ffbe-4a22-8a77-2dba5cb0b391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:42.808948 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b9eeb-ffbe-4a22-8a77-2dba5cb0b391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:42.809234 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b9eeb-ffbe-4a22-8a77-2dba5cb0b391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:42.809511 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b9eeb-ffbe-4a22-8a77-2dba5cb0b391 admin admin] PATH_INFO: `/v3/projects/dfb63660feb942a3ba917a389f7a2b3f` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:42.810732 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b9eeb-ffbe-4a22-8a77-2dba5cb0b391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfb63660feb942a3ba917a389f7a2b3f)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:42.812652 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b9eeb-ffbe-4a22-8a77-2dba5cb0b391 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:42.860532 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-059b9eeb-ffbe-4a22-8a77-2dba5cb0b391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfb63660feb942a3ba917a389f7a2b3f', 'request_id': 'req-059b9eeb-ffbe-4a22-8a77-2dba5cb0b391'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:42.862339 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:42.867519 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-059b9eeb-ffbe-4a22-8a77-2dba5cb0b391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfb63660feb942a3ba917a389f7a2b3f', 'request_id': 'req-059b9eeb-ffbe-4a22-8a77-2dba5cb0b391'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:42.874541 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-059b9eeb-ffbe-4a22-8a77-2dba5cb0b391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfb63660feb942a3ba917a389f7a2b3f', 'request_id': 'req-059b9eeb-ffbe-4a22-8a77-2dba5cb0b391'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:42.885372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-059b9eeb-ffbe-4a22-8a77-2dba5cb0b391 admin admin] The token cache is being invalidate because project dfb63660feb942a3ba917a389f7a2b3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:24:42.885663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-059b9eeb-ffbe-4a22-8a77-2dba5cb0b391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:42.886325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-059b9eeb-ffbe-4a22-8a77-2dba5cb0b391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:42.887869 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1344/2670] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:24:42 2022] DELETE /identity/v3/projects/dfb63660feb942a3ba917a389f7a2b3f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:24:42.892797 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a295f29-62b4-4338-9c8b-aaef6061ea76 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:42.893086 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a295f29-62b4-4338-9c8b-aaef6061ea76 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:42.893366 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a295f29-62b4-4338-9c8b-aaef6061ea76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:42.912784 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-1a295f29-62b4-4338-9c8b-aaef6061ea76 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:24:42.913911 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-1a295f29-62b4-4338-9c8b-aaef6061ea76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:42.974248 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1327/2671] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:24:42.981872 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29c665-5eb7-4e10-99b3-fa208de65931 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:42.982189 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29c665-5eb7-4e10-99b3-fa208de65931 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:42.982475 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29c665-5eb7-4e10-99b3-fa208de65931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:43.000507 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-ef29c665-5eb7-4e10-99b3-fa208de65931 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:24:43.001713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-ef29c665-5eb7-4e10-99b3-fa208de65931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:43.009807 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1345/2672] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:24:43.013964 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a295f29-62b4-4338-9c8b-aaef6061ea76 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:43.024172 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a295f29-62b4-4338-9c8b-aaef6061ea76 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:43.028758 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b99f5a-ffe5-4171-a938-1f1f3fce5b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:43.029418 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b99f5a-ffe5-4171-a938-1f1f3fce5b5f admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:43.029699 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b99f5a-ffe5-4171-a938-1f1f3fce5b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:43.029974 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b99f5a-ffe5-4171-a938-1f1f3fce5b5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:43.030728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b99f5a-ffe5-4171-a938-1f1f3fce5b5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:24:43.031062 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b99f5a-ffe5-4171-a938-1f1f3fce5b5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:43.032651 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b99f5a-ffe5-4171-a938-1f1f3fce5b5f admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:43.045310 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1328/2673] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:24:43.049674 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29c665-5eb7-4e10-99b3-fa208de65931 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:43.059091 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29c665-5eb7-4e10-99b3-fa208de65931 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:43.063742 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b61a7-2618-45a4-b5c6-1a753e6fbcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:43.064400 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b61a7-2618-45a4-b5c6-1a753e6fbcf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:43.064690 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b61a7-2618-45a4-b5c6-1a753e6fbcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:43.064973 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b61a7-2618-45a4-b5c6-1a753e6fbcf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:43.065661 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b61a7-2618-45a4-b5c6-1a753e6fbcf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:43.067605 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b61a7-2618-45a4-b5c6-1a753e6fbcf8 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:43.093131 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1346/2674] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:24:43 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:24:43.097552 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b99f5a-ffe5-4171-a938-1f1f3fce5b5f admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:43.108255 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b99f5a-ffe5-4171-a938-1f1f3fce5b5f admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:43.165061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5939c-5972-4efd-96eb-a3c50a65b212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:43.165659 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5939c-5972-4efd-96eb-a3c50a65b212 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:43.165949 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5939c-5972-4efd-96eb-a3c50a65b212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:43.166262 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5939c-5972-4efd-96eb-a3c50a65b212 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:43.166959 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5939c-5972-4efd-96eb-a3c50a65b212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:43.168888 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5939c-5972-4efd-96eb-a3c50a65b212 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:43.175690 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:43.190909 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1329/2675] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:24:43 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:24:43.197305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b61a7-2618-45a4-b5c6-1a753e6fbcf8 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:43.207719 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b61a7-2618-45a4-b5c6-1a753e6fbcf8 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:43.212352 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0dfebb-226a-4a8b-9355-4bb11d84771e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:43.213019 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dfebb-226a-4a8b-9355-4bb11d84771e admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:43.213308 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dfebb-226a-4a8b-9355-4bb11d84771e admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:43.213585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dfebb-226a-4a8b-9355-4bb11d84771e admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:43.214346 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0dfebb-226a-4a8b-9355-4bb11d84771e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:43.215951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0dfebb-226a-4a8b-9355-4bb11d84771e admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:43.226383 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1347/2676] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:24:43.230524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5939c-5972-4efd-96eb-a3c50a65b212 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:43.241423 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5939c-5972-4efd-96eb-a3c50a65b212 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:43.246280 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4f6cd-ac30-4be6-b4d5-e735c0811463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:43.246939 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4f6cd-ac30-4be6-b4d5-e735c0811463 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:43.247224 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4f6cd-ac30-4be6-b4d5-e735c0811463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:43.247500 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4f6cd-ac30-4be6-b4d5-e735c0811463 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:43.248213 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4f6cd-ac30-4be6-b4d5-e735c0811463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:43.249797 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4f6cd-ac30-4be6-b4d5-e735c0811463 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:43.260519 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1330/2677] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:24:43.264664 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0dfebb-226a-4a8b-9355-4bb11d84771e admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:43.274834 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0dfebb-226a-4a8b-9355-4bb11d84771e admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:43.279455 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dff6de-e74a-4387-bd34-9486d54e0d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:43.280345 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dff6de-e74a-4387-bd34-9486d54e0d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:43.280629 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dff6de-e74a-4387-bd34-9486d54e0d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:43.280904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dff6de-e74a-4387-bd34-9486d54e0d5a admin admin] PATH_INFO: `/v3/projects/d7f403a6f07d45fcad2d7f18d9b6b5d2/users/a783f2d57f0c47dfbd6f187ff93f8ca9/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:43.296326 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dff6de-e74a-4387-bd34-9486d54e0d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7f403a6f07d45fcad2d7f18d9b6b5d2, user_id=a783f2d57f0c47dfbd6f187ff93f8ca9, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:43.299015 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dff6de-e74a-4387-bd34-9486d54e0d5a admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:43.312623 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1348/2678] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:24:43 2022] PUT /identity/v3/projects/d7f403a6f07d45fcad2d7f18d9b6b5d2/users/a783f2d57f0c47dfbd6f187ff93f8ca9/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:24:43.323687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0dd781-3966-4ced-ac20-1f69cbac5f26 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:43.323982 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0dd781-3966-4ced-ac20-1f69cbac5f26 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:43.324261 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0dd781-3966-4ced-ac20-1f69cbac5f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:43.335975 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dff6de-e74a-4387-bd34-9486d54e0d5a admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:43.337684 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-86dff6de-e74a-4387-bd34-9486d54e0d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:43.355670 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-8a0dd781-3966-4ced-ac20-1f69cbac5f26 None None] MFA Rules not processed for user `a783f2d57f0c47dfbd6f187ff93f8ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:24:43.356917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-8a0dd781-3966-4ced-ac20-1f69cbac5f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:43.405861 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dff6de-e74a-4387-bd34-9486d54e0d5a admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:43.410773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba065a-0d99-4967-bed4-707d3c1a5e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:43.412190 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba065a-0d99-4967-bed4-707d3c1a5e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:43.412472 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba065a-0d99-4967-bed4-707d3c1a5e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:43.412747 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba065a-0d99-4967-bed4-707d3c1a5e9f admin admin] PATH_INFO: `/v3/users/564ac90b4e9d4e4cbdd0cd53204b6ebe` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:43.413946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba065a-0d99-4967-bed4-707d3c1a5e9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=564ac90b4e9d4e4cbdd0cd53204b6ebe)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:43.415998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba065a-0d99-4967-bed4-707d3c1a5e9f admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:43.425962 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1331/2679] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:24:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:24:43.430968 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0dd781-3966-4ced-ac20-1f69cbac5f26 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:43.441576 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0dd781-3966-4ced-ac20-1f69cbac5f26 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:43.446849 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56386f1f-55f7-44e1-8c25-4a6a0fa0fbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:43.447587 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56386f1f-55f7-44e1-8c25-4a6a0fa0fbe6 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:43.447898 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56386f1f-55f7-44e1-8c25-4a6a0fa0fbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:43.448205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56386f1f-55f7-44e1-8c25-4a6a0fa0fbe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:43.448927 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56386f1f-55f7-44e1-8c25-4a6a0fa0fbe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:43.450939 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56386f1f-55f7-44e1-8c25-4a6a0fa0fbe6 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:43.468586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f1ba065a-0d99-4967-bed4-707d3c1a5e9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '564ac90b4e9d4e4cbdd0cd53204b6ebe'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:43.477892 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f1ba065a-0d99-4967-bed4-707d3c1a5e9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '564ac90b4e9d4e4cbdd0cd53204b6ebe'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:43.479756 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1332/2680] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:24:43 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:24:43.483844 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56386f1f-55f7-44e1-8c25-4a6a0fa0fbe6 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:43.487980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f1ba065a-0d99-4967-bed4-707d3c1a5e9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '564ac90b4e9d4e4cbdd0cd53204b6ebe'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:43.488799 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f1ba065a-0d99-4967-bed4-707d3c1a5e9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '564ac90b4e9d4e4cbdd0cd53204b6ebe'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:43.502886 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f1ba065a-0d99-4967-bed4-707d3c1a5e9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '564ac90b4e9d4e4cbdd0cd53204b6ebe'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:43.503927 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=83,keystone:INSERT=4,keystone:DELETE=13 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:43.512823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1349/2681] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:24:43 2022] DELETE /identity/v3/users/564ac90b4e9d4e4cbdd0cd53204b6ebe => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:24:43.517529 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a8fa0-59de-4409-b30c-51ded55231ab None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:43.517929 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a8fa0-59de-4409-b30c-51ded55231ab None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:43.518321 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a8fa0-59de-4409-b30c-51ded55231ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:43.536298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-656a8fa0-59de-4409-b30c-51ded55231ab None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:24:43.537628 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-656a8fa0-59de-4409-b30c-51ded55231ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:43.552092 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56386f1f-55f7-44e1-8c25-4a6a0fa0fbe6 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:43.600294 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:43.604198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1350/2682] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:24:43.611121 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a8fa0-59de-4409-b30c-51ded55231ab None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:43.612749 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-656a8fa0-59de-4409-b30c-51ded55231ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:43.613840 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af98698-4f75-4877-b492-f85cc1d22a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:43.614581 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af98698-4f75-4877-b492-f85cc1d22a33 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:43.614864 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af98698-4f75-4877-b492-f85cc1d22a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:43.615142 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af98698-4f75-4877-b492-f85cc1d22a33 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:43.615835 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af98698-4f75-4877-b492-f85cc1d22a33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:43.617748 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af98698-4f75-4877-b492-f85cc1d22a33 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:43.641748 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1333/2683] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:24:43 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:24:43.642831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af98698-4f75-4877-b492-f85cc1d22a33 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:43.644489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-6af98698-4f75-4877-b492-f85cc1d22a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:43.656841 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af98698-4f75-4877-b492-f85cc1d22a33 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:43.661647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b3673-69d9-480d-98f9-75d0d88a4565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:43.662358 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b3673-69d9-480d-98f9-75d0d88a4565 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:43.662653 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b3673-69d9-480d-98f9-75d0d88a4565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:43.662981 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b3673-69d9-480d-98f9-75d0d88a4565 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:43.663721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b3673-69d9-480d-98f9-75d0d88a4565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:43.665369 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b3673-69d9-480d-98f9-75d0d88a4565 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:43.675133 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a8fa0-59de-4409-b30c-51ded55231ab None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:43.679284 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1334/2684] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:24:43.679832 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19c0e8-5110-44f4-9d11-3eb09a445a8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:43.680400 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19c0e8-5110-44f4-9d11-3eb09a445a8a service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:43.681060 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19c0e8-5110-44f4-9d11-3eb09a445a8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:43.681179 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b3673-69d9-480d-98f9-75d0d88a4565 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:43.681284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19c0e8-5110-44f4-9d11-3eb09a445a8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:43.691311 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b3673-69d9-480d-98f9-75d0d88a4565 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:43.696302 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19c0e8-5110-44f4-9d11-3eb09a445a8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:43.696576 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf0dd2-5fc9-4653-9ed7-85717932f33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:43.697450 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf0dd2-5fc9-4653-9ed7-85717932f33c admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:43.697741 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf0dd2-5fc9-4653-9ed7-85717932f33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:43.697855 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19c0e8-5110-44f4-9d11-3eb09a445a8a service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:43.698029 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf0dd2-5fc9-4653-9ed7-85717932f33c admin admin] PATH_INFO: `/v3/projects/58196dbd3d164926924eb0ebe9bcd34b/users/5727feb2d296499f84633661814d56d6/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:43.707538 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1351/2685] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:24:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:24:43.714412 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf0dd2-5fc9-4653-9ed7-85717932f33c admin admin] RBAC: Authorizing `identity:create_grant(project_id=58196dbd3d164926924eb0ebe9bcd34b, user_id=5727feb2d296499f84633661814d56d6, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:43.717083 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf0dd2-5fc9-4653-9ed7-85717932f33c admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:43.731236 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1335/2686] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:24:43 2022] PUT /identity/v3/projects/58196dbd3d164926924eb0ebe9bcd34b/users/5727feb2d296499f84633661814d56d6/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:24:43.735336 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19c0e8-5110-44f4-9d11-3eb09a445a8a service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:43.745634 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19c0e8-5110-44f4-9d11-3eb09a445a8a service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:43.829450 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5c85d-be17-4904-9755-9a65e5795a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:43.830164 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5c85d-be17-4904-9755-9a65e5795a68 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:43.830463 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5c85d-be17-4904-9755-9a65e5795a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:43.830742 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5c85d-be17-4904-9755-9a65e5795a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:43.831535 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5c85d-be17-4904-9755-9a65e5795a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:43.833356 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5c85d-be17-4904-9755-9a65e5795a68 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:43.844334 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1352/2687] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:24:43.848517 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf0dd2-5fc9-4653-9ed7-85717932f33c admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:43.859110 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf0dd2-5fc9-4653-9ed7-85717932f33c admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:43.863845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1a985-c214-46c7-a38e-27d4e087c06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:43.865264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1a985-c214-46c7-a38e-27d4e087c06d admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:43.865549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1a985-c214-46c7-a38e-27d4e087c06d admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:43.865868 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1a985-c214-46c7-a38e-27d4e087c06d admin admin] PATH_INFO: `/v3/projects/58196dbd3d164926924eb0ebe9bcd34b/users/5727feb2d296499f84633661814d56d6/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:43.867984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1a985-c214-46c7-a38e-27d4e087c06d admin admin] RBAC: Authorizing `identity:create_grant(project_id=58196dbd3d164926924eb0ebe9bcd34b, user_id=5727feb2d296499f84633661814d56d6, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:43.870690 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1a985-c214-46c7-a38e-27d4e087c06d admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:43.899024 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1336/2688] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:24:43 2022] PUT /identity/v3/projects/58196dbd3d164926924eb0ebe9bcd34b/users/5727feb2d296499f84633661814d56d6/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:24:43.902336 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273ec41-bd11-44ec-bd86-01f8ae869499 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:43.902637 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273ec41-bd11-44ec-bd86-01f8ae869499 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:43.902919 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273ec41-bd11-44ec-bd86-01f8ae869499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:43.931531 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-e273ec41-bd11-44ec-bd86-01f8ae869499 None None] MFA Rules not processed for user `5727feb2d296499f84633661814d56d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:24:43.932680 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-e273ec41-bd11-44ec-bd86-01f8ae869499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:43.959174 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=100 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:44.011656 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1353/2689] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:24:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:24:44.019287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1a985-c214-46c7-a38e-27d4e087c06d admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:44.021136 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-6cb1a985-c214-46c7-a38e-27d4e087c06d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:44.028082 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273ec41-bd11-44ec-bd86-01f8ae869499 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:44.029465 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-e273ec41-bd11-44ec-bd86-01f8ae869499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:44.091789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273ec41-bd11-44ec-bd86-01f8ae869499 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:44.096002 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66091a0-1746-4929-8490-9bfb4182fc28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:44.096663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66091a0-1746-4929-8490-9bfb4182fc28 service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:44.097037 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66091a0-1746-4929-8490-9bfb4182fc28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:44.097227 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66091a0-1746-4929-8490-9bfb4182fc28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:44.100105 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1a985-c214-46c7-a38e-27d4e087c06d admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:44.106548 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74defcac-373c-4411-acb3-e55ec0872ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:44.107439 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74defcac-373c-4411-acb3-e55ec0872ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:44.107577 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66091a0-1746-4929-8490-9bfb4182fc28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:44.107798 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74defcac-373c-4411-acb3-e55ec0872ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:44.108042 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74defcac-373c-4411-acb3-e55ec0872ba7 admin admin] PATH_INFO: `/v3/projects/5aea993f963747dfba56ac94784df418` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:44.109036 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66091a0-1746-4929-8490-9bfb4182fc28 service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:44.109304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74defcac-373c-4411-acb3-e55ec0872ba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aea993f963747dfba56ac94784df418)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:44.111294 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74defcac-373c-4411-acb3-e55ec0872ba7 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:44.120529 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1354/2690] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:24:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:24:44.162543 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-74defcac-373c-4411-acb3-e55ec0872ba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aea993f963747dfba56ac94784df418', 'request_id': 'req-74defcac-373c-4411-acb3-e55ec0872ba7'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:44.168741 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-74defcac-373c-4411-acb3-e55ec0872ba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aea993f963747dfba56ac94784df418', 'request_id': 'req-74defcac-373c-4411-acb3-e55ec0872ba7'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:44.177688 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-74defcac-373c-4411-acb3-e55ec0872ba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aea993f963747dfba56ac94784df418', 'request_id': 'req-74defcac-373c-4411-acb3-e55ec0872ba7'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:44.189185 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-74defcac-373c-4411-acb3-e55ec0872ba7 admin admin] The token cache is being invalidate because project 5aea993f963747dfba56ac94784df418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:24:44.189502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-74defcac-373c-4411-acb3-e55ec0872ba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:44.190204 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-74defcac-373c-4411-acb3-e55ec0872ba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:44.191963 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1337/2691] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:24:44 2022] DELETE /identity/v3/projects/5aea993f963747dfba56ac94784df418 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:24:44.193910 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66091a0-1746-4929-8490-9bfb4182fc28 service cinder] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:44.196626 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57542d82-95e7-4662-af0c-34100a18eaae None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:44.196926 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57542d82-95e7-4662-af0c-34100a18eaae None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:44.197212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57542d82-95e7-4662-af0c-34100a18eaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:44.204600 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66091a0-1746-4929-8490-9bfb4182fc28 service cinder] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:44.217741 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-57542d82-95e7-4662-af0c-34100a18eaae None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:24:44.218983 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-57542d82-95e7-4662-af0c-34100a18eaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:44.239750 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:44.258713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13038887-7c28-4254-9110-8e9d81d6e246 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:44.259377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13038887-7c28-4254-9110-8e9d81d6e246 service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:44.259669 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13038887-7c28-4254-9110-8e9d81d6e246 service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:44.259957 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13038887-7c28-4254-9110-8e9d81d6e246 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:44.261823 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-13038887-7c28-4254-9110-8e9d81d6e246 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:44.284469 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1338/2692] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:24:44.292719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338d147-8bdd-4de0-9c74-8f6fe10933a9 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:44.293411 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338d147-8bdd-4de0-9c74-8f6fe10933a9 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:44.293697 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338d147-8bdd-4de0-9c74-8f6fe10933a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:44.314308 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-8338d147-8bdd-4de0-9c74-8f6fe10933a9 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:24:44.315533 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-8338d147-8bdd-4de0-9c74-8f6fe10933a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:44.323679 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1339/2693] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:24:44.324630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13038887-7c28-4254-9110-8e9d81d6e246 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:44.326071 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13038887-7c28-4254-9110-8e9d81d6e246 service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:44.327759 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338d147-8bdd-4de0-9c74-8f6fe10933a9 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:44.336279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1355/2694] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:24:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:24:44.336760 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338d147-8bdd-4de0-9c74-8f6fe10933a9 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:44.341486 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a5a22-8664-41e3-bc6a-38067a17ce04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:44.342154 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a5a22-8664-41e3-bc6a-38067a17ce04 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:44.342499 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a5a22-8664-41e3-bc6a-38067a17ce04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:44.342712 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a5a22-8664-41e3-bc6a-38067a17ce04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:44.343443 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a5a22-8664-41e3-bc6a-38067a17ce04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:24:44.343751 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a5a22-8664-41e3-bc6a-38067a17ce04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:44.345349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a5a22-8664-41e3-bc6a-38067a17ce04 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:44.358294 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1340/2695] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:24:44.362721 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13038887-7c28-4254-9110-8e9d81d6e246 service cinder] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:44.375645 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13038887-7c28-4254-9110-8e9d81d6e246 service cinder] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:44.380594 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f5ae3-abea-4f11-b72b-519cb9f595f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:44.381374 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f5ae3-abea-4f11-b72b-519cb9f595f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:44.381976 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f5ae3-abea-4f11-b72b-519cb9f595f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:44.382347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f5ae3-abea-4f11-b72b-519cb9f595f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:44.383057 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f5ae3-abea-4f11-b72b-519cb9f595f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:44.385126 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f5ae3-abea-4f11-b72b-519cb9f595f8 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:44.400969 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:44.415621 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1356/2696] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:24:44 2022] POST /identity/v3/projects => generated 391 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:24:44.419751 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a5a22-8664-41e3-bc6a-38067a17ce04 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:44.431283 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a5a22-8664-41e3-bc6a-38067a17ce04 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:44.507216 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d7c6c-db84-4602-82a6-ed8a28269f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:44.507894 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d7c6c-db84-4602-82a6-ed8a28269f00 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:44.508181 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d7c6c-db84-4602-82a6-ed8a28269f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:44.508455 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d7c6c-db84-4602-82a6-ed8a28269f00 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:44.509521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d7c6c-db84-4602-82a6-ed8a28269f00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:44.511493 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d7c6c-db84-4602-82a6-ed8a28269f00 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:44.533119 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1341/2697] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:24:44 2022] POST /identity/v3/users => generated 296 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:24:44.538462 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f5ae3-abea-4f11-b72b-519cb9f595f8 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:44.549765 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f5ae3-abea-4f11-b72b-519cb9f595f8 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:44.554349 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d99420-e57d-4be4-bc9a-6537a522aa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:44.555011 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d99420-e57d-4be4-bc9a-6537a522aa29 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:44.555293 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d99420-e57d-4be4-bc9a-6537a522aa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:44.555565 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d99420-e57d-4be4-bc9a-6537a522aa29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:44.556284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d99420-e57d-4be4-bc9a-6537a522aa29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:44.558217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d99420-e57d-4be4-bc9a-6537a522aa29 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:44.569798 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1357/2698] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:24:44.573919 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d7c6c-db84-4602-82a6-ed8a28269f00 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:44.584653 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d7c6c-db84-4602-82a6-ed8a28269f00 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:44.590685 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb0122-b3d1-49f3-a29c-0600060a533f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:44.591066 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb0122-b3d1-49f3-a29c-0600060a533f admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:44.591349 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb0122-b3d1-49f3-a29c-0600060a533f admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:44.591800 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb0122-b3d1-49f3-a29c-0600060a533f admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:44.592543 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb0122-b3d1-49f3-a29c-0600060a533f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:44.594437 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb0122-b3d1-49f3-a29c-0600060a533f admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:44.610219 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1342/2699] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:24:44.611341 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d99420-e57d-4be4-bc9a-6537a522aa29 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:44.621723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d99420-e57d-4be4-bc9a-6537a522aa29 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:44.626442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153dffd-acd7-49b9-bb10-77ad303e1af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:44.627339 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153dffd-acd7-49b9-bb10-77ad303e1af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:44.627627 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153dffd-acd7-49b9-bb10-77ad303e1af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:44.627906 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153dffd-acd7-49b9-bb10-77ad303e1af2 admin admin] PATH_INFO: `/v3/projects/2be8874a8aab441485111609591843da/users/8eeaadf55d864bf0b179e242018adeb8/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:44.642792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2153dffd-acd7-49b9-bb10-77ad303e1af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2be8874a8aab441485111609591843da, user_id=8eeaadf55d864bf0b179e242018adeb8, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:44.646345 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2153dffd-acd7-49b9-bb10-77ad303e1af2 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:44.659342 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1358/2700] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:24:44 2022] PUT /identity/v3/projects/2be8874a8aab441485111609591843da/users/8eeaadf55d864bf0b179e242018adeb8/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:24:44.670621 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d122a6-bd1f-4c4d-8a60-e416c99d6784 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:44.670913 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d122a6-bd1f-4c4d-8a60-e416c99d6784 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:44.671192 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d122a6-bd1f-4c4d-8a60-e416c99d6784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:44.699692 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-21d122a6-bd1f-4c4d-8a60-e416c99d6784 None None] MFA Rules not processed for user `8eeaadf55d864bf0b179e242018adeb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:24:44.700833 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-21d122a6-bd1f-4c4d-8a60-e416c99d6784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:44.766368 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1343/2701] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:24:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:24:44.777573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153dffd-acd7-49b9-bb10-77ad303e1af2 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:44.779456 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-2153dffd-acd7-49b9-bb10-77ad303e1af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:44.837946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153dffd-acd7-49b9-bb10-77ad303e1af2 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:44.841741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36616f04-71eb-4081-91ab-0fc8123302ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:44.842454 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36616f04-71eb-4081-91ab-0fc8123302ec service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:44.842743 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36616f04-71eb-4081-91ab-0fc8123302ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:44.843021 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36616f04-71eb-4081-91ab-0fc8123302ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:44.851602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36616f04-71eb-4081-91ab-0fc8123302ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:44.853041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36616f04-71eb-4081-91ab-0fc8123302ec service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:44.862312 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1359/2702] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:24:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:24:54.763250 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=91,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:54.857934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=43,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:54.943432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d122a6-bd1f-4c4d-8a60-e416c99d6784 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:55.004714 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d122a6-bd1f-4c4d-8a60-e416c99d6784 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:55.009410 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7528ad5-467a-4fe8-8169-4c890686372c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:55.010322 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7528ad5-467a-4fe8-8169-4c890686372c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:55.011191 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7528ad5-467a-4fe8-8169-4c890686372c admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:55.011191 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7528ad5-467a-4fe8-8169-4c890686372c admin admin] PATH_INFO: `/v3/users/8eeaadf55d864bf0b179e242018adeb8` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:55.012618 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7528ad5-467a-4fe8-8169-4c890686372c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eeaadf55d864bf0b179e242018adeb8)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:55.016422 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7528ad5-467a-4fe8-8169-4c890686372c admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:55.067723 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a7528ad5-467a-4fe8-8169-4c890686372c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eeaadf55d864bf0b179e242018adeb8'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:55.068379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a7528ad5-467a-4fe8-8169-4c890686372c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eeaadf55d864bf0b179e242018adeb8'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:55.075596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a7528ad5-467a-4fe8-8169-4c890686372c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eeaadf55d864bf0b179e242018adeb8'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:55.083155 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a7528ad5-467a-4fe8-8169-4c890686372c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eeaadf55d864bf0b179e242018adeb8'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:55.094918 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-a7528ad5-467a-4fe8-8169-4c890686372c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eeaadf55d864bf0b179e242018adeb8'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:55.104221 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1344/2703] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:24:54 2022] DELETE /identity/v3/users/8eeaadf55d864bf0b179e242018adeb8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:24:55.109383 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6182d-08a5-49e8-813c-cb0aa46aac5d None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:55.109767 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6182d-08a5-49e8-813c-cb0aa46aac5d None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:55.110242 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6182d-08a5-49e8-813c-cb0aa46aac5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:55.138015 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-ade6182d-08a5-49e8-813c-cb0aa46aac5d None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:24:55.139975 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-ade6182d-08a5-49e8-813c-cb0aa46aac5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:55.227302 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1360/2704] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:24:55.237038 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7528ad5-467a-4fe8-8169-4c890686372c admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:55.238668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-a7528ad5-467a-4fe8-8169-4c890686372c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:55.305382 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7528ad5-467a-4fe8-8169-4c890686372c admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:55.309233 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b02c4-8573-4860-9ebe-c9e5b8d0f1cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:55.309901 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b02c4-8573-4860-9ebe-c9e5b8d0f1cb service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:55.310228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b02c4-8573-4860-9ebe-c9e5b8d0f1cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:55.310537 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b02c4-8573-4860-9ebe-c9e5b8d0f1cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:55.320919 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b02c4-8573-4860-9ebe-c9e5b8d0f1cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:55.322402 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b02c4-8573-4860-9ebe-c9e5b8d0f1cb service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:55.332267 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1345/2705] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:24:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:24:55.617933 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6182d-08a5-49e8-813c-cb0aa46aac5d None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:55.619645 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-ade6182d-08a5-49e8-813c-cb0aa46aac5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:55.635165 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6182d-08a5-49e8-813c-cb0aa46aac5d None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:55.639832 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da03b2-a468-475b-ac94-abe9c6c58f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:55.640718 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da03b2-a468-475b-ac94-abe9c6c58f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:55.641004 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da03b2-a468-475b-ac94-abe9c6c58f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:55.641285 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da03b2-a468-475b-ac94-abe9c6c58f49 admin admin] PATH_INFO: `/v3/projects/2be8874a8aab441485111609591843da` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:55.642618 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da03b2-a468-475b-ac94-abe9c6c58f49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2be8874a8aab441485111609591843da)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:55.645395 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da03b2-a468-475b-ac94-abe9c6c58f49 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:55.694907 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b5da03b2-a468-475b-ac94-abe9c6c58f49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2be8874a8aab441485111609591843da', 'request_id': 'req-b5da03b2-a468-475b-ac94-abe9c6c58f49'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:55.701016 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b5da03b2-a468-475b-ac94-abe9c6c58f49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2be8874a8aab441485111609591843da', 'request_id': 'req-b5da03b2-a468-475b-ac94-abe9c6c58f49'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:55.709227 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b5da03b2-a468-475b-ac94-abe9c6c58f49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2be8874a8aab441485111609591843da', 'request_id': 'req-b5da03b2-a468-475b-ac94-abe9c6c58f49'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:55.719619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b5da03b2-a468-475b-ac94-abe9c6c58f49 admin admin] The token cache is being invalidate because project 2be8874a8aab441485111609591843da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:24:55.719908 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b5da03b2-a468-475b-ac94-abe9c6c58f49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:55.720527 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b5da03b2-a468-475b-ac94-abe9c6c58f49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:24:55.722155 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1361/2706] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:24:55 2022] DELETE /identity/v3/projects/2be8874a8aab441485111609591843da => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:24:55.727506 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe6b6f-8e20-4d54-ae84-cf807c2314cb None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:55.727802 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe6b6f-8e20-4d54-ae84-cf807c2314cb None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:55.728085 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe6b6f-8e20-4d54-ae84-cf807c2314cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:55.747019 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-11fe6b6f-8e20-4d54-ae84-cf807c2314cb None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:24:55.748234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-11fe6b6f-8e20-4d54-ae84-cf807c2314cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:55.765438 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:55.811075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1346/2707] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:24:55.874425 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2c8d3-bdba-4299-b20b-d07fe1b52c0a None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:55.874987 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2c8d3-bdba-4299-b20b-d07fe1b52c0a None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:55.874987 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2c8d3-bdba-4299-b20b-d07fe1b52c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:55.893819 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-eff2c8d3-bdba-4299-b20b-d07fe1b52c0a None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:24:55.895889 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-eff2c8d3-bdba-4299-b20b-d07fe1b52c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:55.903741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1362/2708] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:24:55.908043 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe6b6f-8e20-4d54-ae84-cf807c2314cb None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:55.918755 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe6b6f-8e20-4d54-ae84-cf807c2314cb None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:55.923584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb4ca3-f011-48e1-afa3-9dcbdc619baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:55.924244 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb4ca3-f011-48e1-afa3-9dcbdc619baa admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:55.924538 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb4ca3-f011-48e1-afa3-9dcbdc619baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:55.924819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb4ca3-f011-48e1-afa3-9dcbdc619baa admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:55.925538 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb4ca3-f011-48e1-afa3-9dcbdc619baa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:24:55.925848 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb4ca3-f011-48e1-afa3-9dcbdc619baa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:55.927998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb4ca3-f011-48e1-afa3-9dcbdc619baa admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:55.939687 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1347/2709] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:24:55.944720 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2c8d3-bdba-4299-b20b-d07fe1b52c0a None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:55.953981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2c8d3-bdba-4299-b20b-d07fe1b52c0a None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:55.958569 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62249b-fc34-4c07-8fd4-4ae77033b0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:55.959217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62249b-fc34-4c07-8fd4-4ae77033b0de admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:55.959501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62249b-fc34-4c07-8fd4-4ae77033b0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:55.959777 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62249b-fc34-4c07-8fd4-4ae77033b0de admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:55.960471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62249b-fc34-4c07-8fd4-4ae77033b0de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:55.962391 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62249b-fc34-4c07-8fd4-4ae77033b0de admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:55.986826 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1363/2710] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:24:55 2022] POST /identity/v3/projects => generated 399 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:24:55.991451 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb4ca3-f011-48e1-afa3-9dcbdc619baa admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:56.001572 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb4ca3-f011-48e1-afa3-9dcbdc619baa admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:56.059591 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb414f5b-103a-4c58-9707-6d3c7c5ed04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:56.060269 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb414f5b-103a-4c58-9707-6d3c7c5ed04b admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:56.060558 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb414f5b-103a-4c58-9707-6d3c7c5ed04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:56.060840 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb414f5b-103a-4c58-9707-6d3c7c5ed04b admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:56.061533 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb414f5b-103a-4c58-9707-6d3c7c5ed04b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:56.063479 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb414f5b-103a-4c58-9707-6d3c7c5ed04b admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:56.082656 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1348/2711] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:24:55 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:24:56.086793 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62249b-fc34-4c07-8fd4-4ae77033b0de admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:56.097020 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62249b-fc34-4c07-8fd4-4ae77033b0de admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:56.102101 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a7979-aaa7-44b2-9e26-43197c22ad54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:56.102787 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a7979-aaa7-44b2-9e26-43197c22ad54 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:56.103073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a7979-aaa7-44b2-9e26-43197c22ad54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:56.103351 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a7979-aaa7-44b2-9e26-43197c22ad54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:56.104068 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a7979-aaa7-44b2-9e26-43197c22ad54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:56.105656 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a7979-aaa7-44b2-9e26-43197c22ad54 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:56.116466 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1364/2712] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:24:56.120258 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb414f5b-103a-4c58-9707-6d3c7c5ed04b admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:56.130378 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb414f5b-103a-4c58-9707-6d3c7c5ed04b admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:56.135189 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce07ba-83ce-4e46-845a-322141bf8871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:56.135847 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce07ba-83ce-4e46-845a-322141bf8871 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:56.136132 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce07ba-83ce-4e46-845a-322141bf8871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:56.136410 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce07ba-83ce-4e46-845a-322141bf8871 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:56.137132 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce07ba-83ce-4e46-845a-322141bf8871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:56.138762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce07ba-83ce-4e46-845a-322141bf8871 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:56.148491 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1349/2713] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:24:56.152501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a7979-aaa7-44b2-9e26-43197c22ad54 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:56.162951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a7979-aaa7-44b2-9e26-43197c22ad54 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:56.167533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1436a2-e264-4710-929a-682488d2e979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:56.168408 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1436a2-e264-4710-929a-682488d2e979 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:56.168689 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1436a2-e264-4710-929a-682488d2e979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:56.168962 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1436a2-e264-4710-929a-682488d2e979 admin admin] PATH_INFO: `/v3/projects/dc974ea48175425b8745eb7a3817b9a8/users/d372b323f5f14683a43d638dd021d320/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:56.185026 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1436a2-e264-4710-929a-682488d2e979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc974ea48175425b8745eb7a3817b9a8, user_id=d372b323f5f14683a43d638dd021d320, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:56.187699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1436a2-e264-4710-929a-682488d2e979 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:56.200533 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1365/2714] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:24:56 2022] PUT /identity/v3/projects/dc974ea48175425b8745eb7a3817b9a8/users/d372b323f5f14683a43d638dd021d320/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:24:56.210549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab179cc-8668-433b-8ba4-4ef78386a4bb None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:56.210846 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab179cc-8668-433b-8ba4-4ef78386a4bb None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:56.211127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab179cc-8668-433b-8ba4-4ef78386a4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:56.238402 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-5ab179cc-8668-433b-8ba4-4ef78386a4bb None None] MFA Rules not processed for user `d372b323f5f14683a43d638dd021d320`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:24:56.240220 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-5ab179cc-8668-433b-8ba4-4ef78386a4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:56.303501 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1350/2715] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:24:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:24:56.315622 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1436a2-e264-4710-929a-682488d2e979 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:24:56.317425 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-bc1436a2-e264-4710-929a-682488d2e979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:24:56.338687 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:56.375642 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1436a2-e264-4710-929a-682488d2e979 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:24:56.379312 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779345f8-0b1a-47ad-8390-f0ac963018dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:24:56.379957 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779345f8-0b1a-47ad-8390-f0ac963018dd service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:24:56.380240 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779345f8-0b1a-47ad-8390-f0ac963018dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:24:56.380563 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779345f8-0b1a-47ad-8390-f0ac963018dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:24:56.388972 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779345f8-0b1a-47ad-8390-f0ac963018dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:24:56.390417 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779345f8-0b1a-47ad-8390-f0ac963018dd service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:24:56.399123 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1366/2716] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:24:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:25:01.405034 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab179cc-8668-433b-8ba4-4ef78386a4bb None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:01.423891 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:01.475971 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab179cc-8668-433b-8ba4-4ef78386a4bb None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:01.481818 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a96f1f-c91b-4bae-bf5d-603397320682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:01.482809 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a96f1f-c91b-4bae-bf5d-603397320682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:01.483092 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a96f1f-c91b-4bae-bf5d-603397320682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:01.483370 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a96f1f-c91b-4bae-bf5d-603397320682 admin admin] PATH_INFO: `/v3/users/d372b323f5f14683a43d638dd021d320` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:01.484644 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a96f1f-c91b-4bae-bf5d-603397320682 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d372b323f5f14683a43d638dd021d320)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:01.486634 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a96f1f-c91b-4bae-bf5d-603397320682 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:01.534062 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-10a96f1f-c91b-4bae-bf5d-603397320682 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd372b323f5f14683a43d638dd021d320'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:01.534750 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-10a96f1f-c91b-4bae-bf5d-603397320682 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd372b323f5f14683a43d638dd021d320'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:01.543071 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-10a96f1f-c91b-4bae-bf5d-603397320682 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd372b323f5f14683a43d638dd021d320'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:01.550214 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-10a96f1f-c91b-4bae-bf5d-603397320682 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd372b323f5f14683a43d638dd021d320'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:01.562073 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-10a96f1f-c91b-4bae-bf5d-603397320682 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd372b323f5f14683a43d638dd021d320'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:01.568431 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1351/2717] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:25:01 2022] DELETE /identity/v3/users/d372b323f5f14683a43d638dd021d320 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:01.573161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367db01-8106-4807-804a-4453bb976d3c None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:01.573657 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367db01-8106-4807-804a-4453bb976d3c None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:01.573767 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367db01-8106-4807-804a-4453bb976d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:01.591536 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-7367db01-8106-4807-804a-4453bb976d3c None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:01.592672 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-7367db01-8106-4807-804a-4453bb976d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:01.651011 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1367/2718] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:01.660721 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a96f1f-c91b-4bae-bf5d-603397320682 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:01.662204 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-10a96f1f-c91b-4bae-bf5d-603397320682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:01.719742 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a96f1f-c91b-4bae-bf5d-603397320682 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:01.723481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d139bbe-0229-41ab-aedd-59dabfaf5ddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:01.724134 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d139bbe-0229-41ab-aedd-59dabfaf5ddb service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:01.724424 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d139bbe-0229-41ab-aedd-59dabfaf5ddb service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:01.724708 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d139bbe-0229-41ab-aedd-59dabfaf5ddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:01.733784 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d139bbe-0229-41ab-aedd-59dabfaf5ddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:01.735253 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d139bbe-0229-41ab-aedd-59dabfaf5ddb service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:01.745225 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1352/2719] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:25:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:25:02.012138 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367db01-8106-4807-804a-4453bb976d3c None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:02.013653 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-7367db01-8106-4807-804a-4453bb976d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:02.027381 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367db01-8106-4807-804a-4453bb976d3c None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:02.032073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123c8c9-6edd-43cb-bdbc-1672c17285e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:02.032951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123c8c9-6edd-43cb-bdbc-1672c17285e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:02.033239 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123c8c9-6edd-43cb-bdbc-1672c17285e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:02.033515 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123c8c9-6edd-43cb-bdbc-1672c17285e0 admin admin] PATH_INFO: `/v3/projects/dc974ea48175425b8745eb7a3817b9a8` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:02.034749 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123c8c9-6edd-43cb-bdbc-1672c17285e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc974ea48175425b8745eb7a3817b9a8)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:02.037297 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123c8c9-6edd-43cb-bdbc-1672c17285e0 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:02.084929 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-c123c8c9-6edd-43cb-bdbc-1672c17285e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc974ea48175425b8745eb7a3817b9a8', 'request_id': 'req-c123c8c9-6edd-43cb-bdbc-1672c17285e0'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:02.091056 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-c123c8c9-6edd-43cb-bdbc-1672c17285e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc974ea48175425b8745eb7a3817b9a8', 'request_id': 'req-c123c8c9-6edd-43cb-bdbc-1672c17285e0'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:02.098223 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-c123c8c9-6edd-43cb-bdbc-1672c17285e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc974ea48175425b8745eb7a3817b9a8', 'request_id': 'req-c123c8c9-6edd-43cb-bdbc-1672c17285e0'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:02.108864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-c123c8c9-6edd-43cb-bdbc-1672c17285e0 admin admin] The token cache is being invalidate because project dc974ea48175425b8745eb7a3817b9a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:25:02.109155 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-c123c8c9-6edd-43cb-bdbc-1672c17285e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:02.109786 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-c123c8c9-6edd-43cb-bdbc-1672c17285e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:02.111346 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1368/2720] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:25:02 2022] DELETE /identity/v3/projects/dc974ea48175425b8745eb7a3817b9a8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:02.116367 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774381e-37ba-48ec-bc7f-a6955690122d None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:02.116660 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774381e-37ba-48ec-bc7f-a6955690122d None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:02.116969 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774381e-37ba-48ec-bc7f-a6955690122d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:02.136272 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-f774381e-37ba-48ec-bc7f-a6955690122d None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:02.137409 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-f774381e-37ba-48ec-bc7f-a6955690122d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:02.170725 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:02.197571 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1353/2721] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:02.206792 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907935a-ca84-4976-bdfd-417db80e245b None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:02.207081 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907935a-ca84-4976-bdfd-417db80e245b None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:02.207357 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907935a-ca84-4976-bdfd-417db80e245b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:02.226169 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-5907935a-ca84-4976-bdfd-417db80e245b None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:02.227462 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-5907935a-ca84-4976-bdfd-417db80e245b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:02.235402 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1369/2722] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:02.240123 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774381e-37ba-48ec-bc7f-a6955690122d None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:02.249655 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774381e-37ba-48ec-bc7f-a6955690122d None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:02.254219 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf191fc1-45ff-4748-8c7e-5ae5865f8ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:02.254869 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf191fc1-45ff-4748-8c7e-5ae5865f8ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:02.255147 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf191fc1-45ff-4748-8c7e-5ae5865f8ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:02.255423 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf191fc1-45ff-4748-8c7e-5ae5865f8ea6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:02.256238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf191fc1-45ff-4748-8c7e-5ae5865f8ea6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:25:02.256543 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf191fc1-45ff-4748-8c7e-5ae5865f8ea6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:02.258409 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf191fc1-45ff-4748-8c7e-5ae5865f8ea6 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:02.269873 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1354/2723] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:25:02.273883 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907935a-ca84-4976-bdfd-417db80e245b None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:02.283174 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907935a-ca84-4976-bdfd-417db80e245b None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:02.288299 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f3aac-4bf5-4049-96d6-b02baba99e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:02.288950 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f3aac-4bf5-4049-96d6-b02baba99e11 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:02.289240 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f3aac-4bf5-4049-96d6-b02baba99e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:02.289521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f3aac-4bf5-4049-96d6-b02baba99e11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:02.290357 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f3aac-4bf5-4049-96d6-b02baba99e11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:02.292257 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f3aac-4bf5-4049-96d6-b02baba99e11 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:02.317711 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1370/2724] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:25:02 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:25:02.321815 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf191fc1-45ff-4748-8c7e-5ae5865f8ea6 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:02.332201 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf191fc1-45ff-4748-8c7e-5ae5865f8ea6 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:02.387648 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca580bb2-4a69-4489-bed4-d6a946699870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:02.388240 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca580bb2-4a69-4489-bed4-d6a946699870 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:02.388525 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca580bb2-4a69-4489-bed4-d6a946699870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:02.388799 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca580bb2-4a69-4489-bed4-d6a946699870 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:02.389485 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca580bb2-4a69-4489-bed4-d6a946699870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:02.391420 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca580bb2-4a69-4489-bed4-d6a946699870 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:02.411329 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1355/2725] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:25:02 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:25:02.415556 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f3aac-4bf5-4049-96d6-b02baba99e11 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:02.425814 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f3aac-4bf5-4049-96d6-b02baba99e11 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:02.431053 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54cbb7-1d29-4621-a170-c34770e62877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:02.431720 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54cbb7-1d29-4621-a170-c34770e62877 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:02.432006 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54cbb7-1d29-4621-a170-c34770e62877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:02.432289 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54cbb7-1d29-4621-a170-c34770e62877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:02.433014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54cbb7-1d29-4621-a170-c34770e62877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:02.434719 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54cbb7-1d29-4621-a170-c34770e62877 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:02.444913 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1371/2726] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:25:02.448817 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca580bb2-4a69-4489-bed4-d6a946699870 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:02.459311 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca580bb2-4a69-4489-bed4-d6a946699870 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:02.463954 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3c982-be0c-473b-a5f8-f49d0e5e0bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:02.464608 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3c982-be0c-473b-a5f8-f49d0e5e0bfd admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:02.464900 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3c982-be0c-473b-a5f8-f49d0e5e0bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:02.465183 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3c982-be0c-473b-a5f8-f49d0e5e0bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:02.465905 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3c982-be0c-473b-a5f8-f49d0e5e0bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:02.467529 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3c982-be0c-473b-a5f8-f49d0e5e0bfd admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:02.478622 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1356/2727] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:25:02.482821 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54cbb7-1d29-4621-a170-c34770e62877 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:02.492899 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54cbb7-1d29-4621-a170-c34770e62877 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:02.499261 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111db8fb-9ef7-4d3a-98a5-ddb6576d6bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:02.500158 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111db8fb-9ef7-4d3a-98a5-ddb6576d6bdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:02.500442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111db8fb-9ef7-4d3a-98a5-ddb6576d6bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:02.500720 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111db8fb-9ef7-4d3a-98a5-ddb6576d6bdf admin admin] PATH_INFO: `/v3/projects/6cfb22835b64405a838e165ee4ed609b/users/ba1997c9721b4896b4f7019996d741e5/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:02.503188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:02.518735 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111db8fb-9ef7-4d3a-98a5-ddb6576d6bdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cfb22835b64405a838e165ee4ed609b, user_id=ba1997c9721b4896b4f7019996d741e5, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:02.521910 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111db8fb-9ef7-4d3a-98a5-ddb6576d6bdf admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:02.536059 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1372/2728] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:25:02 2022] PUT /identity/v3/projects/6cfb22835b64405a838e165ee4ed609b/users/ba1997c9721b4896b4f7019996d741e5/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:25:02.542172 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe80366-f930-4d3e-8e92-4ebe42dd4b7f None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:02.542475 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe80366-f930-4d3e-8e92-4ebe42dd4b7f None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:02.542810 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe80366-f930-4d3e-8e92-4ebe42dd4b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:02.560902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-ffe80366-f930-4d3e-8e92-4ebe42dd4b7f None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:02.562145 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-ffe80366-f930-4d3e-8e92-4ebe42dd4b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:02.623125 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1357/2729] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:02.632913 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111db8fb-9ef7-4d3a-98a5-ddb6576d6bdf admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:02.635293 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-111db8fb-9ef7-4d3a-98a5-ddb6576d6bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:02.695867 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111db8fb-9ef7-4d3a-98a5-ddb6576d6bdf admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:02.699867 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5909777-0571-4dc7-9fca-cd1a914fb171 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:02.700530 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5909777-0571-4dc7-9fca-cd1a914fb171 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:02.700852 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5909777-0571-4dc7-9fca-cd1a914fb171 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:02.701136 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5909777-0571-4dc7-9fca-cd1a914fb171 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:02.712210 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5909777-0571-4dc7-9fca-cd1a914fb171 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:02.713656 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5909777-0571-4dc7-9fca-cd1a914fb171 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:02.724739 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1373/2730] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:25:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:25:06.682588 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd04bc-ce17-4bc2-a526-b5f56e939a66 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:06.683051 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd04bc-ce17-4bc2-a526-b5f56e939a66 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:06.683155 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd04bc-ce17-4bc2-a526-b5f56e939a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:06.715279 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-86dd04bc-ce17-4bc2-a526-b5f56e939a66 None None] MFA Rules not processed for user `ba1997c9721b4896b4f7019996d741e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:06.716532 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-86dd04bc-ce17-4bc2-a526-b5f56e939a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:06.756226 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:06.791143 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1358/2731] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:06.795760 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5909777-0571-4dc7-9fca-cd1a914fb171 service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:06.806389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5909777-0571-4dc7-9fca-cd1a914fb171 service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:06.811741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea7f46-37cd-4dfd-9b18-8926b730a271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:06.812625 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea7f46-37cd-4dfd-9b18-8926b730a271 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:06.812908 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea7f46-37cd-4dfd-9b18-8926b730a271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:06.813183 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea7f46-37cd-4dfd-9b18-8926b730a271 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:06.814011 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea7f46-37cd-4dfd-9b18-8926b730a271 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:06.816087 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea7f46-37cd-4dfd-9b18-8926b730a271 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:06.855043 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1374/2732] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:25:06 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:25:06.856406 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd04bc-ce17-4bc2-a526-b5f56e939a66 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:06.868416 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd04bc-ce17-4bc2-a526-b5f56e939a66 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:06.946408 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4d0d5-64ea-480a-90dd-2dd7e063be75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:06.947106 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4d0d5-64ea-480a-90dd-2dd7e063be75 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:06.947392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4d0d5-64ea-480a-90dd-2dd7e063be75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:06.947675 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4d0d5-64ea-480a-90dd-2dd7e063be75 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:06.948376 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4d0d5-64ea-480a-90dd-2dd7e063be75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:06.951256 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4d0d5-64ea-480a-90dd-2dd7e063be75 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:06.974300 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1359/2733] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:25:06 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:25:06.977564 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea7f46-37cd-4dfd-9b18-8926b730a271 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:06.989538 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea7f46-37cd-4dfd-9b18-8926b730a271 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:06.994412 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c3e8a-df51-4e6f-a0ce-3bab771f2909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:06.995100 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c3e8a-df51-4e6f-a0ce-3bab771f2909 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:06.995389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c3e8a-df51-4e6f-a0ce-3bab771f2909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:06.995674 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c3e8a-df51-4e6f-a0ce-3bab771f2909 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:06.996421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c3e8a-df51-4e6f-a0ce-3bab771f2909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:06.998584 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c3e8a-df51-4e6f-a0ce-3bab771f2909 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:07.012631 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1375/2734] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:25:07.017009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4d0d5-64ea-480a-90dd-2dd7e063be75 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:07.027988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4d0d5-64ea-480a-90dd-2dd7e063be75 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:07.033008 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6624a-abea-4f2d-9987-3c70dfd7da58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:07.034065 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6624a-abea-4f2d-9987-3c70dfd7da58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:07.034405 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6624a-abea-4f2d-9987-3c70dfd7da58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:07.034708 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6624a-abea-4f2d-9987-3c70dfd7da58 admin admin] PATH_INFO: `/v3/projects/c74ea7e65a634078a09a601d3ed36071/users/17ef6576ad4c44a489fa66eabd2ef793/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:07.053658 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b6624a-abea-4f2d-9987-3c70dfd7da58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c74ea7e65a634078a09a601d3ed36071, user_id=17ef6576ad4c44a489fa66eabd2ef793, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:07.056406 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b6624a-abea-4f2d-9987-3c70dfd7da58 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:07.075057 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1360/2735] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:25:07 2022] PUT /identity/v3/projects/c74ea7e65a634078a09a601d3ed36071/users/17ef6576ad4c44a489fa66eabd2ef793/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:07.079097 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c3e8a-df51-4e6f-a0ce-3bab771f2909 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:07.093327 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c3e8a-df51-4e6f-a0ce-3bab771f2909 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:07.162180 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57fa22-7931-4b73-a1d4-36ea81de3c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:07.162956 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57fa22-7931-4b73-a1d4-36ea81de3c78 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:07.163316 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57fa22-7931-4b73-a1d4-36ea81de3c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:07.163780 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57fa22-7931-4b73-a1d4-36ea81de3c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:07.164786 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57fa22-7931-4b73-a1d4-36ea81de3c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:07.166652 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57fa22-7931-4b73-a1d4-36ea81de3c78 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:07.179114 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1376/2736] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:25:07.183451 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6624a-abea-4f2d-9987-3c70dfd7da58 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:07.196012 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6624a-abea-4f2d-9987-3c70dfd7da58 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:07.200766 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2dd13-1114-41c5-a485-75befe2e5ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:07.201658 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2dd13-1114-41c5-a485-75befe2e5ffc admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:07.201948 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2dd13-1114-41c5-a485-75befe2e5ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:07.202419 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2dd13-1114-41c5-a485-75befe2e5ffc admin admin] PATH_INFO: `/v3/projects/c74ea7e65a634078a09a601d3ed36071/users/17ef6576ad4c44a489fa66eabd2ef793/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:07.204394 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2dd13-1114-41c5-a485-75befe2e5ffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c74ea7e65a634078a09a601d3ed36071, user_id=17ef6576ad4c44a489fa66eabd2ef793, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:07.207070 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2dd13-1114-41c5-a485-75befe2e5ffc admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:07.217635 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1361/2737] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:25:07 2022] PUT /identity/v3/projects/c74ea7e65a634078a09a601d3ed36071/users/17ef6576ad4c44a489fa66eabd2ef793/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:12.485541 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2da0f-62e8-474e-b15f-c72d68d6d030 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:12.486529 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2da0f-62e8-474e-b15f-c72d68d6d030 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:12.487000 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2da0f-62e8-474e-b15f-c72d68d6d030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:12.519004 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-fbd2da0f-62e8-474e-b15f-c72d68d6d030 None None] MFA Rules not processed for user `17ef6576ad4c44a489fa66eabd2ef793`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:12.521174 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-fbd2da0f-62e8-474e-b15f-c72d68d6d030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:12.577015 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:12.625249 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1377/2738] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:12.639619 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2dd13-1114-41c5-a485-75befe2e5ffc admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:12.641874 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-d1c2dd13-1114-41c5-a485-75befe2e5ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:12.747787 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2dd13-1114-41c5-a485-75befe2e5ffc admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:12.758932 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a433bed-cd62-45fd-ab98-0ddbabd545a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:12.759994 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a433bed-cd62-45fd-ab98-0ddbabd545a9 service nova] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:12.760438 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a433bed-cd62-45fd-ab98-0ddbabd545a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:12.760797 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a433bed-cd62-45fd-ab98-0ddbabd545a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:12.788285 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:12.823572 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a433bed-cd62-45fd-ab98-0ddbabd545a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:12.825192 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a433bed-cd62-45fd-ab98-0ddbabd545a9 service nova] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:12.836100 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1362/2739] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:25:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:25:13.870006 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74a15f-1f03-45d6-9f19-0a2d42408772 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:13.871011 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74a15f-1f03-45d6-9f19-0a2d42408772 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:13.871296 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74a15f-1f03-45d6-9f19-0a2d42408772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:13.889505 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-7c74a15f-1f03-45d6-9f19-0a2d42408772 None None] MFA Rules not processed for user `ba1997c9721b4896b4f7019996d741e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:13.890865 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-7c74a15f-1f03-45d6-9f19-0a2d42408772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:13.898359 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1378/2740] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:14.709971 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a433bed-cd62-45fd-ab98-0ddbabd545a9 service nova] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:14.712088 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-8a433bed-cd62-45fd-ab98-0ddbabd545a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:14.790651 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a433bed-cd62-45fd-ab98-0ddbabd545a9 service nova] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:14.796955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e268f-0a46-43af-9cd9-00d00127414c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:14.798488 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e268f-0a46-43af-9cd9-00d00127414c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:14.799007 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e268f-0a46-43af-9cd9-00d00127414c admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:14.799387 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e268f-0a46-43af-9cd9-00d00127414c admin admin] PATH_INFO: `/v3/users/a783f2d57f0c47dfbd6f187ff93f8ca9` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:14.800847 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e268f-0a46-43af-9cd9-00d00127414c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a783f2d57f0c47dfbd6f187ff93f8ca9)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:14.803010 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e268f-0a46-43af-9cd9-00d00127414c admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:14.872140 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-ab4e268f-0a46-43af-9cd9-00d00127414c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a783f2d57f0c47dfbd6f187ff93f8ca9'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:14.872902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-ab4e268f-0a46-43af-9cd9-00d00127414c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a783f2d57f0c47dfbd6f187ff93f8ca9'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:14.885996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-ab4e268f-0a46-43af-9cd9-00d00127414c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a783f2d57f0c47dfbd6f187ff93f8ca9'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:14.907452 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-ab4e268f-0a46-43af-9cd9-00d00127414c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a783f2d57f0c47dfbd6f187ff93f8ca9'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:14.923427 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-ab4e268f-0a46-43af-9cd9-00d00127414c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a783f2d57f0c47dfbd6f187ff93f8ca9'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:14.933316 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1363/2741] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:25:14 2022] DELETE /identity/v3/users/a783f2d57f0c47dfbd6f187ff93f8ca9 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:14.935187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a949c6-c766-47db-9741-baeb6c1810d7 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:14.935648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a949c6-c766-47db-9741-baeb6c1810d7 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:14.935901 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a949c6-c766-47db-9741-baeb6c1810d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:14.956576 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-06a949c6-c766-47db-9741-baeb6c1810d7 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:14.958427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-06a949c6-c766-47db-9741-baeb6c1810d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:15.044864 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1379/2742] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:15.055012 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e268f-0a46-43af-9cd9-00d00127414c admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:15.056516 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-ab4e268f-0a46-43af-9cd9-00d00127414c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:15.120888 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:15.138303 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e268f-0a46-43af-9cd9-00d00127414c admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:15.143055 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e6623-2538-4be1-a226-adeb55ee3010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:15.144878 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e6623-2538-4be1-a226-adeb55ee3010 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:15.145256 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e6623-2538-4be1-a226-adeb55ee3010 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:15.145606 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e6623-2538-4be1-a226-adeb55ee3010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:15.156918 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e6623-2538-4be1-a226-adeb55ee3010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:15.158548 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e6623-2538-4be1-a226-adeb55ee3010 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:15.178346 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1364/2743] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:25:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:25:15.488257 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a949c6-c766-47db-9741-baeb6c1810d7 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:15.489902 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-06a949c6-c766-47db-9741-baeb6c1810d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:15.586231 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a949c6-c766-47db-9741-baeb6c1810d7 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:15.591025 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353f05c-79e2-4d0c-9bf8-d43132827398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:15.591967 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353f05c-79e2-4d0c-9bf8-d43132827398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:15.592251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353f05c-79e2-4d0c-9bf8-d43132827398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:15.592531 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353f05c-79e2-4d0c-9bf8-d43132827398 admin admin] PATH_INFO: `/v3/projects/d7f403a6f07d45fcad2d7f18d9b6b5d2` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:15.595336 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353f05c-79e2-4d0c-9bf8-d43132827398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7f403a6f07d45fcad2d7f18d9b6b5d2)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:15.597604 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353f05c-79e2-4d0c-9bf8-d43132827398 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:15.649143 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f353f05c-79e2-4d0c-9bf8-d43132827398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7f403a6f07d45fcad2d7f18d9b6b5d2', 'request_id': 'req-f353f05c-79e2-4d0c-9bf8-d43132827398'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:15.658021 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f353f05c-79e2-4d0c-9bf8-d43132827398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7f403a6f07d45fcad2d7f18d9b6b5d2', 'request_id': 'req-f353f05c-79e2-4d0c-9bf8-d43132827398'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:15.666442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f353f05c-79e2-4d0c-9bf8-d43132827398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7f403a6f07d45fcad2d7f18d9b6b5d2', 'request_id': 'req-f353f05c-79e2-4d0c-9bf8-d43132827398'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:15.667773 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:15.688257 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f353f05c-79e2-4d0c-9bf8-d43132827398 admin admin] The token cache is being invalidate because project d7f403a6f07d45fcad2d7f18d9b6b5d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:25:15.688837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f353f05c-79e2-4d0c-9bf8-d43132827398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:15.689506 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f353f05c-79e2-4d0c-9bf8-d43132827398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:15.694405 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1380/2744] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:25:15 2022] DELETE /identity/v3/projects/d7f403a6f07d45fcad2d7f18d9b6b5d2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:15.695896 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e6623-2538-4be1-a226-adeb55ee3010 service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:15.776684 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e6623-2538-4be1-a226-adeb55ee3010 service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:15.851833 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fcf08-4ad3-4cbb-921e-2ffed59789f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:15.852785 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fcf08-4ad3-4cbb-921e-2ffed59789f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:15.853239 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fcf08-4ad3-4cbb-921e-2ffed59789f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:15.853521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fcf08-4ad3-4cbb-921e-2ffed59789f1 admin admin] PATH_INFO: `/v3/users/5727feb2d296499f84633661814d56d6` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:15.854840 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fcf08-4ad3-4cbb-921e-2ffed59789f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5727feb2d296499f84633661814d56d6)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:15.856934 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fcf08-4ad3-4cbb-921e-2ffed59789f1 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:15.911399 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-8f2fcf08-4ad3-4cbb-921e-2ffed59789f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5727feb2d296499f84633661814d56d6'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:15.912083 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-8f2fcf08-4ad3-4cbb-921e-2ffed59789f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5727feb2d296499f84633661814d56d6'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:15.921053 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-8f2fcf08-4ad3-4cbb-921e-2ffed59789f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5727feb2d296499f84633661814d56d6'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:15.935004 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-8f2fcf08-4ad3-4cbb-921e-2ffed59789f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5727feb2d296499f84633661814d56d6'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:15.955182 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-8f2fcf08-4ad3-4cbb-921e-2ffed59789f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5727feb2d296499f84633661814d56d6'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:15.962357 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1365/2745] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:25:15 2022] DELETE /identity/v3/users/5727feb2d296499f84633661814d56d6 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:16.275631 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353f05c-79e2-4d0c-9bf8-d43132827398 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:16.277189 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-f353f05c-79e2-4d0c-9bf8-d43132827398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:16.292297 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353f05c-79e2-4d0c-9bf8-d43132827398 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:16.355626 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44eeb8-5202-48cf-bb0e-a0c02d4717d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:16.356502 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44eeb8-5202-48cf-bb0e-a0c02d4717d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:16.356786 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44eeb8-5202-48cf-bb0e-a0c02d4717d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:16.357063 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44eeb8-5202-48cf-bb0e-a0c02d4717d9 admin admin] PATH_INFO: `/v3/projects/58196dbd3d164926924eb0ebe9bcd34b` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:16.358302 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44eeb8-5202-48cf-bb0e-a0c02d4717d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58196dbd3d164926924eb0ebe9bcd34b)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:16.360213 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44eeb8-5202-48cf-bb0e-a0c02d4717d9 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:16.422422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-7e44eeb8-5202-48cf-bb0e-a0c02d4717d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58196dbd3d164926924eb0ebe9bcd34b', 'request_id': 'req-7e44eeb8-5202-48cf-bb0e-a0c02d4717d9'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:16.430875 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-7e44eeb8-5202-48cf-bb0e-a0c02d4717d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58196dbd3d164926924eb0ebe9bcd34b', 'request_id': 'req-7e44eeb8-5202-48cf-bb0e-a0c02d4717d9'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:16.444932 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-7e44eeb8-5202-48cf-bb0e-a0c02d4717d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58196dbd3d164926924eb0ebe9bcd34b', 'request_id': 'req-7e44eeb8-5202-48cf-bb0e-a0c02d4717d9'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:16.457602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-7e44eeb8-5202-48cf-bb0e-a0c02d4717d9 admin admin] The token cache is being invalidate because project 58196dbd3d164926924eb0ebe9bcd34b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:25:16.457888 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-7e44eeb8-5202-48cf-bb0e-a0c02d4717d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:16.458594 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-7e44eeb8-5202-48cf-bb0e-a0c02d4717d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:16.460144 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1381/2746] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:25:16 2022] DELETE /identity/v3/projects/58196dbd3d164926924eb0ebe9bcd34b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:16.467383 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f6acd-c81a-40ef-af25-71de6c49f131 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:16.467680 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f6acd-c81a-40ef-af25-71de6c49f131 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:16.467966 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f6acd-c81a-40ef-af25-71de6c49f131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:16.527213 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:16.538396 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-e49f6acd-c81a-40ef-af25-71de6c49f131 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:16.541782 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-e49f6acd-c81a-40ef-af25-71de6c49f131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:16.609209 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1366/2747] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:25:16.618532 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49bb4e-08f5-4be9-8ff8-b471c06626f4 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:16.619729 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49bb4e-08f5-4be9-8ff8-b471c06626f4 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:16.619729 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49bb4e-08f5-4be9-8ff8-b471c06626f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:16.638368 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-1a49bb4e-08f5-4be9-8ff8-b471c06626f4 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:16.639591 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-1a49bb4e-08f5-4be9-8ff8-b471c06626f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:16.647847 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1382/2748] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:16.651986 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f6acd-c81a-40ef-af25-71de6c49f131 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:16.662030 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f6acd-c81a-40ef-af25-71de6c49f131 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:16.666649 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705fac7-8532-44eb-8f3a-016c5342f7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:16.667309 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705fac7-8532-44eb-8f3a-016c5342f7bb admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:16.667697 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705fac7-8532-44eb-8f3a-016c5342f7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:16.667888 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705fac7-8532-44eb-8f3a-016c5342f7bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:16.668597 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705fac7-8532-44eb-8f3a-016c5342f7bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:25:16.668907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705fac7-8532-44eb-8f3a-016c5342f7bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:16.670574 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705fac7-8532-44eb-8f3a-016c5342f7bb admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:16.686084 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1367/2749] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:25:16.690472 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49bb4e-08f5-4be9-8ff8-b471c06626f4 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:16.700602 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49bb4e-08f5-4be9-8ff8-b471c06626f4 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:16.705285 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188b2bc-bc3c-4e93-89e3-25de024e0250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:16.705951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188b2bc-bc3c-4e93-89e3-25de024e0250 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:16.706275 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188b2bc-bc3c-4e93-89e3-25de024e0250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:16.706576 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188b2bc-bc3c-4e93-89e3-25de024e0250 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:16.707981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188b2bc-bc3c-4e93-89e3-25de024e0250 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:16.709912 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188b2bc-bc3c-4e93-89e3-25de024e0250 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:16.736834 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1383/2750] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:25:16 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:25:16.740566 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705fac7-8532-44eb-8f3a-016c5342f7bb admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:16.750691 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705fac7-8532-44eb-8f3a-016c5342f7bb admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:16.811494 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3e8e0-f4c6-4262-aa1f-a050ed1f644d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:16.812214 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3e8e0-f4c6-4262-aa1f-a050ed1f644d admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:16.812544 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3e8e0-f4c6-4262-aa1f-a050ed1f644d admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:16.812842 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3e8e0-f4c6-4262-aa1f-a050ed1f644d admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:16.813532 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3e8e0-f4c6-4262-aa1f-a050ed1f644d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:16.815483 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3e8e0-f4c6-4262-aa1f-a050ed1f644d admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:16.836238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1368/2751] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:25:16 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:25:16.840442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188b2bc-bc3c-4e93-89e3-25de024e0250 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:16.851418 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188b2bc-bc3c-4e93-89e3-25de024e0250 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:16.856004 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637aa6ed-64c4-403a-aeb7-b6b4eb86aaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:16.856666 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637aa6ed-64c4-403a-aeb7-b6b4eb86aaaf admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:16.856950 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637aa6ed-64c4-403a-aeb7-b6b4eb86aaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:16.857233 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637aa6ed-64c4-403a-aeb7-b6b4eb86aaaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:16.858234 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637aa6ed-64c4-403a-aeb7-b6b4eb86aaaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:16.859969 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637aa6ed-64c4-403a-aeb7-b6b4eb86aaaf admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:16.871120 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1384/2752] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:25:16.875350 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3e8e0-f4c6-4262-aa1f-a050ed1f644d admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:16.886244 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3e8e0-f4c6-4262-aa1f-a050ed1f644d admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:16.891161 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0127d6-8372-4aeb-962f-6cfbb3c5c38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:16.891844 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0127d6-8372-4aeb-962f-6cfbb3c5c38d admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:16.892131 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0127d6-8372-4aeb-962f-6cfbb3c5c38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:16.892412 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0127d6-8372-4aeb-962f-6cfbb3c5c38d admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:16.893141 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0127d6-8372-4aeb-962f-6cfbb3c5c38d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:16.895321 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0127d6-8372-4aeb-962f-6cfbb3c5c38d admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:16.905937 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1369/2753] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:25:16.910999 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637aa6ed-64c4-403a-aeb7-b6b4eb86aaaf admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:16.921853 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637aa6ed-64c4-403a-aeb7-b6b4eb86aaaf admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:16.927147 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cbda1-28a8-4766-9353-a03e2e1c7d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:16.928069 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cbda1-28a8-4766-9353-a03e2e1c7d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:16.928357 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cbda1-28a8-4766-9353-a03e2e1c7d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:16.928641 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cbda1-28a8-4766-9353-a03e2e1c7d54 admin admin] PATH_INFO: `/v3/projects/4fd0b54463d84a1eb064deff22cbe913/users/a67858c3a1304795b702cb2a6db16c63/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:16.946301 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0cbda1-28a8-4766-9353-a03e2e1c7d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd0b54463d84a1eb064deff22cbe913, user_id=a67858c3a1304795b702cb2a6db16c63, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:16.949015 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0cbda1-28a8-4766-9353-a03e2e1c7d54 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:16.962798 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1385/2754] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:25:16 2022] PUT /identity/v3/projects/4fd0b54463d84a1eb064deff22cbe913/users/a67858c3a1304795b702cb2a6db16c63/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:16.973797 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadc4a4-272c-42b7-a58b-deed5d0f3606 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:16.974086 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadc4a4-272c-42b7-a58b-deed5d0f3606 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:16.974402 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadc4a4-272c-42b7-a58b-deed5d0f3606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:17.002059 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-fdadc4a4-272c-42b7-a58b-deed5d0f3606 None None] MFA Rules not processed for user `a67858c3a1304795b702cb2a6db16c63`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:17.003305 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-fdadc4a4-272c-42b7-a58b-deed5d0f3606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:17.064072 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:17.070391 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1370/2755] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:17.075101 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cbda1-28a8-4766-9353-a03e2e1c7d54 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:17.093708 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:17.145660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cbda1-28a8-4766-9353-a03e2e1c7d54 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:17.150406 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96cb64-9496-4a5a-b750-4bd2ae10736c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:17.151086 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96cb64-9496-4a5a-b750-4bd2ae10736c admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:17.151370 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96cb64-9496-4a5a-b750-4bd2ae10736c admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:17.151777 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96cb64-9496-4a5a-b750-4bd2ae10736c admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:17.152539 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96cb64-9496-4a5a-b750-4bd2ae10736c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:17.155117 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96cb64-9496-4a5a-b750-4bd2ae10736c admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:17.183730 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1386/2756] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:25:17 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:25:17.187206 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadc4a4-272c-42b7-a58b-deed5d0f3606 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:17.197998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadc4a4-272c-42b7-a58b-deed5d0f3606 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:17.257826 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122e71e-9c6b-4977-aa16-9d05fd21250e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:17.258539 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122e71e-9c6b-4977-aa16-9d05fd21250e admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:17.258830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122e71e-9c6b-4977-aa16-9d05fd21250e admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:17.259111 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122e71e-9c6b-4977-aa16-9d05fd21250e admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:17.259815 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122e71e-9c6b-4977-aa16-9d05fd21250e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:17.261734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122e71e-9c6b-4977-aa16-9d05fd21250e admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:17.284104 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1371/2757] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:25:17 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:25:17.289036 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96cb64-9496-4a5a-b750-4bd2ae10736c admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:17.301603 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96cb64-9496-4a5a-b750-4bd2ae10736c admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:17.306350 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62288eb-0917-4207-b218-89a6b284174d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:17.307031 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62288eb-0917-4207-b218-89a6b284174d admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:17.307310 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62288eb-0917-4207-b218-89a6b284174d admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:17.307586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62288eb-0917-4207-b218-89a6b284174d admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:17.308310 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62288eb-0917-4207-b218-89a6b284174d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:17.309924 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62288eb-0917-4207-b218-89a6b284174d admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:17.325333 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1387/2758] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:25:17.329549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122e71e-9c6b-4977-aa16-9d05fd21250e admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:17.339809 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122e71e-9c6b-4977-aa16-9d05fd21250e admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:17.344519 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009af60-bc11-4313-a42d-3f95622cffbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:17.345432 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009af60-bc11-4313-a42d-3f95622cffbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:17.345720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009af60-bc11-4313-a42d-3f95622cffbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:17.346028 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009af60-bc11-4313-a42d-3f95622cffbb admin admin] PATH_INFO: `/v3/projects/57f6263fe9134a119844bfa23f5b5abf/users/6fdf8e1ba0a343dca490779c099809e6/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:17.362258 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009af60-bc11-4313-a42d-3f95622cffbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=57f6263fe9134a119844bfa23f5b5abf, user_id=6fdf8e1ba0a343dca490779c099809e6, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:17.365450 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009af60-bc11-4313-a42d-3f95622cffbb admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:17.379621 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1372/2759] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:25:17 2022] PUT /identity/v3/projects/57f6263fe9134a119844bfa23f5b5abf/users/6fdf8e1ba0a343dca490779c099809e6/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:17.383849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62288eb-0917-4207-b218-89a6b284174d admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:17.393877 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62288eb-0917-4207-b218-89a6b284174d admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:17.452875 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fba4a5-82a6-40c0-bdcb-c260d12832c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:17.453481 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fba4a5-82a6-40c0-bdcb-c260d12832c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:17.453769 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fba4a5-82a6-40c0-bdcb-c260d12832c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:17.454047 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fba4a5-82a6-40c0-bdcb-c260d12832c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:17.454812 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fba4a5-82a6-40c0-bdcb-c260d12832c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:17.456748 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fba4a5-82a6-40c0-bdcb-c260d12832c8 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:17.468133 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1388/2760] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:25:17.472302 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009af60-bc11-4313-a42d-3f95622cffbb admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:17.483228 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009af60-bc11-4313-a42d-3f95622cffbb admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:17.489741 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33623c2b-3b4f-46fa-ba58-9e4074352c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:17.490684 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33623c2b-3b4f-46fa-ba58-9e4074352c93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:17.490969 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33623c2b-3b4f-46fa-ba58-9e4074352c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:17.491284 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33623c2b-3b4f-46fa-ba58-9e4074352c93 admin admin] PATH_INFO: `/v3/projects/57f6263fe9134a119844bfa23f5b5abf/users/6fdf8e1ba0a343dca490779c099809e6/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:17.493319 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33623c2b-3b4f-46fa-ba58-9e4074352c93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57f6263fe9134a119844bfa23f5b5abf, user_id=6fdf8e1ba0a343dca490779c099809e6, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:17.496713 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33623c2b-3b4f-46fa-ba58-9e4074352c93 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:17.511165 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1373/2761] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:25:17 2022] PUT /identity/v3/projects/57f6263fe9134a119844bfa23f5b5abf/users/6fdf8e1ba0a343dca490779c099809e6/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:25:17.521459 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b717d3c-91c1-4a91-9918-c36c748b2524 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:17.521834 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b717d3c-91c1-4a91-9918-c36c748b2524 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:17.522328 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b717d3c-91c1-4a91-9918-c36c748b2524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:17.552849 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-8b717d3c-91c1-4a91-9918-c36c748b2524 None None] MFA Rules not processed for user `6fdf8e1ba0a343dca490779c099809e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:17.554236 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-8b717d3c-91c1-4a91-9918-c36c748b2524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:17.632170 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1389/2762] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:17.644365 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33623c2b-3b4f-46fa-ba58-9e4074352c93 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:17.646198 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-33623c2b-3b4f-46fa-ba58-9e4074352c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:17.732209 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33623c2b-3b4f-46fa-ba58-9e4074352c93 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:17.735925 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093bb28a-5352-4797-8da3-242a891dbc69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:17.736584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bb28a-5352-4797-8da3-242a891dbc69 service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:17.736870 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bb28a-5352-4797-8da3-242a891dbc69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:17.737146 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bb28a-5352-4797-8da3-242a891dbc69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:17.748375 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093bb28a-5352-4797-8da3-242a891dbc69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:17.749843 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093bb28a-5352-4797-8da3-242a891dbc69 service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:17.760908 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1374/2763] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:25:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:25:17.839008 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b717d3c-91c1-4a91-9918-c36c748b2524 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:17.849313 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b717d3c-91c1-4a91-9918-c36c748b2524 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:17.853280 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dca43b-caf0-4832-9611-3c9a46bfea73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:17.853605 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dca43b-caf0-4832-9611-3c9a46bfea73 service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:17.853891 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dca43b-caf0-4832-9611-3c9a46bfea73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:17.854229 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dca43b-caf0-4832-9611-3c9a46bfea73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:17.864136 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:17.914248 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dca43b-caf0-4832-9611-3c9a46bfea73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:17.915759 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dca43b-caf0-4832-9611-3c9a46bfea73 service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:17.924668 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1390/2764] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:25:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:25:24.695612 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093bb28a-5352-4797-8da3-242a891dbc69 service cinder] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:24.737003 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:24.759680 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093bb28a-5352-4797-8da3-242a891dbc69 service cinder] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:24.764222 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732e622-d0a7-4d5f-9858-dc0e3fcf899b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:24.765104 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732e622-d0a7-4d5f-9858-dc0e3fcf899b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:24.765392 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732e622-d0a7-4d5f-9858-dc0e3fcf899b admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:24.765671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732e622-d0a7-4d5f-9858-dc0e3fcf899b admin admin] PATH_INFO: `/v3/users/a67858c3a1304795b702cb2a6db16c63` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:24.767036 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732e622-d0a7-4d5f-9858-dc0e3fcf899b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a67858c3a1304795b702cb2a6db16c63)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:24.768995 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732e622-d0a7-4d5f-9858-dc0e3fcf899b admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:24.815554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-e732e622-d0a7-4d5f-9858-dc0e3fcf899b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a67858c3a1304795b702cb2a6db16c63'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:24.816818 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-e732e622-d0a7-4d5f-9858-dc0e3fcf899b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a67858c3a1304795b702cb2a6db16c63'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:24.825819 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-e732e622-d0a7-4d5f-9858-dc0e3fcf899b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a67858c3a1304795b702cb2a6db16c63'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:24.833470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-e732e622-d0a7-4d5f-9858-dc0e3fcf899b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a67858c3a1304795b702cb2a6db16c63'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:24.846013 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-e732e622-d0a7-4d5f-9858-dc0e3fcf899b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a67858c3a1304795b702cb2a6db16c63'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:24.852061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1375/2765] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:25:24 2022] DELETE /identity/v3/users/a67858c3a1304795b702cb2a6db16c63 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:24.856455 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600ba62-5675-4917-82fe-9386f788a10c None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:24.856935 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600ba62-5675-4917-82fe-9386f788a10c None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:24.857178 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600ba62-5675-4917-82fe-9386f788a10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:24.874952 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-0600ba62-5675-4917-82fe-9386f788a10c None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:24.876167 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-0600ba62-5675-4917-82fe-9386f788a10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:24.934972 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1391/2766] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:24.945119 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732e622-d0a7-4d5f-9858-dc0e3fcf899b admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:24.946597 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-e732e622-d0a7-4d5f-9858-dc0e3fcf899b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:25.004307 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732e622-d0a7-4d5f-9858-dc0e3fcf899b admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:25.008427 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05dd609-88aa-4b8e-ba2a-75d3526c2328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:25.009121 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dd609-88aa-4b8e-ba2a-75d3526c2328 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:25.009407 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dd609-88aa-4b8e-ba2a-75d3526c2328 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:25.009686 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dd609-88aa-4b8e-ba2a-75d3526c2328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:25.019066 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05dd609-88aa-4b8e-ba2a-75d3526c2328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:25.020500 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05dd609-88aa-4b8e-ba2a-75d3526c2328 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:25.030029 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1376/2767] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:25:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:25:25.298807 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600ba62-5675-4917-82fe-9386f788a10c None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:25.300934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-0600ba62-5675-4917-82fe-9386f788a10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:25.313690 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600ba62-5675-4917-82fe-9386f788a10c None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:25.318719 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af467520-a4da-473d-8835-02f938ed2832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:25.319611 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af467520-a4da-473d-8835-02f938ed2832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:25.319897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af467520-a4da-473d-8835-02f938ed2832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:25.320174 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af467520-a4da-473d-8835-02f938ed2832 admin admin] PATH_INFO: `/v3/projects/4fd0b54463d84a1eb064deff22cbe913` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:25.321381 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af467520-a4da-473d-8835-02f938ed2832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fd0b54463d84a1eb064deff22cbe913)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:25.323466 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af467520-a4da-473d-8835-02f938ed2832 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:25.371382 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-af467520-a4da-473d-8835-02f938ed2832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd0b54463d84a1eb064deff22cbe913', 'request_id': 'req-af467520-a4da-473d-8835-02f938ed2832'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:25.377608 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-af467520-a4da-473d-8835-02f938ed2832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd0b54463d84a1eb064deff22cbe913', 'request_id': 'req-af467520-a4da-473d-8835-02f938ed2832'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:25.385580 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-af467520-a4da-473d-8835-02f938ed2832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd0b54463d84a1eb064deff22cbe913', 'request_id': 'req-af467520-a4da-473d-8835-02f938ed2832'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:25.396656 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-af467520-a4da-473d-8835-02f938ed2832 admin admin] The token cache is being invalidate because project 4fd0b54463d84a1eb064deff22cbe913 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:25:25.396937 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-af467520-a4da-473d-8835-02f938ed2832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:25.397603 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-af467520-a4da-473d-8835-02f938ed2832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:25.399219 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1392/2768] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:25:25 2022] DELETE /identity/v3/projects/4fd0b54463d84a1eb064deff22cbe913 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:25.403327 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05dd609-88aa-4b8e-ba2a-75d3526c2328 service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:25.413862 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05dd609-88aa-4b8e-ba2a-75d3526c2328 service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:25.472783 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea943008-21a0-4ea5-ba8b-51fd61fd3859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:25.473697 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea943008-21a0-4ea5-ba8b-51fd61fd3859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:25.473978 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea943008-21a0-4ea5-ba8b-51fd61fd3859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:25.474355 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea943008-21a0-4ea5-ba8b-51fd61fd3859 admin admin] PATH_INFO: `/v3/users/6fdf8e1ba0a343dca490779c099809e6` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:25.475562 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea943008-21a0-4ea5-ba8b-51fd61fd3859 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fdf8e1ba0a343dca490779c099809e6)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:25.477738 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea943008-21a0-4ea5-ba8b-51fd61fd3859 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:25.479449 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:25.531037 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-ea943008-21a0-4ea5-ba8b-51fd61fd3859 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fdf8e1ba0a343dca490779c099809e6'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:25.531616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-ea943008-21a0-4ea5-ba8b-51fd61fd3859 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fdf8e1ba0a343dca490779c099809e6'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:25.540916 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-ea943008-21a0-4ea5-ba8b-51fd61fd3859 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fdf8e1ba0a343dca490779c099809e6'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:25.549101 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-ea943008-21a0-4ea5-ba8b-51fd61fd3859 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fdf8e1ba0a343dca490779c099809e6'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:25.562894 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-ea943008-21a0-4ea5-ba8b-51fd61fd3859 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fdf8e1ba0a343dca490779c099809e6'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:25.569647 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1377/2769] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:25:25 2022] DELETE /identity/v3/users/6fdf8e1ba0a343dca490779c099809e6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:25.887106 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af467520-a4da-473d-8835-02f938ed2832 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:25.889131 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-af467520-a4da-473d-8835-02f938ed2832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:25.903557 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af467520-a4da-473d-8835-02f938ed2832 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:25.951744 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:25.985970 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd597d-adb9-421a-b778-0d4348e1059c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:25.987460 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd597d-adb9-421a-b778-0d4348e1059c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:25.987848 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd597d-adb9-421a-b778-0d4348e1059c admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:25.988146 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd597d-adb9-421a-b778-0d4348e1059c admin admin] PATH_INFO: `/v3/projects/57f6263fe9134a119844bfa23f5b5abf` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:25.989384 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd597d-adb9-421a-b778-0d4348e1059c admin admin] RBAC: Authorizing `identity:delete_project(project_id=57f6263fe9134a119844bfa23f5b5abf)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:25.991366 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd597d-adb9-421a-b778-0d4348e1059c admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:26.044678 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-86bd597d-adb9-421a-b778-0d4348e1059c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57f6263fe9134a119844bfa23f5b5abf', 'request_id': 'req-86bd597d-adb9-421a-b778-0d4348e1059c'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:26.051508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-86bd597d-adb9-421a-b778-0d4348e1059c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57f6263fe9134a119844bfa23f5b5abf', 'request_id': 'req-86bd597d-adb9-421a-b778-0d4348e1059c'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:26.059330 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-86bd597d-adb9-421a-b778-0d4348e1059c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57f6263fe9134a119844bfa23f5b5abf', 'request_id': 'req-86bd597d-adb9-421a-b778-0d4348e1059c'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:26.071785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-86bd597d-adb9-421a-b778-0d4348e1059c admin admin] The token cache is being invalidate because project 57f6263fe9134a119844bfa23f5b5abf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:25:26.072163 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-86bd597d-adb9-421a-b778-0d4348e1059c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:26.072737 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-86bd597d-adb9-421a-b778-0d4348e1059c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:26.074346 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1393/2770] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:25:25 2022] DELETE /identity/v3/projects/57f6263fe9134a119844bfa23f5b5abf => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:26.079418 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731291f-549f-4cce-b07d-bb7b41df7502 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:26.080021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731291f-549f-4cce-b07d-bb7b41df7502 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:26.080021 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731291f-549f-4cce-b07d-bb7b41df7502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:26.100407 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-a731291f-549f-4cce-b07d-bb7b41df7502 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:26.101649 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-a731291f-549f-4cce-b07d-bb7b41df7502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:26.168472 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1378/2771] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:26.177389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dde25-982e-4002-9b75-a91697326aac None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:26.177683 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dde25-982e-4002-9b75-a91697326aac None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:26.177965 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dde25-982e-4002-9b75-a91697326aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:26.197082 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-d78dde25-982e-4002-9b75-a91697326aac None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:26.198352 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-d78dde25-982e-4002-9b75-a91697326aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:26.206694 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1394/2772] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:26.211613 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731291f-549f-4cce-b07d-bb7b41df7502 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:26.224564 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731291f-549f-4cce-b07d-bb7b41df7502 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:26.229230 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef24831-b9a1-4dbd-8585-bee18650332b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:26.229938 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef24831-b9a1-4dbd-8585-bee18650332b admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:26.230256 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef24831-b9a1-4dbd-8585-bee18650332b admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:26.230540 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef24831-b9a1-4dbd-8585-bee18650332b admin admin] PATH_INFO: `/v3/domains` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:26.231272 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef24831-b9a1-4dbd-8585-bee18650332b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:25:26.231581 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef24831-b9a1-4dbd-8585-bee18650332b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:26.234220 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef24831-b9a1-4dbd-8585-bee18650332b admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:26.247931 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1379/2773] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:25:26.252294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dde25-982e-4002-9b75-a91697326aac None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:26.262014 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dde25-982e-4002-9b75-a91697326aac None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:26.267688 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f2b50-e11e-4828-b87d-a970719e3a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:26.268387 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f2b50-e11e-4828-b87d-a970719e3a83 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:26.268658 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f2b50-e11e-4828-b87d-a970719e3a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:26.269009 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f2b50-e11e-4828-b87d-a970719e3a83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:26.269714 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f2b50-e11e-4828-b87d-a970719e3a83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:26.271671 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f2b50-e11e-4828-b87d-a970719e3a83 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:26.302982 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1395/2774] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:25:26 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:25:26.304127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef24831-b9a1-4dbd-8585-bee18650332b admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:26.314367 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef24831-b9a1-4dbd-8585-bee18650332b admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:26.371739 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e19d8-a525-4cd2-b8f7-e3095c42e9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:26.372431 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e19d8-a525-4cd2-b8f7-e3095c42e9b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:26.372719 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e19d8-a525-4cd2-b8f7-e3095c42e9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:26.372998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e19d8-a525-4cd2-b8f7-e3095c42e9b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:26.373690 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e19d8-a525-4cd2-b8f7-e3095c42e9b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:26.375648 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e19d8-a525-4cd2-b8f7-e3095c42e9b9 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:26.385739 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:26.401205 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1380/2775] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:25:26 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:25:26.402446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f2b50-e11e-4828-b87d-a970719e3a83 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:26.413561 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f2b50-e11e-4828-b87d-a970719e3a83 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:26.418185 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c632b-c4ef-4366-a501-21d4f8928545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:26.418860 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c632b-c4ef-4366-a501-21d4f8928545 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:26.419148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c632b-c4ef-4366-a501-21d4f8928545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:26.419431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c632b-c4ef-4366-a501-21d4f8928545 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:26.420162 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c632b-c4ef-4366-a501-21d4f8928545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:26.421783 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c632b-c4ef-4366-a501-21d4f8928545 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:26.434097 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1396/2776] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:25:26.438191 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e19d8-a525-4cd2-b8f7-e3095c42e9b9 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:26.448223 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e19d8-a525-4cd2-b8f7-e3095c42e9b9 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:26.452817 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee055a1f-514e-4b3a-a492-0c19695ee70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:26.453488 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee055a1f-514e-4b3a-a492-0c19695ee70c admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:26.453775 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee055a1f-514e-4b3a-a492-0c19695ee70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:26.454050 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee055a1f-514e-4b3a-a492-0c19695ee70c admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:26.454809 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee055a1f-514e-4b3a-a492-0c19695ee70c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:26.456930 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee055a1f-514e-4b3a-a492-0c19695ee70c admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:26.467831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1381/2777] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:25:26.472888 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c632b-c4ef-4366-a501-21d4f8928545 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:26.483103 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c632b-c4ef-4366-a501-21d4f8928545 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:26.487816 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675180a-e4a6-490b-a33f-1174c6ca2267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:26.488709 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675180a-e4a6-490b-a33f-1174c6ca2267 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:26.488995 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675180a-e4a6-490b-a33f-1174c6ca2267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:26.489274 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675180a-e4a6-490b-a33f-1174c6ca2267 admin admin] PATH_INFO: `/v3/projects/c1219b79fc824467a9dfe3f022e60e3c/users/4280fe2acc574e09bcfded8675d4852f/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:26.504697 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675180a-e4a6-490b-a33f-1174c6ca2267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1219b79fc824467a9dfe3f022e60e3c, user_id=4280fe2acc574e09bcfded8675d4852f, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:26.507930 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675180a-e4a6-490b-a33f-1174c6ca2267 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:26.522218 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1397/2778] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:25:26 2022] PUT /identity/v3/projects/c1219b79fc824467a9dfe3f022e60e3c/users/4280fe2acc574e09bcfded8675d4852f/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:26.533633 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca53efe-431f-478a-af7a-8d8c0f7fb192 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:26.533912 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca53efe-431f-478a-af7a-8d8c0f7fb192 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:26.535204 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca53efe-431f-478a-af7a-8d8c0f7fb192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:26.566212 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-cca53efe-431f-478a-af7a-8d8c0f7fb192 None None] MFA Rules not processed for user `4280fe2acc574e09bcfded8675d4852f`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:26.567624 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-cca53efe-431f-478a-af7a-8d8c0f7fb192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:26.643507 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1382/2779] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:25:26.649031 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675180a-e4a6-490b-a33f-1174c6ca2267 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:26.720076 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675180a-e4a6-490b-a33f-1174c6ca2267 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:26.725877 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceff501-61ca-4e05-9013-89fba436efd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:26.726581 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceff501-61ca-4e05-9013-89fba436efd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:26.726873 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceff501-61ca-4e05-9013-89fba436efd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:26.727161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceff501-61ca-4e05-9013-89fba436efd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:26.727850 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceff501-61ca-4e05-9013-89fba436efd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:26.729888 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceff501-61ca-4e05-9013-89fba436efd1 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:26.733386 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:26.758010 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1398/2780] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:25:26 2022] POST /identity/v3/projects => generated 389 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:25:26.762123 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca53efe-431f-478a-af7a-8d8c0f7fb192 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:26.773823 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca53efe-431f-478a-af7a-8d8c0f7fb192 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:26.832336 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ce5cf-6092-4b26-bba5-8467aed5df02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:26.832967 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ce5cf-6092-4b26-bba5-8467aed5df02 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:26.833255 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ce5cf-6092-4b26-bba5-8467aed5df02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:26.833534 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ce5cf-6092-4b26-bba5-8467aed5df02 admin admin] PATH_INFO: `/v3/users` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:26.834304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ce5cf-6092-4b26-bba5-8467aed5df02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:26.836321 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ce5cf-6092-4b26-bba5-8467aed5df02 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:26.856486 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1383/2781] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:25:26 2022] POST /identity/v3/users => generated 301 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:25:26.860447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceff501-61ca-4e05-9013-89fba436efd1 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:26.871128 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceff501-61ca-4e05-9013-89fba436efd1 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:26.875958 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a9adb-2299-4a15-8eec-a0a3828d2c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:26.876659 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a9adb-2299-4a15-8eec-a0a3828d2c4c admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:26.876943 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a9adb-2299-4a15-8eec-a0a3828d2c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:26.877221 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a9adb-2299-4a15-8eec-a0a3828d2c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:26.877942 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a9adb-2299-4a15-8eec-a0a3828d2c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:26.880079 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a9adb-2299-4a15-8eec-a0a3828d2c4c admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:26.891135 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1399/2782] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:25:26.895870 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ce5cf-6092-4b26-bba5-8467aed5df02 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:26.905923 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ce5cf-6092-4b26-bba5-8467aed5df02 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:26.910606 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60631827-09c8-45c4-b3a5-dabe9ffda648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:26.911513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60631827-09c8-45c4-b3a5-dabe9ffda648 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:26.911794 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60631827-09c8-45c4-b3a5-dabe9ffda648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:26.912069 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60631827-09c8-45c4-b3a5-dabe9ffda648 admin admin] PATH_INFO: `/v3/projects/79437d206bb143c28e913f498b3b4e05/users/450d7a96d97943bf879ea23c73a600cd/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:26.927848 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60631827-09c8-45c4-b3a5-dabe9ffda648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79437d206bb143c28e913f498b3b4e05, user_id=450d7a96d97943bf879ea23c73a600cd, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:26.930382 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60631827-09c8-45c4-b3a5-dabe9ffda648 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:26.945755 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1384/2783] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:25:26 2022] PUT /identity/v3/projects/79437d206bb143c28e913f498b3b4e05/users/450d7a96d97943bf879ea23c73a600cd/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:26.949826 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a9adb-2299-4a15-8eec-a0a3828d2c4c admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:26.962072 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a9adb-2299-4a15-8eec-a0a3828d2c4c admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:27.023516 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708503b6-db23-449a-88a7-648fb62a86bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:27.024487 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708503b6-db23-449a-88a7-648fb62a86bb admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:27.024889 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708503b6-db23-449a-88a7-648fb62a86bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:27.025238 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708503b6-db23-449a-88a7-648fb62a86bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:27.026944 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708503b6-db23-449a-88a7-648fb62a86bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:27.028672 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708503b6-db23-449a-88a7-648fb62a86bb admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:27.042089 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1400/2784] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:25:27.043429 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60631827-09c8-45c4-b3a5-dabe9ffda648 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:27.053965 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60631827-09c8-45c4-b3a5-dabe9ffda648 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:27.058718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fd45a-1364-455d-9424-125502ca2c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:27.059616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fd45a-1364-455d-9424-125502ca2c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:27.059900 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fd45a-1364-455d-9424-125502ca2c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:27.060176 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fd45a-1364-455d-9424-125502ca2c2c admin admin] PATH_INFO: `/v3/projects/79437d206bb143c28e913f498b3b4e05/users/450d7a96d97943bf879ea23c73a600cd/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:27.062180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fd45a-1364-455d-9424-125502ca2c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=79437d206bb143c28e913f498b3b4e05, user_id=450d7a96d97943bf879ea23c73a600cd, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:27.064809 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fd45a-1364-455d-9424-125502ca2c2c admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:27.076755 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1385/2785] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:25:27 2022] PUT /identity/v3/projects/79437d206bb143c28e913f498b3b4e05/users/450d7a96d97943bf879ea23c73a600cd/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:27.088635 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dc19a-c8e5-41ba-a74d-620280dee708 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:27.088863 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dc19a-c8e5-41ba-a74d-620280dee708 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:27.089107 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dc19a-c8e5-41ba-a74d-620280dee708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:27.116452 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-622dc19a-c8e5-41ba-a74d-620280dee708 None None] MFA Rules not processed for user `450d7a96d97943bf879ea23c73a600cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:27.117714 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-622dc19a-c8e5-41ba-a74d-620280dee708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:27.191865 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1401/2786] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:27.204258 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fd45a-1364-455d-9424-125502ca2c2c admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:27.206077 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-1a9fd45a-1364-455d-9424-125502ca2c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:27.238867 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:27.275008 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fd45a-1364-455d-9424-125502ca2c2c admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:27.278667 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b90840-e674-498a-988d-ee95231421b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:27.279327 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b90840-e674-498a-988d-ee95231421b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:27.279605 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b90840-e674-498a-988d-ee95231421b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:27.279877 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b90840-e674-498a-988d-ee95231421b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:27.289287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b90840-e674-498a-988d-ee95231421b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:27.290764 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b90840-e674-498a-988d-ee95231421b8 service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:27.300960 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1386/2787] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:25:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:25:27.430860 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dc19a-c8e5-41ba-a74d-620280dee708 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:27.490988 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:27.497107 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dc19a-c8e5-41ba-a74d-620280dee708 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:27.503267 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e1270-6bfe-4302-acc6-b7e7c2f93d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:27.504280 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e1270-6bfe-4302-acc6-b7e7c2f93d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:27.504830 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e1270-6bfe-4302-acc6-b7e7c2f93d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:27.505152 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e1270-6bfe-4302-acc6-b7e7c2f93d3a admin admin] PATH_INFO: `/v3/users/4280fe2acc574e09bcfded8675d4852f` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:27.507175 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e1270-6bfe-4302-acc6-b7e7c2f93d3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4280fe2acc574e09bcfded8675d4852f)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:27.509188 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e1270-6bfe-4302-acc6-b7e7c2f93d3a admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:27.571620 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-616e1270-6bfe-4302-acc6-b7e7c2f93d3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4280fe2acc574e09bcfded8675d4852f'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:27.573623 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b90840-e674-498a-988d-ee95231421b8 service cinder] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:27.575576 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-25b90840-e674-498a-988d-ee95231421b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:27.588244 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-616e1270-6bfe-4302-acc6-b7e7c2f93d3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4280fe2acc574e09bcfded8675d4852f'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:27.598074 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-616e1270-6bfe-4302-acc6-b7e7c2f93d3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4280fe2acc574e09bcfded8675d4852f'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:27.599127 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-616e1270-6bfe-4302-acc6-b7e7c2f93d3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4280fe2acc574e09bcfded8675d4852f'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:27.613824 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-616e1270-6bfe-4302-acc6-b7e7c2f93d3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4280fe2acc574e09bcfded8675d4852f'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:27.621572 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1402/2788] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:25:27 2022] DELETE /identity/v3/users/4280fe2acc574e09bcfded8675d4852f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:27.626216 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1fae4-ca49-4fda-a86f-04ab2d7d15de None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:27.626515 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1fae4-ca49-4fda-a86f-04ab2d7d15de None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:27.626797 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1fae4-ca49-4fda-a86f-04ab2d7d15de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:27.648908 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-d0d1fae4-ca49-4fda-a86f-04ab2d7d15de None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:27.651470 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-d0d1fae4-ca49-4fda-a86f-04ab2d7d15de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:27.690486 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b90840-e674-498a-988d-ee95231421b8 service cinder] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:27.725914 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1403/2789] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:25:27.735800 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1fae4-ca49-4fda-a86f-04ab2d7d15de None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:27.739423 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-d0d1fae4-ca49-4fda-a86f-04ab2d7d15de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:27.765974 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb0182-8c7f-42b5-abe1-cc07587e3066 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '698828dd940f46e2b493ba55cd894eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:27.766688 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb0182-8c7f-42b5-abe1-cc07587e3066 service placement] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:27.766967 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb0182-8c7f-42b5-abe1-cc07587e3066 service placement] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:27.767249 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb0182-8c7f-42b5-abe1-cc07587e3066 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:27.769572 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-98fb0182-8c7f-42b5-abe1-cc07587e3066 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:27.789659 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb0182-8c7f-42b5-abe1-cc07587e3066 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:27.791299 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb0182-8c7f-42b5-abe1-cc07587e3066 service placement] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:27.810472 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1fae4-ca49-4fda-a86f-04ab2d7d15de None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:27.811696 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1387/2790] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:25:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:25:27.814475 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36359dde-d619-4c10-a3ca-ee2104ccc3b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:27.815146 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36359dde-d619-4c10-a3ca-ee2104ccc3b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:27.815433 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36359dde-d619-4c10-a3ca-ee2104ccc3b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:27.815754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36359dde-d619-4c10-a3ca-ee2104ccc3b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:27.827904 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36359dde-d619-4c10-a3ca-ee2104ccc3b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:27.829452 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36359dde-d619-4c10-a3ca-ee2104ccc3b6 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:27.840742 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1404/2791] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:25:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:25:28.156926 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb0182-8c7f-42b5-abe1-cc07587e3066 service placement] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:28.158718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-98fb0182-8c7f-42b5-abe1-cc07587e3066 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:28.188381 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb0182-8c7f-42b5-abe1-cc07587e3066 service placement] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:28.194297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357ad4b-7d55-4437-af5a-9603d87e97bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:28.195266 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357ad4b-7d55-4437-af5a-9603d87e97bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:28.195554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357ad4b-7d55-4437-af5a-9603d87e97bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:28.195831 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357ad4b-7d55-4437-af5a-9603d87e97bb admin admin] PATH_INFO: `/v3/projects/c1219b79fc824467a9dfe3f022e60e3c` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:28.197032 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e357ad4b-7d55-4437-af5a-9603d87e97bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1219b79fc824467a9dfe3f022e60e3c)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:28.198972 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e357ad4b-7d55-4437-af5a-9603d87e97bb admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:28.243015 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:28.252427 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-e357ad4b-7d55-4437-af5a-9603d87e97bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1219b79fc824467a9dfe3f022e60e3c', 'request_id': 'req-e357ad4b-7d55-4437-af5a-9603d87e97bb'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:28.259704 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-e357ad4b-7d55-4437-af5a-9603d87e97bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1219b79fc824467a9dfe3f022e60e3c', 'request_id': 'req-e357ad4b-7d55-4437-af5a-9603d87e97bb'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:28.267527 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-e357ad4b-7d55-4437-af5a-9603d87e97bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1219b79fc824467a9dfe3f022e60e3c', 'request_id': 'req-e357ad4b-7d55-4437-af5a-9603d87e97bb'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:28.279910 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-e357ad4b-7d55-4437-af5a-9603d87e97bb admin admin] The token cache is being invalidate because project c1219b79fc824467a9dfe3f022e60e3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:25:28.280201 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-e357ad4b-7d55-4437-af5a-9603d87e97bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:28.280856 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-e357ad4b-7d55-4437-af5a-9603d87e97bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:28.282480 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1388/2792] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:25:28 2022] DELETE /identity/v3/projects/c1219b79fc824467a9dfe3f022e60e3c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:25:28.287193 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36359dde-d619-4c10-a3ca-ee2104ccc3b6 service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:28.297837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36359dde-d619-4c10-a3ca-ee2104ccc3b6 service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:28.311813 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:28.366012 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed3abb-1079-4c3c-a153-ac47d954c377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:28.366944 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed3abb-1079-4c3c-a153-ac47d954c377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:28.367234 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed3abb-1079-4c3c-a153-ac47d954c377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:28.367543 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed3abb-1079-4c3c-a153-ac47d954c377 admin admin] PATH_INFO: `/v3/users/450d7a96d97943bf879ea23c73a600cd` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:28.368810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed3abb-1079-4c3c-a153-ac47d954c377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=450d7a96d97943bf879ea23c73a600cd)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:28.371284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed3abb-1079-4c3c-a153-ac47d954c377 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:28.419074 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-00ed3abb-1079-4c3c-a153-ac47d954c377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '450d7a96d97943bf879ea23c73a600cd'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:28.427348 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-00ed3abb-1079-4c3c-a153-ac47d954c377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '450d7a96d97943bf879ea23c73a600cd'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:28.435158 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-00ed3abb-1079-4c3c-a153-ac47d954c377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '450d7a96d97943bf879ea23c73a600cd'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:28.436004 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-00ed3abb-1079-4c3c-a153-ac47d954c377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '450d7a96d97943bf879ea23c73a600cd'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:28.448511 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-00ed3abb-1079-4c3c-a153-ac47d954c377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '450d7a96d97943bf879ea23c73a600cd'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:28.455329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1405/2793] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:25:28 2022] DELETE /identity/v3/users/450d7a96d97943bf879ea23c73a600cd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:25:28.738243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357ad4b-7d55-4437-af5a-9603d87e97bb admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:28.740267 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-e357ad4b-7d55-4437-af5a-9603d87e97bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:28.756296 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357ad4b-7d55-4437-af5a-9603d87e97bb admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:28.818561 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578fdd1-6ff0-4d78-9b6d-9e9dc4a5fda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:28.819447 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578fdd1-6ff0-4d78-9b6d-9e9dc4a5fda4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:28.819740 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578fdd1-6ff0-4d78-9b6d-9e9dc4a5fda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:28.820022 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578fdd1-6ff0-4d78-9b6d-9e9dc4a5fda4 admin admin] PATH_INFO: `/v3/projects/79437d206bb143c28e913f498b3b4e05` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:28.821376 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578fdd1-6ff0-4d78-9b6d-9e9dc4a5fda4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79437d206bb143c28e913f498b3b4e05)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:28.823370 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578fdd1-6ff0-4d78-9b6d-9e9dc4a5fda4 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:28.873695 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-c578fdd1-6ff0-4d78-9b6d-9e9dc4a5fda4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79437d206bb143c28e913f498b3b4e05', 'request_id': 'req-c578fdd1-6ff0-4d78-9b6d-9e9dc4a5fda4'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:28.881279 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-c578fdd1-6ff0-4d78-9b6d-9e9dc4a5fda4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79437d206bb143c28e913f498b3b4e05', 'request_id': 'req-c578fdd1-6ff0-4d78-9b6d-9e9dc4a5fda4'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:28.892445 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-c578fdd1-6ff0-4d78-9b6d-9e9dc4a5fda4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79437d206bb143c28e913f498b3b4e05', 'request_id': 'req-c578fdd1-6ff0-4d78-9b6d-9e9dc4a5fda4'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:28.904881 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-c578fdd1-6ff0-4d78-9b6d-9e9dc4a5fda4 admin admin] The token cache is being invalidate because project 79437d206bb143c28e913f498b3b4e05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:25:28.905229 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-c578fdd1-6ff0-4d78-9b6d-9e9dc4a5fda4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:28.906061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-c578fdd1-6ff0-4d78-9b6d-9e9dc4a5fda4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:28.911264 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1389/2794] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:25:28 2022] DELETE /identity/v3/projects/79437d206bb143c28e913f498b3b4e05 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:28.912986 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a08b7-bcef-4cc5-a231-63de3a22305b None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:28.913281 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a08b7-bcef-4cc5-a231-63de3a22305b None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:28.913559 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a08b7-bcef-4cc5-a231-63de3a22305b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:28.949305 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-e90a08b7-bcef-4cc5-a231-63de3a22305b None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:28.951973 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-e90a08b7-bcef-4cc5-a231-63de3a22305b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:29.025915 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1406/2795] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:29.034384 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c24756-1288-46a7-a3bf-232cfbbbea1f None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:29.035481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c24756-1288-46a7-a3bf-232cfbbbea1f None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:29.036887 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c24756-1288-46a7-a3bf-232cfbbbea1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:29.055930 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-81c24756-1288-46a7-a3bf-232cfbbbea1f None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:29.057155 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-81c24756-1288-46a7-a3bf-232cfbbbea1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:29.065308 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1390/2796] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:29.069585 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a08b7-bcef-4cc5-a231-63de3a22305b None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:29.080079 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a08b7-bcef-4cc5-a231-63de3a22305b None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:29.085122 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d5595-c4d8-4350-badd-3355d7bec225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:29.085797 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d5595-c4d8-4350-badd-3355d7bec225 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:29.086085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d5595-c4d8-4350-badd-3355d7bec225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:29.086395 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d5595-c4d8-4350-badd-3355d7bec225 admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:29.087354 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d5595-c4d8-4350-badd-3355d7bec225 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:25:29.087660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d5595-c4d8-4350-badd-3355d7bec225 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:29.089701 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d5595-c4d8-4350-badd-3355d7bec225 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:29.103703 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1407/2797] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:25:29.107875 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c24756-1288-46a7-a3bf-232cfbbbea1f None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:29.117974 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c24756-1288-46a7-a3bf-232cfbbbea1f None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:29.126070 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42946b18-973e-4333-94b2-ab2865d9dda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:29.126784 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42946b18-973e-4333-94b2-ab2865d9dda2 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:29.127126 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42946b18-973e-4333-94b2-ab2865d9dda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:29.127554 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42946b18-973e-4333-94b2-ab2865d9dda2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:29.128296 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42946b18-973e-4333-94b2-ab2865d9dda2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:29.130504 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42946b18-973e-4333-94b2-ab2865d9dda2 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:29.158194 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1391/2798] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:25:29 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:25:29.162924 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d5595-c4d8-4350-badd-3355d7bec225 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:29.173496 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d5595-c4d8-4350-badd-3355d7bec225 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:29.195332 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:29.238402 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893841e-730a-46d0-8b0f-9444a1185e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:29.239202 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893841e-730a-46d0-8b0f-9444a1185e45 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:29.239489 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893841e-730a-46d0-8b0f-9444a1185e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:29.239791 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893841e-730a-46d0-8b0f-9444a1185e45 admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:29.240534 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893841e-730a-46d0-8b0f-9444a1185e45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:29.242580 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893841e-730a-46d0-8b0f-9444a1185e45 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:29.265580 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1408/2799] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:25:29 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:25:29.266872 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42946b18-973e-4333-94b2-ab2865d9dda2 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:29.279778 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42946b18-973e-4333-94b2-ab2865d9dda2 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:29.301016 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c6a4e-cf1e-44e3-b13a-5948d617fb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:29.302499 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c6a4e-cf1e-44e3-b13a-5948d617fb85 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:29.302799 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c6a4e-cf1e-44e3-b13a-5948d617fb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:29.303080 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c6a4e-cf1e-44e3-b13a-5948d617fb85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:29.303823 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c6a4e-cf1e-44e3-b13a-5948d617fb85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:29.305944 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c6a4e-cf1e-44e3-b13a-5948d617fb85 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:29.322184 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1392/2800] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:25:29.324970 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893841e-730a-46d0-8b0f-9444a1185e45 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:29.338799 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893841e-730a-46d0-8b0f-9444a1185e45 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:29.344493 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c06bd5-01e5-4c0c-b6a5-43dab2a323b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:29.345282 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c06bd5-01e5-4c0c-b6a5-43dab2a323b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:29.345579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c06bd5-01e5-4c0c-b6a5-43dab2a323b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:29.345868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c06bd5-01e5-4c0c-b6a5-43dab2a323b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:29.346644 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c06bd5-01e5-4c0c-b6a5-43dab2a323b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:29.348784 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c06bd5-01e5-4c0c-b6a5-43dab2a323b2 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:29.359545 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1409/2801] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:25:29.364132 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c6a4e-cf1e-44e3-b13a-5948d617fb85 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:29.375034 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c6a4e-cf1e-44e3-b13a-5948d617fb85 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:29.384355 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03796f-1596-44a5-b16b-76b4a3ec2ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:29.385350 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03796f-1596-44a5-b16b-76b4a3ec2ea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:29.385782 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03796f-1596-44a5-b16b-76b4a3ec2ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:29.386061 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03796f-1596-44a5-b16b-76b4a3ec2ea0 admin admin] PATH_INFO: `/v3/projects/f2e2b833589d457b8008f1c39a3add1a/users/10b77af011664d23af6d812ccdd6d233/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:29.401238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:29.404731 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03796f-1596-44a5-b16b-76b4a3ec2ea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2e2b833589d457b8008f1c39a3add1a, user_id=10b77af011664d23af6d812ccdd6d233, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:29.408549 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03796f-1596-44a5-b16b-76b4a3ec2ea0 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:29.426865 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1393/2802] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:25:29 2022] PUT /identity/v3/projects/f2e2b833589d457b8008f1c39a3add1a/users/10b77af011664d23af6d812ccdd6d233/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:29.445702 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e92f1a-ba90-406f-9b4d-0316353584fd None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:29.446260 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e92f1a-ba90-406f-9b4d-0316353584fd None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:29.446774 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e92f1a-ba90-406f-9b4d-0316353584fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:29.484495 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-50e92f1a-ba90-406f-9b4d-0316353584fd None None] MFA Rules not processed for user `10b77af011664d23af6d812ccdd6d233`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:29.485619 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-50e92f1a-ba90-406f-9b4d-0316353584fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:29.562963 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1410/2803] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:29.564290 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03796f-1596-44a5-b16b-76b4a3ec2ea0 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:29.628118 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03796f-1596-44a5-b16b-76b4a3ec2ea0 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:29.633306 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f98791-ca84-41d6-a42a-aee1fad33705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:29.633985 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f98791-ca84-41d6-a42a-aee1fad33705 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:29.634306 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f98791-ca84-41d6-a42a-aee1fad33705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:29.634637 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f98791-ca84-41d6-a42a-aee1fad33705 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:29.635497 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f98791-ca84-41d6-a42a-aee1fad33705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:29.637230 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f98791-ca84-41d6-a42a-aee1fad33705 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:29.668929 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1394/2804] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:25:29 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:25:29.673873 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e92f1a-ba90-406f-9b4d-0316353584fd None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:29.691098 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e92f1a-ba90-406f-9b4d-0316353584fd None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:29.758013 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04d9b8-e465-4fa1-b73f-86c9cb1a899c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:29.758855 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04d9b8-e465-4fa1-b73f-86c9cb1a899c admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:29.759149 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04d9b8-e465-4fa1-b73f-86c9cb1a899c admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:29.759429 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04d9b8-e465-4fa1-b73f-86c9cb1a899c admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:29.760130 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04d9b8-e465-4fa1-b73f-86c9cb1a899c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:29.762148 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04d9b8-e465-4fa1-b73f-86c9cb1a899c admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:29.787692 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1411/2805] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:25:29 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:25:29.791476 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f98791-ca84-41d6-a42a-aee1fad33705 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:29.802466 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f98791-ca84-41d6-a42a-aee1fad33705 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:29.807582 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f13e7-8641-45a7-91bf-67b71acbdbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:29.808224 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f13e7-8641-45a7-91bf-67b71acbdbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:29.808494 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f13e7-8641-45a7-91bf-67b71acbdbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:29.808773 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f13e7-8641-45a7-91bf-67b71acbdbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:29.809516 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f13e7-8641-45a7-91bf-67b71acbdbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:29.811188 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f13e7-8641-45a7-91bf-67b71acbdbb7 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:29.823877 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1395/2806] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:25:29.827870 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04d9b8-e465-4fa1-b73f-86c9cb1a899c admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:29.840000 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04d9b8-e465-4fa1-b73f-86c9cb1a899c admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:29.844946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e591b6-e461-412b-bb26-43ac0c97f93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:29.845719 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e591b6-e461-412b-bb26-43ac0c97f93d admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:29.846071 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e591b6-e461-412b-bb26-43ac0c97f93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:29.846447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e591b6-e461-412b-bb26-43ac0c97f93d admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:29.847298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e591b6-e461-412b-bb26-43ac0c97f93d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:29.848975 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e591b6-e461-412b-bb26-43ac0c97f93d admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:29.860110 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1412/2807] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:25:29.864596 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f13e7-8641-45a7-91bf-67b71acbdbb7 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:29.874935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f13e7-8641-45a7-91bf-67b71acbdbb7 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:29.880126 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20652c96-c3a6-41a3-a497-f4d9d1075a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:29.881087 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20652c96-c3a6-41a3-a497-f4d9d1075a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:29.881434 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20652c96-c3a6-41a3-a497-f4d9d1075a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:29.882700 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20652c96-c3a6-41a3-a497-f4d9d1075a2a admin admin] PATH_INFO: `/v3/projects/d401dc75f76846a89f1a459245d637eb/users/41ea4811501e484d98c7910b98825376/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:29.898374 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20652c96-c3a6-41a3-a497-f4d9d1075a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d401dc75f76846a89f1a459245d637eb, user_id=41ea4811501e484d98c7910b98825376, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:29.901084 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20652c96-c3a6-41a3-a497-f4d9d1075a2a admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:29.916779 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1396/2808] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:25:29 2022] PUT /identity/v3/projects/d401dc75f76846a89f1a459245d637eb/users/41ea4811501e484d98c7910b98825376/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:29.986011 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dd972-bcaa-4e42-98d5-a1c5b400620a None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:29.986347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dd972-bcaa-4e42-98d5-a1c5b400620a None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:29.986636 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dd972-bcaa-4e42-98d5-a1c5b400620a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:30.013785 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:30.025751 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-4f2dd972-bcaa-4e42-98d5-a1c5b400620a None None] MFA Rules not processed for user `41ea4811501e484d98c7910b98825376`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:30.027040 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-4f2dd972-bcaa-4e42-98d5-a1c5b400620a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:30.096444 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1413/2809] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:30.101213 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20652c96-c3a6-41a3-a497-f4d9d1075a2a admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:30.170955 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20652c96-c3a6-41a3-a497-f4d9d1075a2a admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:30.176705 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef4cb4-fab8-4684-80c8-765a517febab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:30.177380 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef4cb4-fab8-4684-80c8-765a517febab admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:30.177679 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef4cb4-fab8-4684-80c8-765a517febab admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:30.177949 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef4cb4-fab8-4684-80c8-765a517febab admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:30.178785 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef4cb4-fab8-4684-80c8-765a517febab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:30.180691 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef4cb4-fab8-4684-80c8-765a517febab admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:30.213520 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1397/2810] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:25:30 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:25:30.216043 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dd972-bcaa-4e42-98d5-a1c5b400620a None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:30.227370 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dd972-bcaa-4e42-98d5-a1c5b400620a None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:30.305980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d6cd7-b8f5-472c-8b12-39e562ad804c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:30.306710 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d6cd7-b8f5-472c-8b12-39e562ad804c admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:30.307099 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d6cd7-b8f5-472c-8b12-39e562ad804c admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:30.307264 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d6cd7-b8f5-472c-8b12-39e562ad804c admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:30.308008 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d6cd7-b8f5-472c-8b12-39e562ad804c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:30.309975 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d6cd7-b8f5-472c-8b12-39e562ad804c admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:30.334081 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1414/2811] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:25:30 2022] POST /identity/v3/users => generated 296 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:25:30.338091 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef4cb4-fab8-4684-80c8-765a517febab admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:30.350502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef4cb4-fab8-4684-80c8-765a517febab admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:30.355426 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ca6ef-8b63-4143-90fe-d45e93fbbd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:30.356243 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ca6ef-8b63-4143-90fe-d45e93fbbd4d admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:30.356635 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ca6ef-8b63-4143-90fe-d45e93fbbd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:30.357150 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ca6ef-8b63-4143-90fe-d45e93fbbd4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:30.358150 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ca6ef-8b63-4143-90fe-d45e93fbbd4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:30.359850 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ca6ef-8b63-4143-90fe-d45e93fbbd4d admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:30.375551 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1398/2812] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:25:30.377325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d6cd7-b8f5-472c-8b12-39e562ad804c admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:30.388795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d6cd7-b8f5-472c-8b12-39e562ad804c admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:30.393928 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16311a2-506c-46db-a55b-feadb32fbc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:30.394873 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16311a2-506c-46db-a55b-feadb32fbc2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:30.395171 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16311a2-506c-46db-a55b-feadb32fbc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:30.395452 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16311a2-506c-46db-a55b-feadb32fbc2a admin admin] PATH_INFO: `/v3/projects/df72c77a2ee14ebab3c78ab6279982cb/users/c0a3da8dc58e4a8895adc1c6f89304d4/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:30.415755 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16311a2-506c-46db-a55b-feadb32fbc2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=df72c77a2ee14ebab3c78ab6279982cb, user_id=c0a3da8dc58e4a8895adc1c6f89304d4, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:30.418685 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16311a2-506c-46db-a55b-feadb32fbc2a admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:30.435342 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1415/2813] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:25:30 2022] PUT /identity/v3/projects/df72c77a2ee14ebab3c78ab6279982cb/users/c0a3da8dc58e4a8895adc1c6f89304d4/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:30.439418 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ca6ef-8b63-4143-90fe-d45e93fbbd4d admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:30.450237 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ca6ef-8b63-4143-90fe-d45e93fbbd4d admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:30.464188 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:30.555771 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09414c-bee6-4cbd-913f-c99f0ad47ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:30.556556 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09414c-bee6-4cbd-913f-c99f0ad47ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:30.557039 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09414c-bee6-4cbd-913f-c99f0ad47ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:30.557323 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09414c-bee6-4cbd-913f-c99f0ad47ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:30.558066 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09414c-bee6-4cbd-913f-c99f0ad47ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:30.559744 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09414c-bee6-4cbd-913f-c99f0ad47ff0 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:30.574859 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1399/2814] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:25:30.575796 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16311a2-506c-46db-a55b-feadb32fbc2a admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:30.587658 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16311a2-506c-46db-a55b-feadb32fbc2a admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:30.592641 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18d5e9-6bcf-4f7a-90ac-8b5c9609a626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:30.593704 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18d5e9-6bcf-4f7a-90ac-8b5c9609a626 admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:30.594051 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18d5e9-6bcf-4f7a-90ac-8b5c9609a626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:30.594435 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18d5e9-6bcf-4f7a-90ac-8b5c9609a626 admin admin] PATH_INFO: `/v3/projects/df72c77a2ee14ebab3c78ab6279982cb/users/c0a3da8dc58e4a8895adc1c6f89304d4/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:30.596452 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18d5e9-6bcf-4f7a-90ac-8b5c9609a626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df72c77a2ee14ebab3c78ab6279982cb, user_id=c0a3da8dc58e4a8895adc1c6f89304d4, role_id=4a380ca745bc4fa49dcb1a8bbd5b96d0)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:30.599666 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18d5e9-6bcf-4f7a-90ac-8b5c9609a626 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:30.612584 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1416/2815] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:25:30 2022] PUT /identity/v3/projects/df72c77a2ee14ebab3c78ab6279982cb/users/c0a3da8dc58e4a8895adc1c6f89304d4/roles/4a380ca745bc4fa49dcb1a8bbd5b96d0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:30.623083 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434e9c9-eccd-4903-b64a-9fefde6b31b9 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:30.623379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434e9c9-eccd-4903-b64a-9fefde6b31b9 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:30.623662 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434e9c9-eccd-4903-b64a-9fefde6b31b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:30.654435 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-b434e9c9-eccd-4903-b64a-9fefde6b31b9 None None] MFA Rules not processed for user `c0a3da8dc58e4a8895adc1c6f89304d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:30.655676 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-b434e9c9-eccd-4903-b64a-9fefde6b31b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:30.743773 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1400/2816] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:30.751281 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18d5e9-6bcf-4f7a-90ac-8b5c9609a626 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:30.753292 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-3b18d5e9-6bcf-4f7a-90ac-8b5c9609a626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:30.813878 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18d5e9-6bcf-4f7a-90ac-8b5c9609a626 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:30.817723 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777ca9d-1af5-44bb-8fc6-17876662dbea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:30.818407 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777ca9d-1af5-44bb-8fc6-17876662dbea service cinder] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:30.818699 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777ca9d-1af5-44bb-8fc6-17876662dbea service cinder] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:30.818981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777ca9d-1af5-44bb-8fc6-17876662dbea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:30.826335 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:30.829399 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777ca9d-1af5-44bb-8fc6-17876662dbea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:30.831377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777ca9d-1af5-44bb-8fc6-17876662dbea service cinder] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:30.843073 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1417/2817] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:25:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:25:30.889060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434e9c9-eccd-4903-b64a-9fefde6b31b9 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:30.890492 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-b434e9c9-eccd-4903-b64a-9fefde6b31b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:30.903287 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434e9c9-eccd-4903-b64a-9fefde6b31b9 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:30.907162 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d853c1-b09d-4d69-bbb0-667c99230677 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:30.907853 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d853c1-b09d-4d69-bbb0-667c99230677 service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:30.908272 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d853c1-b09d-4d69-bbb0-667c99230677 service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:30.908556 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d853c1-b09d-4d69-bbb0-667c99230677 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:30.969579 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d853c1-b09d-4d69-bbb0-667c99230677 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:30.971064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d853c1-b09d-4d69-bbb0-667c99230677 service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:30.980803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1401/2818] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:25:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:25:33.919306 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777ca9d-1af5-44bb-8fc6-17876662dbea service cinder] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:33.983837 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777ca9d-1af5-44bb-8fc6-17876662dbea service cinder] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:33.988959 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bbe03-5c71-46cd-89c0-19fb5cf111dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:33.989839 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bbe03-5c71-46cd-89c0-19fb5cf111dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:33.990147 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bbe03-5c71-46cd-89c0-19fb5cf111dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:33.990431 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bbe03-5c71-46cd-89c0-19fb5cf111dc admin admin] PATH_INFO: `/v3/users/10b77af011664d23af6d812ccdd6d233` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:33.991740 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bbe03-5c71-46cd-89c0-19fb5cf111dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b77af011664d23af6d812ccdd6d233)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:33.993687 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bbe03-5c71-46cd-89c0-19fb5cf111dc admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:34.041165 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-014bbe03-5c71-46cd-89c0-19fb5cf111dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b77af011664d23af6d812ccdd6d233'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:34.049900 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-014bbe03-5c71-46cd-89c0-19fb5cf111dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b77af011664d23af6d812ccdd6d233'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:34.058315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-014bbe03-5c71-46cd-89c0-19fb5cf111dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b77af011664d23af6d812ccdd6d233'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:34.059040 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-014bbe03-5c71-46cd-89c0-19fb5cf111dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b77af011664d23af6d812ccdd6d233'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:34.072177 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-014bbe03-5c71-46cd-89c0-19fb5cf111dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b77af011664d23af6d812ccdd6d233'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:34.079659 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1418/2819] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:25:33 2022] DELETE /identity/v3/users/10b77af011664d23af6d812ccdd6d233 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:34.084248 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d7c14-ffd5-416f-860c-4b522e17402f None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:34.084773 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d7c14-ffd5-416f-860c-4b522e17402f None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:34.084884 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d7c14-ffd5-416f-860c-4b522e17402f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:34.102747 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-2d2d7c14-ffd5-416f-860c-4b522e17402f None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:34.103971 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-2d2d7c14-ffd5-416f-860c-4b522e17402f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:34.138249 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=100 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:34.166964 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1402/2820] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:34.177612 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bbe03-5c71-46cd-89c0-19fb5cf111dc admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:34.179840 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-014bbe03-5c71-46cd-89c0-19fb5cf111dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:34.262442 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bbe03-5c71-46cd-89c0-19fb5cf111dc admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:34.266152 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edd04d-06f9-4a7d-b7be-d469b1e0c047 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:34.266806 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edd04d-06f9-4a7d-b7be-d469b1e0c047 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:34.267092 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edd04d-06f9-4a7d-b7be-d469b1e0c047 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:34.267370 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edd04d-06f9-4a7d-b7be-d469b1e0c047 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:34.276617 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edd04d-06f9-4a7d-b7be-d469b1e0c047 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:34.278043 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edd04d-06f9-4a7d-b7be-d469b1e0c047 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:34.281908 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:34.291892 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1419/2821] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:25:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:25:34.597996 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d7c14-ffd5-416f-860c-4b522e17402f None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:34.605336 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-2d2d7c14-ffd5-416f-860c-4b522e17402f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:34.625703 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d7c14-ffd5-416f-860c-4b522e17402f None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:34.632379 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16df35-1032-4917-a771-d4fdf61a5e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:34.633312 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16df35-1032-4917-a771-d4fdf61a5e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:34.633762 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16df35-1032-4917-a771-d4fdf61a5e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:34.634288 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16df35-1032-4917-a771-d4fdf61a5e22 admin admin] PATH_INFO: `/v3/projects/f2e2b833589d457b8008f1c39a3add1a` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:34.635735 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16df35-1032-4917-a771-d4fdf61a5e22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2e2b833589d457b8008f1c39a3add1a)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:34.637678 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16df35-1032-4917-a771-d4fdf61a5e22 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:34.713870 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-5f16df35-1032-4917-a771-d4fdf61a5e22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2e2b833589d457b8008f1c39a3add1a', 'request_id': 'req-5f16df35-1032-4917-a771-d4fdf61a5e22'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:34.721720 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-5f16df35-1032-4917-a771-d4fdf61a5e22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2e2b833589d457b8008f1c39a3add1a', 'request_id': 'req-5f16df35-1032-4917-a771-d4fdf61a5e22'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:34.733684 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-5f16df35-1032-4917-a771-d4fdf61a5e22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2e2b833589d457b8008f1c39a3add1a', 'request_id': 'req-5f16df35-1032-4917-a771-d4fdf61a5e22'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:34.744737 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-5f16df35-1032-4917-a771-d4fdf61a5e22 admin admin] The token cache is being invalidate because project f2e2b833589d457b8008f1c39a3add1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:25:34.745052 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-5f16df35-1032-4917-a771-d4fdf61a5e22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:34.745727 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-5f16df35-1032-4917-a771-d4fdf61a5e22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:34.747333 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1403/2822] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:25:34 2022] DELETE /identity/v3/projects/f2e2b833589d457b8008f1c39a3add1a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:34.751421 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edd04d-06f9-4a7d-b7be-d469b1e0c047 service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:34.761799 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edd04d-06f9-4a7d-b7be-d469b1e0c047 service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:34.830918 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fac34-bb66-4043-bb87-48d529433817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:34.832376 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fac34-bb66-4043-bb87-48d529433817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:34.832843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fac34-bb66-4043-bb87-48d529433817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:34.833224 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fac34-bb66-4043-bb87-48d529433817 admin admin] PATH_INFO: `/v3/users/41ea4811501e484d98c7910b98825376` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:34.834872 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fac34-bb66-4043-bb87-48d529433817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41ea4811501e484d98c7910b98825376)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:34.837235 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fac34-bb66-4043-bb87-48d529433817 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:34.897576 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-981fac34-bb66-4043-bb87-48d529433817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41ea4811501e484d98c7910b98825376'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:34.919447 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-981fac34-bb66-4043-bb87-48d529433817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41ea4811501e484d98c7910b98825376'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:34.930307 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-981fac34-bb66-4043-bb87-48d529433817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41ea4811501e484d98c7910b98825376'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:34.931100 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-981fac34-bb66-4043-bb87-48d529433817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41ea4811501e484d98c7910b98825376'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:34.944030 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-981fac34-bb66-4043-bb87-48d529433817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41ea4811501e484d98c7910b98825376'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:34.951136 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1420/2823] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:25:34 2022] DELETE /identity/v3/users/41ea4811501e484d98c7910b98825376 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:35.242902 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16df35-1032-4917-a771-d4fdf61a5e22 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:35.244370 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-5f16df35-1032-4917-a771-d4fdf61a5e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:35.258910 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16df35-1032-4917-a771-d4fdf61a5e22 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:35.326476 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47439fec-00ca-4594-a3d2-c3713ac8e2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:35.327354 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47439fec-00ca-4594-a3d2-c3713ac8e2af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:35.327638 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47439fec-00ca-4594-a3d2-c3713ac8e2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:35.327941 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47439fec-00ca-4594-a3d2-c3713ac8e2af admin admin] PATH_INFO: `/v3/projects/d401dc75f76846a89f1a459245d637eb` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:35.329199 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47439fec-00ca-4594-a3d2-c3713ac8e2af admin admin] RBAC: Authorizing `identity:delete_project(project_id=d401dc75f76846a89f1a459245d637eb)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:35.331180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47439fec-00ca-4594-a3d2-c3713ac8e2af admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:35.379733 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-47439fec-00ca-4594-a3d2-c3713ac8e2af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd401dc75f76846a89f1a459245d637eb', 'request_id': 'req-47439fec-00ca-4594-a3d2-c3713ac8e2af'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:35.387278 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-47439fec-00ca-4594-a3d2-c3713ac8e2af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd401dc75f76846a89f1a459245d637eb', 'request_id': 'req-47439fec-00ca-4594-a3d2-c3713ac8e2af'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:35.395988 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-47439fec-00ca-4594-a3d2-c3713ac8e2af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd401dc75f76846a89f1a459245d637eb', 'request_id': 'req-47439fec-00ca-4594-a3d2-c3713ac8e2af'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:35.397353 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:35.411658 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-47439fec-00ca-4594-a3d2-c3713ac8e2af admin admin] The token cache is being invalidate because project d401dc75f76846a89f1a459245d637eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:25:35.411949 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-47439fec-00ca-4594-a3d2-c3713ac8e2af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:35.412600 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-47439fec-00ca-4594-a3d2-c3713ac8e2af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:35.414161 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1404/2824] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:25:35 2022] DELETE /identity/v3/projects/d401dc75f76846a89f1a459245d637eb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:35.418143 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fac34-bb66-4043-bb87-48d529433817 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:35.419559 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-981fac34-bb66-4043-bb87-48d529433817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:35.432609 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fac34-bb66-4043-bb87-48d529433817 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:35.490751 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fa803-73d6-40a3-85d5-e065a732c410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:35.491644 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fa803-73d6-40a3-85d5-e065a732c410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:35.491934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fa803-73d6-40a3-85d5-e065a732c410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:35.492210 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fa803-73d6-40a3-85d5-e065a732c410 admin admin] PATH_INFO: `/v3/users/c0a3da8dc58e4a8895adc1c6f89304d4` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:35.493410 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fa803-73d6-40a3-85d5-e065a732c410 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0a3da8dc58e4a8895adc1c6f89304d4)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:35.495407 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fa803-73d6-40a3-85d5-e065a732c410 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:35.520660 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:35.552570 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f81fa803-73d6-40a3-85d5-e065a732c410 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0a3da8dc58e4a8895adc1c6f89304d4'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:35.560733 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f81fa803-73d6-40a3-85d5-e065a732c410 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0a3da8dc58e4a8895adc1c6f89304d4'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:35.571061 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f81fa803-73d6-40a3-85d5-e065a732c410 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0a3da8dc58e4a8895adc1c6f89304d4'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:35.571268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f81fa803-73d6-40a3-85d5-e065a732c410 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0a3da8dc58e4a8895adc1c6f89304d4'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:35.585786 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-f81fa803-73d6-40a3-85d5-e065a732c410 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0a3da8dc58e4a8895adc1c6f89304d4'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:35.591855 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1421/2825] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:25:35 2022] DELETE /identity/v3/users/c0a3da8dc58e4a8895adc1c6f89304d4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:35.877718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47439fec-00ca-4594-a3d2-c3713ac8e2af admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:35.879419 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-47439fec-00ca-4594-a3d2-c3713ac8e2af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:35.893714 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47439fec-00ca-4594-a3d2-c3713ac8e2af admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:35.954294 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15d91b-06db-40ef-a866-dd6003f58b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:35.955170 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15d91b-06db-40ef-a866-dd6003f58b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:35.955452 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15d91b-06db-40ef-a866-dd6003f58b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:35.955728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15d91b-06db-40ef-a866-dd6003f58b97 admin admin] PATH_INFO: `/v3/projects/df72c77a2ee14ebab3c78ab6279982cb` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:35.957182 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15d91b-06db-40ef-a866-dd6003f58b97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df72c77a2ee14ebab3c78ab6279982cb)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:35.959187 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15d91b-06db-40ef-a866-dd6003f58b97 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:36.026520 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-8b15d91b-06db-40ef-a866-dd6003f58b97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df72c77a2ee14ebab3c78ab6279982cb', 'request_id': 'req-8b15d91b-06db-40ef-a866-dd6003f58b97'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:36.035769 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-8b15d91b-06db-40ef-a866-dd6003f58b97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df72c77a2ee14ebab3c78ab6279982cb', 'request_id': 'req-8b15d91b-06db-40ef-a866-dd6003f58b97'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:36.045715 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-8b15d91b-06db-40ef-a866-dd6003f58b97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df72c77a2ee14ebab3c78ab6279982cb', 'request_id': 'req-8b15d91b-06db-40ef-a866-dd6003f58b97'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:36.058879 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-8b15d91b-06db-40ef-a866-dd6003f58b97 admin admin] The token cache is being invalidate because project df72c77a2ee14ebab3c78ab6279982cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:25:36.059159 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-8b15d91b-06db-40ef-a866-dd6003f58b97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:36.059818 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-8b15d91b-06db-40ef-a866-dd6003f58b97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:36.061368 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1405/2826] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:25:35 2022] DELETE /identity/v3/projects/df72c77a2ee14ebab3c78ab6279982cb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:36.067598 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f470325-820a-426a-a71b-321cc11c8543 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:36.068096 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f470325-820a-426a-a71b-321cc11c8543 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:36.068221 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f470325-820a-426a-a71b-321cc11c8543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:36.086501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-1f470325-820a-426a-a71b-321cc11c8543 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:36.087729 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-1f470325-820a-426a-a71b-321cc11c8543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:36.152704 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1422/2827] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:36.161690 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd14fec-5b55-4e22-a04b-a959e904307f None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:36.161983 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd14fec-5b55-4e22-a04b-a959e904307f None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:36.162297 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd14fec-5b55-4e22-a04b-a959e904307f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:36.181811 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-ffd14fec-5b55-4e22-a04b-a959e904307f None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:36.183105 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-ffd14fec-5b55-4e22-a04b-a959e904307f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:36.191586 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1406/2828] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:36.198142 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f470325-820a-426a-a71b-321cc11c8543 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:36.208722 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f470325-820a-426a-a71b-321cc11c8543 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:36.213315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e1870-1c8e-4219-ab52-ed829bf63655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:36.214001 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e1870-1c8e-4219-ab52-ed829bf63655 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:36.214325 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e1870-1c8e-4219-ab52-ed829bf63655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:36.214608 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e1870-1c8e-4219-ab52-ed829bf63655 admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:36.215349 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e1870-1c8e-4219-ab52-ed829bf63655 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:25:36.215663 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e1870-1c8e-4219-ab52-ed829bf63655 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:36.217277 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e1870-1c8e-4219-ab52-ed829bf63655 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:36.230271 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1423/2829] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:25:36.234725 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd14fec-5b55-4e22-a04b-a959e904307f None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:36.245231 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd14fec-5b55-4e22-a04b-a959e904307f None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:36.251491 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d32e9d-cd00-4d48-88ef-3250ecb98bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:36.252338 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d32e9d-cd00-4d48-88ef-3250ecb98bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:36.252657 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d32e9d-cd00-4d48-88ef-3250ecb98bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:36.252938 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d32e9d-cd00-4d48-88ef-3250ecb98bd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:36.253828 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d32e9d-cd00-4d48-88ef-3250ecb98bd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:36.256185 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d32e9d-cd00-4d48-88ef-3250ecb98bd5 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:36.288507 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1407/2830] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:25:36 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:25:36.289486 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e1870-1c8e-4219-ab52-ed829bf63655 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:36.299560 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e1870-1c8e-4219-ab52-ed829bf63655 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:36.358092 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b29c54-5b72-4762-bb19-ea38ae6048dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:36.358803 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b29c54-5b72-4762-bb19-ea38ae6048dd admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:36.359090 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b29c54-5b72-4762-bb19-ea38ae6048dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:36.359368 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b29c54-5b72-4762-bb19-ea38ae6048dd admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:36.360070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b29c54-5b72-4762-bb19-ea38ae6048dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:36.361996 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b29c54-5b72-4762-bb19-ea38ae6048dd admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:36.383222 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1424/2831] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:25:36 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:25:36.387453 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d32e9d-cd00-4d48-88ef-3250ecb98bd5 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:36.401906 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d32e9d-cd00-4d48-88ef-3250ecb98bd5 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:36.407654 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e8a9b-60ed-4ae4-8dca-514e1ddf7b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:36.408387 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e8a9b-60ed-4ae4-8dca-514e1ddf7b31 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:36.408875 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e8a9b-60ed-4ae4-8dca-514e1ddf7b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:36.410019 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e8a9b-60ed-4ae4-8dca-514e1ddf7b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:36.411084 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e8a9b-60ed-4ae4-8dca-514e1ddf7b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:36.413028 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e8a9b-60ed-4ae4-8dca-514e1ddf7b31 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:36.426885 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1408/2832] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:25:36.430877 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b29c54-5b72-4762-bb19-ea38ae6048dd admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:36.441631 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b29c54-5b72-4762-bb19-ea38ae6048dd admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:36.446747 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2c399-fe39-4cdc-ba48-100587ec9f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:36.447492 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2c399-fe39-4cdc-ba48-100587ec9f42 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:36.447843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2c399-fe39-4cdc-ba48-100587ec9f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:36.448187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2c399-fe39-4cdc-ba48-100587ec9f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:36.448981 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2c399-fe39-4cdc-ba48-100587ec9f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:36.450680 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2c399-fe39-4cdc-ba48-100587ec9f42 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:36.461523 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e8a9b-60ed-4ae4-8dca-514e1ddf7b31 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:36.462695 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1425/2833] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:25:36.463731 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-2c1e8a9b-60ed-4ae4-8dca-514e1ddf7b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:36.467031 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2c399-fe39-4cdc-ba48-100587ec9f42 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:36.472655 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:36.479741 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2c399-fe39-4cdc-ba48-100587ec9f42 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:36.487473 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e339c-f056-4e6a-950b-57e0716db84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:36.488637 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e339c-f056-4e6a-950b-57e0716db84e admin admin] REQUEST_METHOD: `PUT` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:36.489427 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e339c-f056-4e6a-950b-57e0716db84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:36.489713 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e339c-f056-4e6a-950b-57e0716db84e admin admin] PATH_INFO: `/v3/projects/d0a8b3acbf3a411188de853993d31c5f/users/6c75a130152a4ca6a790b4bc5a1342b8/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:36.507193 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e339c-f056-4e6a-950b-57e0716db84e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a8b3acbf3a411188de853993d31c5f, user_id=6c75a130152a4ca6a790b4bc5a1342b8, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:36.509855 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e339c-f056-4e6a-950b-57e0716db84e admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:36.515009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:36.527315 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1426/2834] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:25:36 2022] PUT /identity/v3/projects/d0a8b3acbf3a411188de853993d31c5f/users/6c75a130152a4ca6a790b4bc5a1342b8/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:25:36.536347 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e8a9b-60ed-4ae4-8dca-514e1ddf7b31 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:36.540334 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76780a22-caee-4220-8e91-52d138ef2e1d None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:36.540682 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76780a22-caee-4220-8e91-52d138ef2e1d None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:36.540964 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76780a22-caee-4220-8e91-52d138ef2e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:36.571336 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-76780a22-caee-4220-8e91-52d138ef2e1d None None] MFA Rules not processed for user `6c75a130152a4ca6a790b4bc5a1342b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:36.572726 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-76780a22-caee-4220-8e91-52d138ef2e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:36.589242 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ccc41-d0da-4399-8070-2b7b3865e341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:36.589903 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ccc41-d0da-4399-8070-2b7b3865e341 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:36.590362 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ccc41-d0da-4399-8070-2b7b3865e341 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:36.590646 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ccc41-d0da-4399-8070-2b7b3865e341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:36.592545 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-c96ccc41-d0da-4399-8070-2b7b3865e341 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:36.640913 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1427/2835] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:25:36.652951 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76780a22-caee-4220-8e91-52d138ef2e1d None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:36.654394 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-76780a22-caee-4220-8e91-52d138ef2e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:36.675780 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ccc41-d0da-4399-8070-2b7b3865e341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:36.678372 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ccc41-d0da-4399-8070-2b7b3865e341 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:36.692976 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1409/2836] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:25:36 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:25:36.732467 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76780a22-caee-4220-8e91-52d138ef2e1d None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:36.737041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3d804-4139-4c5b-bb37-6414e4b13c38 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7af0259f7f24dfdafbdfc1f613ebb42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:36.737793 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3d804-4139-4c5b-bb37-6414e4b13c38 service glance] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:36.738209 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3d804-4139-4c5b-bb37-6414e4b13c38 service glance] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:36.738570 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3d804-4139-4c5b-bb37-6414e4b13c38 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:36.747934 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3d804-4139-4c5b-bb37-6414e4b13c38 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:36.749521 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3d804-4139-4c5b-bb37-6414e4b13c38 service glance] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:36.759749 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1428/2837] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:25:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:25:38.591222 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ccc41-d0da-4399-8070-2b7b3865e341 service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:38.592722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-c96ccc41-d0da-4399-8070-2b7b3865e341 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:38.727616 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ccc41-d0da-4399-8070-2b7b3865e341 service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:38.733569 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97d3e3-b263-4307-80fe-6ca492a4c1c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:38.734350 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97d3e3-b263-4307-80fe-6ca492a4c1c5 service nova] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:38.734709 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97d3e3-b263-4307-80fe-6ca492a4c1c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:38.735060 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97d3e3-b263-4307-80fe-6ca492a4c1c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:38.737049 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-4e97d3e3-b263-4307-80fe-6ca492a4c1c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:38.751063 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e97d3e3-b263-4307-80fe-6ca492a4c1c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:38.752677 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e97d3e3-b263-4307-80fe-6ca492a4c1c5 service nova] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:38.766542 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1410/2838] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:25:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:25:46.755189 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=67,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:48.760050 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=98 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:51.209009 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3d804-4139-4c5b-bb37-6414e4b13c38 service glance] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:51.271127 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3d804-4139-4c5b-bb37-6414e4b13c38 service glance] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:51.275624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1b4b1-348a-4309-8ef1-cd3592229621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:51.276507 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1b4b1-348a-4309-8ef1-cd3592229621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:51.276791 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1b4b1-348a-4309-8ef1-cd3592229621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:51.277069 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1b4b1-348a-4309-8ef1-cd3592229621 admin admin] PATH_INFO: `/v3/users/6c75a130152a4ca6a790b4bc5a1342b8` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:51.278294 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1b4b1-348a-4309-8ef1-cd3592229621 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c75a130152a4ca6a790b4bc5a1342b8)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:51.280229 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1b4b1-348a-4309-8ef1-cd3592229621 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:51.324818 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b3c1b4b1-348a-4309-8ef1-cd3592229621 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c75a130152a4ca6a790b4bc5a1342b8'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:51.332664 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b3c1b4b1-348a-4309-8ef1-cd3592229621 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c75a130152a4ca6a790b4bc5a1342b8'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:51.339899 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b3c1b4b1-348a-4309-8ef1-cd3592229621 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c75a130152a4ca6a790b4bc5a1342b8'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:51.340581 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b3c1b4b1-348a-4309-8ef1-cd3592229621 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c75a130152a4ca6a790b4bc5a1342b8'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:51.353313 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-b3c1b4b1-348a-4309-8ef1-cd3592229621 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c75a130152a4ca6a790b4bc5a1342b8'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:51.359190 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1429/2839] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:25:51 2022] DELETE /identity/v3/users/6c75a130152a4ca6a790b4bc5a1342b8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:51.364394 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dd7e6-3a4a-4682-935a-4ba2e7d759a0 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:51.364912 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dd7e6-3a4a-4682-935a-4ba2e7d759a0 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:51.365011 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dd7e6-3a4a-4682-935a-4ba2e7d759a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:51.382879 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-f93dd7e6-3a4a-4682-935a-4ba2e7d759a0 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:51.384083 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-f93dd7e6-3a4a-4682-935a-4ba2e7d759a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:51.443009 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1411/2840] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:51.453422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1b4b1-348a-4309-8ef1-cd3592229621 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:51.454873 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-b3c1b4b1-348a-4309-8ef1-cd3592229621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:51.516642 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1b4b1-348a-4309-8ef1-cd3592229621 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:51.520265 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19fadd-93d2-41de-8f92-21f62a696de6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:51.520912 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19fadd-93d2-41de-8f92-21f62a696de6 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:51.521196 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19fadd-93d2-41de-8f92-21f62a696de6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:51.521471 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19fadd-93d2-41de-8f92-21f62a696de6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:51.530683 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19fadd-93d2-41de-8f92-21f62a696de6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:51.532110 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19fadd-93d2-41de-8f92-21f62a696de6 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:51.542102 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1430/2841] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:25:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:25:51.805927 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93dd7e6-3a4a-4682-935a-4ba2e7d759a0 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:51.807855 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-f93dd7e6-3a4a-4682-935a-4ba2e7d759a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:51.822440 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93dd7e6-3a4a-4682-935a-4ba2e7d759a0 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:51.828344 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d164df-855c-4297-aa0c-0660b8f01fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:51.829241 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d164df-855c-4297-aa0c-0660b8f01fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:51.829508 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d164df-855c-4297-aa0c-0660b8f01fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:51.829759 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d164df-855c-4297-aa0c-0660b8f01fdd admin admin] PATH_INFO: `/v3/projects/d0a8b3acbf3a411188de853993d31c5f` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:51.831114 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d164df-855c-4297-aa0c-0660b8f01fdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0a8b3acbf3a411188de853993d31c5f)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:51.833014 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d164df-855c-4297-aa0c-0660b8f01fdd admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:51.881257 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d6d164df-855c-4297-aa0c-0660b8f01fdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0a8b3acbf3a411188de853993d31c5f', 'request_id': 'req-d6d164df-855c-4297-aa0c-0660b8f01fdd'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:51.889618 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d6d164df-855c-4297-aa0c-0660b8f01fdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0a8b3acbf3a411188de853993d31c5f', 'request_id': 'req-d6d164df-855c-4297-aa0c-0660b8f01fdd'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:51.897459 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d6d164df-855c-4297-aa0c-0660b8f01fdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0a8b3acbf3a411188de853993d31c5f', 'request_id': 'req-d6d164df-855c-4297-aa0c-0660b8f01fdd'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:51.907821 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d6d164df-855c-4297-aa0c-0660b8f01fdd admin admin] The token cache is being invalidate because project d0a8b3acbf3a411188de853993d31c5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:25:51.908116 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d6d164df-855c-4297-aa0c-0660b8f01fdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:51.909241 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-d6d164df-855c-4297-aa0c-0660b8f01fdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:51.910815 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1412/2842] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:25:51 2022] DELETE /identity/v3/projects/d0a8b3acbf3a411188de853993d31c5f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:51.916054 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9004c-191f-4024-8e26-c2db145c076b None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:51.916349 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9004c-191f-4024-8e26-c2db145c076b None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:51.916630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9004c-191f-4024-8e26-c2db145c076b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:51.934989 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-97d9004c-191f-4024-8e26-c2db145c076b None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:51.936204 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-97d9004c-191f-4024-8e26-c2db145c076b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:51.959196 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:52.008508 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1431/2843] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:52.016661 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674fd3e-7ef7-4005-8bf5-171a4c60ac02 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:52.017203 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674fd3e-7ef7-4005-8bf5-171a4c60ac02 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:52.017701 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674fd3e-7ef7-4005-8bf5-171a4c60ac02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:52.039156 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-f674fd3e-7ef7-4005-8bf5-171a4c60ac02 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:52.040705 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-f674fd3e-7ef7-4005-8bf5-171a4c60ac02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:52.049412 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1413/2844] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:25:52.053935 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9004c-191f-4024-8e26-c2db145c076b None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:52.064762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9004c-191f-4024-8e26-c2db145c076b None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:52.069946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8b54f-27d8-4490-add0-3e0783d5d034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:52.070750 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8b54f-27d8-4490-add0-3e0783d5d034 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:52.071040 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8b54f-27d8-4490-add0-3e0783d5d034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:52.071323 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8b54f-27d8-4490-add0-3e0783d5d034 admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:52.072059 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8b54f-27d8-4490-add0-3e0783d5d034 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:25:52.072377 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8b54f-27d8-4490-add0-3e0783d5d034 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:52.074005 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8b54f-27d8-4490-add0-3e0783d5d034 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:52.090198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1432/2845] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:25:52.092400 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674fd3e-7ef7-4005-8bf5-171a4c60ac02 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:52.102786 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674fd3e-7ef7-4005-8bf5-171a4c60ac02 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:52.107643 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf5298-642c-42ef-bde8-b06e25f31845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:52.108315 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf5298-642c-42ef-bde8-b06e25f31845 admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:52.108603 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf5298-642c-42ef-bde8-b06e25f31845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:52.108884 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf5298-642c-42ef-bde8-b06e25f31845 admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:52.109591 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf5298-642c-42ef-bde8-b06e25f31845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:52.111547 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf5298-642c-42ef-bde8-b06e25f31845 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:52.140343 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1414/2846] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:25:52 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:25:52.145363 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8b54f-27d8-4490-add0-3e0783d5d034 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:52.156332 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8b54f-27d8-4490-add0-3e0783d5d034 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:52.217749 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e5beb-b0fb-4e7b-ad63-8667e6dfe1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:52.218443 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e5beb-b0fb-4e7b-ad63-8667e6dfe1b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:52.218729 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e5beb-b0fb-4e7b-ad63-8667e6dfe1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:52.219036 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e5beb-b0fb-4e7b-ad63-8667e6dfe1b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:52.219727 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e5beb-b0fb-4e7b-ad63-8667e6dfe1b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:52.222406 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e5beb-b0fb-4e7b-ad63-8667e6dfe1b0 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:52.242021 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1433/2847] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:25:52 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:25:52.246407 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf5298-642c-42ef-bde8-b06e25f31845 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:52.257075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf5298-642c-42ef-bde8-b06e25f31845 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:52.261870 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1077b7-4d68-4b37-ae70-38df0e0db690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:52.262585 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1077b7-4d68-4b37-ae70-38df0e0db690 admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:52.262915 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1077b7-4d68-4b37-ae70-38df0e0db690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:52.263199 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1077b7-4d68-4b37-ae70-38df0e0db690 admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:52.263932 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1077b7-4d68-4b37-ae70-38df0e0db690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:52.265648 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1077b7-4d68-4b37-ae70-38df0e0db690 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:52.277420 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1415/2848] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:25:52.281502 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e5beb-b0fb-4e7b-ad63-8667e6dfe1b0 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:52.292423 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e5beb-b0fb-4e7b-ad63-8667e6dfe1b0 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:52.300758 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576fd02e-e428-4730-a80b-ff55de111bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:52.301453 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fd02e-e428-4730-a80b-ff55de111bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:52.301795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fd02e-e428-4730-a80b-ff55de111bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:52.302082 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fd02e-e428-4730-a80b-ff55de111bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:52.302869 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576fd02e-e428-4730-a80b-ff55de111bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:52.304506 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576fd02e-e428-4730-a80b-ff55de111bc2 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:52.315742 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1434/2849] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:25:52.319886 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1077b7-4d68-4b37-ae70-38df0e0db690 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:52.330227 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1077b7-4d68-4b37-ae70-38df0e0db690 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:52.335758 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8288c-55cf-43da-92dd-545faa86a357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:52.336650 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8288c-55cf-43da-92dd-545faa86a357 admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:52.336930 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8288c-55cf-43da-92dd-545faa86a357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:52.337232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8288c-55cf-43da-92dd-545faa86a357 admin admin] PATH_INFO: `/v3/projects/5c0f4b15973c40c2a077890e42d00eab/users/0164ec1659584e37b6e5690d69f11679/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:52.352109 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8288c-55cf-43da-92dd-545faa86a357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c0f4b15973c40c2a077890e42d00eab, user_id=0164ec1659584e37b6e5690d69f11679, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:52.354863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8288c-55cf-43da-92dd-545faa86a357 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:52.367428 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1416/2850] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:25:52 2022] PUT /identity/v3/projects/5c0f4b15973c40c2a077890e42d00eab/users/0164ec1659584e37b6e5690d69f11679/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:52.379220 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3468a10-b090-4f42-89e4-786afe2405f0 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:52.379509 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3468a10-b090-4f42-89e4-786afe2405f0 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:52.379789 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3468a10-b090-4f42-89e4-786afe2405f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:52.406701 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-a3468a10-b090-4f42-89e4-786afe2405f0 None None] MFA Rules not processed for user `0164ec1659584e37b6e5690d69f11679`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:52.407826 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-a3468a10-b090-4f42-89e4-786afe2405f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:52.470790 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1435/2851] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:52.481440 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8288c-55cf-43da-92dd-545faa86a357 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:52.483245 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-53f8288c-55cf-43da-92dd-545faa86a357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:52.507584 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:52.565524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8288c-55cf-43da-92dd-545faa86a357 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:52.570478 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaeca0-9b21-44a0-a79c-589bbc02d896 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:52.571133 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaeca0-9b21-44a0-a79c-589bbc02d896 service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:52.571419 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaeca0-9b21-44a0-a79c-589bbc02d896 service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:52.571698 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaeca0-9b21-44a0-a79c-589bbc02d896 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:52.580348 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaaeca0-9b21-44a0-a79c-589bbc02d896 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:52.582380 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaaeca0-9b21-44a0-a79c-589bbc02d896 service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:52.591237 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1417/2852] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:25:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:25:57.882795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3468a10-b090-4f42-89e4-786afe2405f0 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:57.904840 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:57.953116 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3468a10-b090-4f42-89e4-786afe2405f0 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:57.957987 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbacec8-ca79-4bba-83f3-83bc22102fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:57.958984 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbacec8-ca79-4bba-83f3-83bc22102fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:57.959271 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbacec8-ca79-4bba-83f3-83bc22102fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:57.959547 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbacec8-ca79-4bba-83f3-83bc22102fb8 admin admin] PATH_INFO: `/v3/users/0164ec1659584e37b6e5690d69f11679` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:57.960813 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbacec8-ca79-4bba-83f3-83bc22102fb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0164ec1659584e37b6e5690d69f11679)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:57.962866 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbacec8-ca79-4bba-83f3-83bc22102fb8 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:58.013903 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-2bbacec8-ca79-4bba-83f3-83bc22102fb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0164ec1659584e37b6e5690d69f11679'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:58.021251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-2bbacec8-ca79-4bba-83f3-83bc22102fb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0164ec1659584e37b6e5690d69f11679'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:58.028998 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-2bbacec8-ca79-4bba-83f3-83bc22102fb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0164ec1659584e37b6e5690d69f11679'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:58.029650 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-2bbacec8-ca79-4bba-83f3-83bc22102fb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0164ec1659584e37b6e5690d69f11679'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:58.042088 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-2bbacec8-ca79-4bba-83f3-83bc22102fb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0164ec1659584e37b6e5690d69f11679'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:58.047982 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1436/2853] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:25:57 2022] DELETE /identity/v3/users/0164ec1659584e37b6e5690d69f11679 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:25:58.053075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7a43c-5d2d-4dc0-9d88-429655aa3b55 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:58.053625 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7a43c-5d2d-4dc0-9d88-429655aa3b55 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:58.053625 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7a43c-5d2d-4dc0-9d88-429655aa3b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:58.072635 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-1ba7a43c-5d2d-4dc0-9d88-429655aa3b55 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:58.073878 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-1ba7a43c-5d2d-4dc0-9d88-429655aa3b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:58.135268 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1418/2854] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:58.144753 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbacec8-ca79-4bba-83f3-83bc22102fb8 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:58.146253 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-2bbacec8-ca79-4bba-83f3-83bc22102fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:58.202995 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbacec8-ca79-4bba-83f3-83bc22102fb8 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:58.206678 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0bc217-3af1-4cec-906a-80cdbbd3a553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:58.207333 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0bc217-3af1-4cec-906a-80cdbbd3a553 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:58.207624 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0bc217-3af1-4cec-906a-80cdbbd3a553 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:58.207906 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0bc217-3af1-4cec-906a-80cdbbd3a553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:58.217108 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0bc217-3af1-4cec-906a-80cdbbd3a553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:58.218596 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0bc217-3af1-4cec-906a-80cdbbd3a553 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:58.228201 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1437/2855] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:25:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:25:58.505065 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7a43c-5d2d-4dc0-9d88-429655aa3b55 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:58.507062 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-1ba7a43c-5d2d-4dc0-9d88-429655aa3b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:58.522161 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7a43c-5d2d-4dc0-9d88-429655aa3b55 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:58.527594 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99a646-7f9f-4c79-b04f-1b181d4d55d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:58.528673 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99a646-7f9f-4c79-b04f-1b181d4d55d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:58.528964 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99a646-7f9f-4c79-b04f-1b181d4d55d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:58.529249 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99a646-7f9f-4c79-b04f-1b181d4d55d5 admin admin] PATH_INFO: `/v3/projects/5c0f4b15973c40c2a077890e42d00eab` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:58.530683 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99a646-7f9f-4c79-b04f-1b181d4d55d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c0f4b15973c40c2a077890e42d00eab)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:58.532601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99a646-7f9f-4c79-b04f-1b181d4d55d5 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:58.583027 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-dc99a646-7f9f-4c79-b04f-1b181d4d55d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c0f4b15973c40c2a077890e42d00eab', 'request_id': 'req-dc99a646-7f9f-4c79-b04f-1b181d4d55d5'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:58.591475 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-dc99a646-7f9f-4c79-b04f-1b181d4d55d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c0f4b15973c40c2a077890e42d00eab', 'request_id': 'req-dc99a646-7f9f-4c79-b04f-1b181d4d55d5'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:58.600907 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-dc99a646-7f9f-4c79-b04f-1b181d4d55d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c0f4b15973c40c2a077890e42d00eab', 'request_id': 'req-dc99a646-7f9f-4c79-b04f-1b181d4d55d5'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:58.612956 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-dc99a646-7f9f-4c79-b04f-1b181d4d55d5 admin admin] The token cache is being invalidate because project 5c0f4b15973c40c2a077890e42d00eab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:25:58.613245 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-dc99a646-7f9f-4c79-b04f-1b181d4d55d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:58.613878 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-dc99a646-7f9f-4c79-b04f-1b181d4d55d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:25:58.615440 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1419/2856] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:25:58 2022] DELETE /identity/v3/projects/5c0f4b15973c40c2a077890e42d00eab => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:58.620329 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6cf4e-f2ea-4429-8ace-3b3af241b6f5 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:58.620630 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6cf4e-f2ea-4429-8ace-3b3af241b6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:58.620917 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6cf4e-f2ea-4429-8ace-3b3af241b6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:58.640347 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-87c6cf4e-f2ea-4429-8ace-3b3af241b6f5 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:58.641573 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-87c6cf4e-f2ea-4429-8ace-3b3af241b6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:58.677884 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:58.705298 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1438/2857] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:58.712990 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e3ccc-d883-49f6-9f85-9769575e1f77 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:58.713283 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e3ccc-d883-49f6-9f85-9769575e1f77 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:58.713569 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e3ccc-d883-49f6-9f85-9769575e1f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:58.731478 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-b64e3ccc-d883-49f6-9f85-9769575e1f77 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:58.732665 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-b64e3ccc-d883-49f6-9f85-9769575e1f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:58.740935 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1420/2858] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:58.745006 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6cf4e-f2ea-4429-8ace-3b3af241b6f5 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:58.755161 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6cf4e-f2ea-4429-8ace-3b3af241b6f5 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:58.760238 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d2871-4fbf-4f75-92bc-7efe0f586d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:58.760901 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d2871-4fbf-4f75-92bc-7efe0f586d69 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:58.761185 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d2871-4fbf-4f75-92bc-7efe0f586d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:58.761491 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d2871-4fbf-4f75-92bc-7efe0f586d69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:58.762253 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d2871-4fbf-4f75-92bc-7efe0f586d69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:25:58.762564 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d2871-4fbf-4f75-92bc-7efe0f586d69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:58.764189 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d2871-4fbf-4f75-92bc-7efe0f586d69 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:58.775744 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1439/2859] 10.222.0.17 () {58 vars in 1152 bytes} [Tue Jul 12 13:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:25:58.779845 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e3ccc-d883-49f6-9f85-9769575e1f77 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:58.789127 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e3ccc-d883-49f6-9f85-9769575e1f77 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:58.793828 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904f5ae-5299-432a-83ed-66b05a20f0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:58.794513 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904f5ae-5299-432a-83ed-66b05a20f0fa admin admin] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:58.794808 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904f5ae-5299-432a-83ed-66b05a20f0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:58.795091 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904f5ae-5299-432a-83ed-66b05a20f0fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:58.795787 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904f5ae-5299-432a-83ed-66b05a20f0fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:58.797685 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904f5ae-5299-432a-83ed-66b05a20f0fa admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:58.817319 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:58.829259 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1421/2860] 10.222.0.17 () {60 vars in 1152 bytes} [Tue Jul 12 13:25:58 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:25:58.830389 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d2871-4fbf-4f75-92bc-7efe0f586d69 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:58.840266 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d2871-4fbf-4f75-92bc-7efe0f586d69 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:58.896362 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f098061-e773-42b2-81c9-d10dd3c6a5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:58.897041 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f098061-e773-42b2-81c9-d10dd3c6a5dc admin admin] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:58.897340 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f098061-e773-42b2-81c9-d10dd3c6a5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:58.897621 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f098061-e773-42b2-81c9-d10dd3c6a5dc admin admin] PATH_INFO: `/v3/users` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:58.898339 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f098061-e773-42b2-81c9-d10dd3c6a5dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:58.900276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f098061-e773-42b2-81c9-d10dd3c6a5dc admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:58.919844 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1440/2861] 10.222.0.17 () {60 vars in 1143 bytes} [Tue Jul 12 13:25:58 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:25:58.924093 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904f5ae-5299-432a-83ed-66b05a20f0fa admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:58.934943 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904f5ae-5299-432a-83ed-66b05a20f0fa admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:58.939965 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0a5f3-3220-4187-8f01-c63815c30f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:58.941152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0a5f3-3220-4187-8f01-c63815c30f3f admin admin] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:58.941448 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0a5f3-3220-4187-8f01-c63815c30f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:58.941741 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0a5f3-3220-4187-8f01-c63815c30f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:58.942472 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0a5f3-3220-4187-8f01-c63815c30f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:58.944080 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0a5f3-3220-4187-8f01-c63815c30f3f admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:58.954909 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1422/2862] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:25:58.958908 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f098061-e773-42b2-81c9-d10dd3c6a5dc admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:58.969025 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f098061-e773-42b2-81c9-d10dd3c6a5dc admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:58.973730 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c01d0b-211d-4fe2-aed9-a65f594b3b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:58.974418 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c01d0b-211d-4fe2-aed9-a65f594b3b07 admin admin] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:58.974711 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c01d0b-211d-4fe2-aed9-a65f594b3b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:58.974995 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c01d0b-211d-4fe2-aed9-a65f594b3b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:58.975730 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c01d0b-211d-4fe2-aed9-a65f594b3b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:58.977335 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c01d0b-211d-4fe2-aed9-a65f594b3b07 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:58.987692 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1441/2863] 10.222.0.17 () {58 vars in 1121 bytes} [Tue Jul 12 13:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:25:58.991502 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0a5f3-3220-4187-8f01-c63815c30f3f admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:59.001240 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0a5f3-3220-4187-8f01-c63815c30f3f admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:59.006612 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3add309-caa0-48cc-b563-1167657c287c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:59.007757 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3add309-caa0-48cc-b563-1167657c287c admin admin] REQUEST_METHOD: `PUT` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:59.008042 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3add309-caa0-48cc-b563-1167657c287c admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:59.008318 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3add309-caa0-48cc-b563-1167657c287c admin admin] PATH_INFO: `/v3/projects/499e94e564e64445a83e8e29e2ca6751/users/035a47f736e84efe99120fb9ca38cacc/roles/1727bdbc17d94ff08782d404dce97d35` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:59.022463 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3add309-caa0-48cc-b563-1167657c287c admin admin] RBAC: Authorizing `identity:create_grant(project_id=499e94e564e64445a83e8e29e2ca6751, user_id=035a47f736e84efe99120fb9ca38cacc, role_id=1727bdbc17d94ff08782d404dce97d35)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:59.025088 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3add309-caa0-48cc-b563-1167657c287c admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:59.037718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1423/2864] 10.222.0.17 () {60 vars in 1482 bytes} [Tue Jul 12 13:25:58 2022] PUT /identity/v3/projects/499e94e564e64445a83e8e29e2ca6751/users/035a47f736e84efe99120fb9ca38cacc/roles/1727bdbc17d94ff08782d404dce97d35 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:25:59.042695 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28e5a2-6ed5-4703-9af9-e0821b9cd488 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:59.042993 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28e5a2-6ed5-4703-9af9-e0821b9cd488 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:59.043278 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28e5a2-6ed5-4703-9af9-e0821b9cd488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:59.061422 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-ae28e5a2-6ed5-4703-9af9-e0821b9cd488 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:25:59.062668 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-ae28e5a2-6ed5-4703-9af9-e0821b9cd488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:59.121797 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1442/2865] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:25:59.131160 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3add309-caa0-48cc-b563-1167657c287c admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:25:59.133222 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-d3add309-caa0-48cc-b563-1167657c287c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:25:59.190758 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3add309-caa0-48cc-b563-1167657c287c admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:25:59.194359 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b258c-5fa8-4306-a1ee-07f726851853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:25:59.194998 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b258c-5fa8-4306-a1ee-07f726851853 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:25:59.195281 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b258c-5fa8-4306-a1ee-07f726851853 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:25:59.195556 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b258c-5fa8-4306-a1ee-07f726851853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:25:59.204441 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b258c-5fa8-4306-a1ee-07f726851853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:25:59.206472 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b258c-5fa8-4306-a1ee-07f726851853 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:25:59.215718 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1424/2866] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:25:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:26:00.060925 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6f8e9-624b-458f-8511-58209c36d404 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:00.061444 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6f8e9-624b-458f-8511-58209c36d404 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:00.061563 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6f8e9-624b-458f-8511-58209c36d404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:00.087245 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-c7d6f8e9-624b-458f-8511-58209c36d404 None None] MFA Rules not processed for user `035a47f736e84efe99120fb9ca38cacc`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:26:00.088493 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-c7d6f8e9-624b-458f-8511-58209c36d404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:26:00.125434 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:00.157762 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1443/2867] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:26:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:26:00.169427 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b258c-5fa8-4306-a1ee-07f726851853 service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:00.170921 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-f68b258c-5fa8-4306-a1ee-07f726851853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:26:00.228722 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b258c-5fa8-4306-a1ee-07f726851853 service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:00.232238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0ccbb-f4e3-4ca4-b3ad-7666280e2274 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:00.232890 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0ccbb-f4e3-4ca4-b3ad-7666280e2274 service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:00.233176 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0ccbb-f4e3-4ca4-b3ad-7666280e2274 service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:00.233453 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0ccbb-f4e3-4ca4-b3ad-7666280e2274 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:00.242012 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0ccbb-f4e3-4ca4-b3ad-7666280e2274 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:00.243481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0ccbb-f4e3-4ca4-b3ad-7666280e2274 service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:00.252401 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1425/2868] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:26:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:26:01.590217 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba90088-d2da-4b35-85e2-b949efda2e01 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:01.590750 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba90088-d2da-4b35-85e2-b949efda2e01 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:01.590750 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba90088-d2da-4b35-85e2-b949efda2e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:01.607900 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-6ba90088-d2da-4b35-85e2-b949efda2e01 None None] MFA Rules not processed for user `035a47f736e84efe99120fb9ca38cacc`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:26:01.609097 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-6ba90088-d2da-4b35-85e2-b949efda2e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:26:01.615972 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1444/2869] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:26:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:26:01.846093 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0ccbb-f4e3-4ca4-b3ad-7666280e2274 service cinder] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:01.847604 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-b7f0ccbb-f4e3-4ca4-b3ad-7666280e2274 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:26:01.860095 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0ccbb-f4e3-4ca4-b3ad-7666280e2274 service cinder] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:01.864531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b6f55-4764-4838-8965-e08a0237cb22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:01.865185 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b6f55-4764-4838-8965-e08a0237cb22 service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:01.865476 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b6f55-4764-4838-8965-e08a0237cb22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:01.865760 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b6f55-4764-4838-8965-e08a0237cb22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:01.867521 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-142b6f55-4764-4838-8965-e08a0237cb22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:26:01.876958 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b6f55-4764-4838-8965-e08a0237cb22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:01.879051 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b6f55-4764-4838-8965-e08a0237cb22 service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:01.887342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1426/2870] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:26:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:26:11.602825 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=14 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:11.883805 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=74,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:26.456655 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cc7ac-277e-4f73-bcdd-e95e04afdb55 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:26.457244 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cc7ac-277e-4f73-bcdd-e95e04afdb55 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:26.457244 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cc7ac-277e-4f73-bcdd-e95e04afdb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:26.476756 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-334cc7ac-277e-4f73-bcdd-e95e04afdb55 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:26:26.477990 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-334cc7ac-277e-4f73-bcdd-e95e04afdb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:26:26.486213 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1445/2871] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Jul 12 13:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:26:26.509856 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b6f55-4764-4838-8965-e08a0237cb22 service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:26.511553 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-142b6f55-4764-4838-8965-e08a0237cb22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:26:26.589421 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b6f55-4764-4838-8965-e08a0237cb22 service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:26.594952 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc34b03-636b-43d4-b15d-54a54c62a2c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:26.595631 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc34b03-636b-43d4-b15d-54a54c62a2c0 service nova] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:26.595917 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc34b03-636b-43d4-b15d-54a54c62a2c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:26.596202 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc34b03-636b-43d4-b15d-54a54c62a2c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:26.607509 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc34b03-636b-43d4-b15d-54a54c62a2c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:26.609115 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc34b03-636b-43d4-b15d-54a54c62a2c0 service nova] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:26.618987 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1427/2872] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:26:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:26:29.536418 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21063c1-eee1-41af-bce7-18782afe8cba None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:29.536995 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21063c1-eee1-41af-bce7-18782afe8cba None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:29.536995 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21063c1-eee1-41af-bce7-18782afe8cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:29.556218 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-c21063c1-eee1-41af-bce7-18782afe8cba None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:26:29.557445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-c21063c1-eee1-41af-bce7-18782afe8cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:26:29.565364 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1446/2873] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Jul 12 13:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:26:29.586290 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc34b03-636b-43d4-b15d-54a54c62a2c0 service nova] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:29.587785 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-8fc34b03-636b-43d4-b15d-54a54c62a2c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:26:29.602644 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc34b03-636b-43d4-b15d-54a54c62a2c0 service nova] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:29.608178 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b4df4-7c28-4bff-887c-7ea1c4a0cfec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:29.608836 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b4df4-7c28-4bff-887c-7ea1c4a0cfec service nova] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:29.609128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b4df4-7c28-4bff-887c-7ea1c4a0cfec service nova] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:29.609412 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b4df4-7c28-4bff-887c-7ea1c4a0cfec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:29.618810 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b4df4-7c28-4bff-887c-7ea1c4a0cfec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:29.620416 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b4df4-7c28-4bff-887c-7ea1c4a0cfec service nova] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:29.630200 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1428/2874] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:26:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:26:32.789187 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40ff57-18e4-40b0-a6c7-f557f27d125d None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:32.789743 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40ff57-18e4-40b0-a6c7-f557f27d125d None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:32.789743 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40ff57-18e4-40b0-a6c7-f557f27d125d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:32.807261 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-1f40ff57-18e4-40b0-a6c7-f557f27d125d None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:26:32.808466 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-1f40ff57-18e4-40b0-a6c7-f557f27d125d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:26:32.816283 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1447/2875] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Jul 12 13:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:26:32.839927 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b4df4-7c28-4bff-887c-7ea1c4a0cfec service nova] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:32.851735 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b4df4-7c28-4bff-887c-7ea1c4a0cfec service nova] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:32.857177 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836fcac-91ed-44e8-8079-fa737ee97844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:32.857825 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836fcac-91ed-44e8-8079-fa737ee97844 service nova] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:32.858135 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836fcac-91ed-44e8-8079-fa737ee97844 service nova] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:32.858418 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836fcac-91ed-44e8-8079-fa737ee97844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:32.866695 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836fcac-91ed-44e8-8079-fa737ee97844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:32.868262 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836fcac-91ed-44e8-8079-fa737ee97844 service nova] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:32.877806 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1429/2876] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:26:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:26:35.877501 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf5c2b-db48-4c65-a965-ce7222ea55dd None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:35.878438 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf5c2b-db48-4c65-a965-ce7222ea55dd None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:35.878731 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf5c2b-db48-4c65-a965-ce7222ea55dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:35.896786 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-61bf5c2b-db48-4c65-a965-ce7222ea55dd None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:26:35.898064 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-61bf5c2b-db48-4c65-a965-ce7222ea55dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:26:35.905985 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1448/2877] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Jul 12 13:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:26:35.927123 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836fcac-91ed-44e8-8079-fa737ee97844 service nova] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:35.939156 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836fcac-91ed-44e8-8079-fa737ee97844 service nova] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:35.944624 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828c07c-9bab-4818-bec3-3216322aec26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:35.945266 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828c07c-9bab-4818-bec3-3216322aec26 service nova] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:35.945552 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828c07c-9bab-4818-bec3-3216322aec26 service nova] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:35.945832 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828c07c-9bab-4818-bec3-3216322aec26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:35.954075 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828c07c-9bab-4818-bec3-3216322aec26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:35.955680 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828c07c-9bab-4818-bec3-3216322aec26 service nova] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:35.965196 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1430/2878] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:26:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:26:39.059956 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196523b-fe1a-4290-a7e0-38b5d7d6ee6d None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:39.060854 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196523b-fe1a-4290-a7e0-38b5d7d6ee6d None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:39.061035 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196523b-fe1a-4290-a7e0-38b5d7d6ee6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:39.080631 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-e196523b-fe1a-4290-a7e0-38b5d7d6ee6d None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:26:39.081926 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-e196523b-fe1a-4290-a7e0-38b5d7d6ee6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:26:39.091139 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1449/2879] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Jul 12 13:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:26:39.115760 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828c07c-9bab-4818-bec3-3216322aec26 service nova] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:39.133097 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828c07c-9bab-4818-bec3-3216322aec26 service nova] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:39.141107 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24327be0-f589-4604-b28c-dcd2a09355f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:39.142272 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24327be0-f589-4604-b28c-dcd2a09355f3 service nova] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:39.142781 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24327be0-f589-4604-b28c-dcd2a09355f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:39.143337 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24327be0-f589-4604-b28c-dcd2a09355f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:39.157150 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24327be0-f589-4604-b28c-dcd2a09355f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:39.158848 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24327be0-f589-4604-b28c-dcd2a09355f3 service nova] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:39.170815 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1431/2880] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:26:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:26:42.219668 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11baa0-c97c-4e2a-b510-f0a3be94998c None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:42.220197 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11baa0-c97c-4e2a-b510-f0a3be94998c None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:42.220299 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11baa0-c97c-4e2a-b510-f0a3be94998c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:42.237950 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-4e11baa0-c97c-4e2a-b510-f0a3be94998c None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:26:42.239196 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-4e11baa0-c97c-4e2a-b510-f0a3be94998c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:26:42.247740 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1450/2881] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Jul 12 13:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:26:42.270134 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24327be0-f589-4604-b28c-dcd2a09355f3 service nova] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:42.282166 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24327be0-f589-4604-b28c-dcd2a09355f3 service nova] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:42.287972 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d3f3f-f3e6-4e94-9749-c26093790efa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:42.288629 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d3f3f-f3e6-4e94-9749-c26093790efa service nova] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:42.288920 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d3f3f-f3e6-4e94-9749-c26093790efa service nova] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:42.289203 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d3f3f-f3e6-4e94-9749-c26093790efa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:42.308234 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d3f3f-f3e6-4e94-9749-c26093790efa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:42.309855 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d3f3f-f3e6-4e94-9749-c26093790efa service nova] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:42.321112 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1432/2882] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:26:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:26:52.232907 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=18 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:52.315854 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=64 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:56.425134 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feccc67-8610-40ad-8817-7c70087714d8 None None] REQUEST_METHOD: `POST` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:56.425769 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feccc67-8610-40ad-8817-7c70087714d8 None None] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:56.425769 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feccc67-8610-40ad-8817-7c70087714d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:56.444526 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.auth.core [None req-4feccc67-8610-40ad-8817-7c70087714d8 None None] MFA Rules not processed for user `035a47f736e84efe99120fb9ca38cacc`. Rule list: `[]` (Enabled: `True`). {{(pid=80628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:26:56.445734 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-4feccc67-8610-40ad-8817-7c70087714d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:26:56.452579 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1451/2883] 10.222.0.17 () {58 vars in 957 bytes} [Tue Jul 12 13:26:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:27:06.439269 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=3 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:10.385830 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea9e3d-9d97-4249-88af-287b62ad9569 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:10.386484 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea9e3d-9d97-4249-88af-287b62ad9569 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:10.386484 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea9e3d-9d97-4249-88af-287b62ad9569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:10.405445 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-24ea9e3d-9d97-4249-88af-287b62ad9569 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:10.406691 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-24ea9e3d-9d97-4249-88af-287b62ad9569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:10.414514 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1433/2884] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Jul 12 13:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:27:10.434469 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feccc67-8610-40ad-8817-7c70087714d8 None None] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:10.447810 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feccc67-8610-40ad-8817-7c70087714d8 None None] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:10.453198 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe654c-628b-4b40-a0a4-dfba9266bc85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:10.453854 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe654c-628b-4b40-a0a4-dfba9266bc85 service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:10.454194 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe654c-628b-4b40-a0a4-dfba9266bc85 service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:10.454483 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe654c-628b-4b40-a0a4-dfba9266bc85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:10.463568 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe654c-628b-4b40-a0a4-dfba9266bc85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:10.465159 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe654c-628b-4b40-a0a4-dfba9266bc85 service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:10.474804 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1452/2885] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:27:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:27:13.646569 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc4a10-21c7-4404-8afa-e63546bc8f77 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:13.647152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc4a10-21c7-4404-8afa-e63546bc8f77 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:13.647152 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc4a10-21c7-4404-8afa-e63546bc8f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:13.665734 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-4dbc4a10-21c7-4404-8afa-e63546bc8f77 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:13.666984 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-4dbc4a10-21c7-4404-8afa-e63546bc8f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:13.675457 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1434/2886] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Jul 12 13:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:27:13.695946 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe654c-628b-4b40-a0a4-dfba9266bc85 service nova] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:13.707397 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe654c-628b-4b40-a0a4-dfba9266bc85 service nova] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:13.713484 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85a0a9-4e81-4132-a1f4-b4e3d4cebbfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:13.714169 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85a0a9-4e81-4132-a1f4-b4e3d4cebbfd service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:13.714462 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85a0a9-4e81-4132-a1f4-b4e3d4cebbfd service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:13.714744 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85a0a9-4e81-4132-a1f4-b4e3d4cebbfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:13.723261 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85a0a9-4e81-4132-a1f4-b4e3d4cebbfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:13.725446 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85a0a9-4e81-4132-a1f4-b4e3d4cebbfd service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:13.735262 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1453/2887] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:27:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:27:16.721238 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbb596-bc8b-41ba-9477-1a5e6de0f2ed None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:16.721784 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbb596-bc8b-41ba-9477-1a5e6de0f2ed None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:16.721784 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbb596-bc8b-41ba-9477-1a5e6de0f2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:16.741083 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-b1cbb596-bc8b-41ba-9477-1a5e6de0f2ed None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:16.742293 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-b1cbb596-bc8b-41ba-9477-1a5e6de0f2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:16.749997 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1435/2888] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Jul 12 13:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:27:16.770027 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85a0a9-4e81-4132-a1f4-b4e3d4cebbfd service nova] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:16.781384 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85a0a9-4e81-4132-a1f4-b4e3d4cebbfd service nova] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:16.786764 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9969737-1298-479f-bd1f-3071c02a3d57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:16.787430 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9969737-1298-479f-bd1f-3071c02a3d57 service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:16.787714 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9969737-1298-479f-bd1f-3071c02a3d57 service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:16.787991 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9969737-1298-479f-bd1f-3071c02a3d57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:16.796279 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9969737-1298-479f-bd1f-3071c02a3d57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:16.797895 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9969737-1298-479f-bd1f-3071c02a3d57 service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:16.808113 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1454/2889] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:27:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:27:19.884232 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6da61-c771-463d-939f-ba99eea5d544 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:19.884822 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6da61-c771-463d-939f-ba99eea5d544 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:19.884822 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6da61-c771-463d-939f-ba99eea5d544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:19.903107 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-05a6da61-c771-463d-939f-ba99eea5d544 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:19.904359 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-05a6da61-c771-463d-939f-ba99eea5d544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:19.912863 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1436/2890] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Jul 12 13:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:27:19.937283 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9969737-1298-479f-bd1f-3071c02a3d57 service nova] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:19.948906 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9969737-1298-479f-bd1f-3071c02a3d57 service nova] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:19.954426 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b64efa-a66e-432b-b3f0-9111c946d887 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:19.955080 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b64efa-a66e-432b-b3f0-9111c946d887 service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:19.955372 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b64efa-a66e-432b-b3f0-9111c946d887 service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:19.955664 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b64efa-a66e-432b-b3f0-9111c946d887 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:19.964381 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b64efa-a66e-432b-b3f0-9111c946d887 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:19.965938 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b64efa-a66e-432b-b3f0-9111c946d887 service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:19.980596 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1455/2891] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:27:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:27:23.041805 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6316a-9b46-4d72-9b21-46bf758826a7 None None] REQUEST_METHOD: `POST` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:23.042378 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6316a-9b46-4d72-9b21-46bf758826a7 None None] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:23.042378 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6316a-9b46-4d72-9b21-46bf758826a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:23.060959 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.auth.core [None req-09e6316a-9b46-4d72-9b21-46bf758826a7 None None] MFA Rules not processed for user `25d818b178534416a984336411a31d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:23.062188 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-09e6316a-9b46-4d72-9b21-46bf758826a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:23.070039 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1437/2892] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Jul 12 13:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:27:23.091959 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b64efa-a66e-432b-b3f0-9111c946d887 service nova] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:23.103800 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b64efa-a66e-432b-b3f0-9111c946d887 service nova] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:23.109312 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c995a5-bbb6-47e2-b3de-9044feebe4da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:23.109959 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c995a5-bbb6-47e2-b3de-9044feebe4da service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:23.110284 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c995a5-bbb6-47e2-b3de-9044feebe4da service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:23.110566 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c995a5-bbb6-47e2-b3de-9044feebe4da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:23.119734 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c995a5-bbb6-47e2-b3de-9044feebe4da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:23.121311 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c995a5-bbb6-47e2-b3de-9044feebe4da service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:23.130980 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1456/2893] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:27:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:27:26.154563 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6316a-9b46-4d72-9b21-46bf758826a7 None None] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:26.164536 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6316a-9b46-4d72-9b21-46bf758826a7 None None] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:26.168123 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0df0ac-9278-415b-9dbe-944ca4b07b9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b89afc60864451ba7b5a0a6d190628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:26.168777 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0df0ac-9278-415b-9dbe-944ca4b07b9c service cinder] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:26.169064 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0df0ac-9278-415b-9dbe-944ca4b07b9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:26.169342 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0df0ac-9278-415b-9dbe-944ca4b07b9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:26.171137 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-4d0df0ac-9278-415b-9dbe-944ca4b07b9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:26.185237 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0df0ac-9278-415b-9dbe-944ca4b07b9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:26.186753 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0df0ac-9278-415b-9dbe-944ca4b07b9c service cinder] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:26.199941 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1438/2894] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:27:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:27:28.783251 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c995a5-bbb6-47e2-b3de-9044feebe4da service nova] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:28.793285 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c995a5-bbb6-47e2-b3de-9044feebe4da service nova] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:28.796753 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5aa0f9-d6ec-432f-af7f-d2cb067cafae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:28.797386 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5aa0f9-d6ec-432f-af7f-d2cb067cafae service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:28.797670 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5aa0f9-d6ec-432f-af7f-d2cb067cafae service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:28.798168 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5aa0f9-d6ec-432f-af7f-d2cb067cafae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:28.799734 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-ab5aa0f9-d6ec-432f-af7f-d2cb067cafae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:28.812989 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5aa0f9-d6ec-432f-af7f-d2cb067cafae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:28.814435 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5aa0f9-d6ec-432f-af7f-d2cb067cafae service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:28.825503 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1457/2895] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:27:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:27:36.194022 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=21 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:38.820692 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=36 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:48.119846 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0df0ac-9278-415b-9dbe-944ca4b07b9c service cinder] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:48.129180 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0df0ac-9278-415b-9dbe-944ca4b07b9c service cinder] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:48.133556 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e737b71-a03d-4da0-8cd4-bdca9717867d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:48.134326 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e737b71-a03d-4da0-8cd4-bdca9717867d service neutron] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:48.134674 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e737b71-a03d-4da0-8cd4-bdca9717867d service neutron] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:48.135016 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e737b71-a03d-4da0-8cd4-bdca9717867d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:48.136832 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-9e737b71-a03d-4da0-8cd4-bdca9717867d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:48.148074 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e737b71-a03d-4da0-8cd4-bdca9717867d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:48.149601 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e737b71-a03d-4da0-8cd4-bdca9717867d service neutron] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:48.159136 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1439/2896] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:27:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:27:48.265897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5aa0f9-d6ec-432f-af7f-d2cb067cafae service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:48.276893 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5aa0f9-d6ec-432f-af7f-d2cb067cafae service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:48.281292 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4214c-127d-41d4-b6d6-0d894fcef834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:48.281950 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4214c-127d-41d4-b6d6-0d894fcef834 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:48.282276 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4214c-127d-41d4-b6d6-0d894fcef834 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:48.282556 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4214c-127d-41d4-b6d6-0d894fcef834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:48.284520 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-3cb4214c-127d-41d4-b6d6-0d894fcef834 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:48.302181 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4214c-127d-41d4-b6d6-0d894fcef834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:48.303744 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4214c-127d-41d4-b6d6-0d894fcef834 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:48.315598 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1458/2897] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:27:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:27:48.376814 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e737b71-a03d-4da0-8cd4-bdca9717867d service neutron] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:48.379399 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-9e737b71-a03d-4da0-8cd4-bdca9717867d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:48.456029 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e737b71-a03d-4da0-8cd4-bdca9717867d service neutron] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:48.461891 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e7839-c948-4ffe-b495-1261dbfdd342 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '698828dd940f46e2b493ba55cd894eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:48.462579 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e7839-c948-4ffe-b495-1261dbfdd342 service placement] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:48.462971 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e7839-c948-4ffe-b495-1261dbfdd342 service placement] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:48.463175 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e7839-c948-4ffe-b495-1261dbfdd342 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:48.465128 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-a78e7839-c948-4ffe-b495-1261dbfdd342 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:48.477470 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e7839-c948-4ffe-b495-1261dbfdd342 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:48.479149 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e7839-c948-4ffe-b495-1261dbfdd342 service placement] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:48.489589 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1440/2898] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:27:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:27:49.854085 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4214c-127d-41d4-b6d6-0d894fcef834 service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:49.863009 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4214c-127d-41d4-b6d6-0d894fcef834 service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:49.866615 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8183da8-5df0-45c6-adfa-9aa38f1bda13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f39694be5f447f9a25dacf7e4c99a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:49.867252 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8183da8-5df0-45c6-adfa-9aa38f1bda13 service neutron] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:49.867534 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8183da8-5df0-45c6-adfa-9aa38f1bda13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:49.867812 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8183da8-5df0-45c6-adfa-9aa38f1bda13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:49.869549 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-f8183da8-5df0-45c6-adfa-9aa38f1bda13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:49.879514 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8183da8-5df0-45c6-adfa-9aa38f1bda13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:49.880938 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8183da8-5df0-45c6-adfa-9aa38f1bda13 service neutron] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:49.889460 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1459/2899] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:27:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:27:51.033898 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e7839-c948-4ffe-b495-1261dbfdd342 service placement] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:51.046054 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e7839-c948-4ffe-b495-1261dbfdd342 service placement] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:51.052945 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c17f64-a272-4c73-9e41-0570ad09a58e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '698828dd940f46e2b493ba55cd894eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:51.053621 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c17f64-a272-4c73-9e41-0570ad09a58e service placement] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:51.053908 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c17f64-a272-4c73-9e41-0570ad09a58e service placement] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:51.054288 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c17f64-a272-4c73-9e41-0570ad09a58e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:51.056171 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-c4c17f64-a272-4c73-9e41-0570ad09a58e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:51.068992 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c17f64-a272-4c73-9e41-0570ad09a58e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:51.070671 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c17f64-a272-4c73-9e41-0570ad09a58e service placement] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:51.083695 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1441/2900] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:27:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:27:51.100032 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8183da8-5df0-45c6-adfa-9aa38f1bda13 service neutron] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:51.113843 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8183da8-5df0-45c6-adfa-9aa38f1bda13 service neutron] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:51.126738 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8e2f2-4bb5-419e-8a6d-56408b2c13e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:51.127743 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8e2f2-4bb5-419e-8a6d-56408b2c13e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:51.128219 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8e2f2-4bb5-419e-8a6d-56408b2c13e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:51.129244 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8e2f2-4bb5-419e-8a6d-56408b2c13e2 admin admin] PATH_INFO: `/v3/users/035a47f736e84efe99120fb9ca38cacc` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:51.130754 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8e2f2-4bb5-419e-8a6d-56408b2c13e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=035a47f736e84efe99120fb9ca38cacc)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:51.133445 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8e2f2-4bb5-419e-8a6d-56408b2c13e2 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:51.190397 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5ae8e2f2-4bb5-419e-8a6d-56408b2c13e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '035a47f736e84efe99120fb9ca38cacc'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:27:51.198649 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5ae8e2f2-4bb5-419e-8a6d-56408b2c13e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '035a47f736e84efe99120fb9ca38cacc'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:27:51.206523 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5ae8e2f2-4bb5-419e-8a6d-56408b2c13e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '035a47f736e84efe99120fb9ca38cacc'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:27:51.207238 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5ae8e2f2-4bb5-419e-8a6d-56408b2c13e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '035a47f736e84efe99120fb9ca38cacc'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:27:51.221645 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-5ae8e2f2-4bb5-419e-8a6d-56408b2c13e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '035a47f736e84efe99120fb9ca38cacc'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:27:51.229428 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1460/2901] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:27:51 2022] DELETE /identity/v3/users/035a47f736e84efe99120fb9ca38cacc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:27:51.492803 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c17f64-a272-4c73-9e41-0570ad09a58e service placement] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:51.511440 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c17f64-a272-4c73-9e41-0570ad09a58e service placement] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:51.576208 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ff063-0118-4b34-8ed6-1d5837644944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:51.576997 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ff063-0118-4b34-8ed6-1d5837644944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:51.577286 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ff063-0118-4b34-8ed6-1d5837644944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:51.577564 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ff063-0118-4b34-8ed6-1d5837644944 admin admin] PATH_INFO: `/v3/projects/499e94e564e64445a83e8e29e2ca6751` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:51.578825 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ff063-0118-4b34-8ed6-1d5837644944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=499e94e564e64445a83e8e29e2ca6751)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:51.580729 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ff063-0118-4b34-8ed6-1d5837644944 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:51.628331 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-538ff063-0118-4b34-8ed6-1d5837644944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '499e94e564e64445a83e8e29e2ca6751', 'request_id': 'req-538ff063-0118-4b34-8ed6-1d5837644944'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:27:51.635524 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-538ff063-0118-4b34-8ed6-1d5837644944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '499e94e564e64445a83e8e29e2ca6751', 'request_id': 'req-538ff063-0118-4b34-8ed6-1d5837644944'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:27:51.645936 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-538ff063-0118-4b34-8ed6-1d5837644944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '499e94e564e64445a83e8e29e2ca6751', 'request_id': 'req-538ff063-0118-4b34-8ed6-1d5837644944'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:27:51.653433 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:51.662312 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-538ff063-0118-4b34-8ed6-1d5837644944 admin admin] The token cache is being invalidate because project 499e94e564e64445a83e8e29e2ca6751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:27:51.663143 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-538ff063-0118-4b34-8ed6-1d5837644944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:27:51.664235 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-538ff063-0118-4b34-8ed6-1d5837644944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:27:51.666707 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1442/2902] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:27:51 2022] DELETE /identity/v3/projects/499e94e564e64445a83e8e29e2ca6751 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:28:01.225829 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=41,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:01.669428 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:DELETE=1,keystone:SELECT=2 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:09.824027 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8e2f2-4bb5-419e-8a6d-56408b2c13e2 admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:09.825665 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-5ae8e2f2-4bb5-419e-8a6d-56408b2c13e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:09.934868 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8e2f2-4bb5-419e-8a6d-56408b2c13e2 admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:10.070865 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b8e4c-a06e-420d-880d-1ecafb4cbfeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e52dfce1b06346bfbde6ee33e7f6f249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:10.072197 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b8e4c-a06e-420d-880d-1ecafb4cbfeb service nova] REQUEST_METHOD: `GET` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:10.072697 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b8e4c-a06e-420d-880d-1ecafb4cbfeb service nova] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:10.073468 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b8e4c-a06e-420d-880d-1ecafb4cbfeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:10.076700 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-f36b8e4c-a06e-420d-880d-1ecafb4cbfeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:10.094107 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b8e4c-a06e-420d-880d-1ecafb4cbfeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:10.096714 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b8e4c-a06e-420d-880d-1ecafb4cbfeb service nova] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:10.113589 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1461/2903] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:29:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:29:20.107484 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=62 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:21.057260 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ff063-0118-4b34-8ed6-1d5837644944 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:21.058778 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-538ff063-0118-4b34-8ed6-1d5837644944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:21.139482 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ff063-0118-4b34-8ed6-1d5837644944 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:21.147168 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1b41f-0e2b-4df3-8d37-5681d70f0e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:21.148150 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1b41f-0e2b-4df3-8d37-5681d70f0e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:21.148448 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1b41f-0e2b-4df3-8d37-5681d70f0e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:21.148730 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1b41f-0e2b-4df3-8d37-5681d70f0e42 admin admin] PATH_INFO: `/v3/users/ba1997c9721b4896b4f7019996d741e5` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:21.150220 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1b41f-0e2b-4df3-8d37-5681d70f0e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba1997c9721b4896b4f7019996d741e5)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:21.152270 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1b41f-0e2b-4df3-8d37-5681d70f0e42 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:21.210894 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-43a1b41f-0e2b-4df3-8d37-5681d70f0e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba1997c9721b4896b4f7019996d741e5'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:29:21.212296 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-43a1b41f-0e2b-4df3-8d37-5681d70f0e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba1997c9721b4896b4f7019996d741e5'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:29:21.222008 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-43a1b41f-0e2b-4df3-8d37-5681d70f0e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba1997c9721b4896b4f7019996d741e5'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:29:21.230489 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-43a1b41f-0e2b-4df3-8d37-5681d70f0e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba1997c9721b4896b4f7019996d741e5'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:29:21.243707 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-43a1b41f-0e2b-4df3-8d37-5681d70f0e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba1997c9721b4896b4f7019996d741e5'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:29:21.250040 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1443/2904] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:29:21 2022] DELETE /identity/v3/users/ba1997c9721b4896b4f7019996d741e5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:29:21.443897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b8e4c-a06e-420d-880d-1ecafb4cbfeb service nova] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:21.461730 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b8e4c-a06e-420d-880d-1ecafb4cbfeb service nova] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:21.531356 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcae3d-2b8f-403a-9af1-67882a354bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:21.532352 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcae3d-2b8f-403a-9af1-67882a354bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:21.532586 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcae3d-2b8f-403a-9af1-67882a354bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:21.532842 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcae3d-2b8f-403a-9af1-67882a354bae admin admin] PATH_INFO: `/v3/projects/6cfb22835b64405a838e165ee4ed609b` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:21.534097 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdcae3d-2b8f-403a-9af1-67882a354bae admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cfb22835b64405a838e165ee4ed609b)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:21.536090 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdcae3d-2b8f-403a-9af1-67882a354bae admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:21.595272 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-acdcae3d-2b8f-403a-9af1-67882a354bae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cfb22835b64405a838e165ee4ed609b', 'request_id': 'req-acdcae3d-2b8f-403a-9af1-67882a354bae'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:29:21.608201 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-acdcae3d-2b8f-403a-9af1-67882a354bae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cfb22835b64405a838e165ee4ed609b', 'request_id': 'req-acdcae3d-2b8f-403a-9af1-67882a354bae'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:29:21.620268 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-acdcae3d-2b8f-403a-9af1-67882a354bae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cfb22835b64405a838e165ee4ed609b', 'request_id': 'req-acdcae3d-2b8f-403a-9af1-67882a354bae'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:29:21.639678 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-acdcae3d-2b8f-403a-9af1-67882a354bae admin admin] The token cache is being invalidate because project 6cfb22835b64405a838e165ee4ed609b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:29:21.640196 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-acdcae3d-2b8f-403a-9af1-67882a354bae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:29:21.641258 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-acdcae3d-2b8f-403a-9af1-67882a354bae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:29:21.644524 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1462/2905] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:29:21 2022] DELETE /identity/v3/projects/6cfb22835b64405a838e165ee4ed609b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:29:21.649380 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1b41f-0e2b-4df3-8d37-5681d70f0e42 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:21.651568 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-43a1b41f-0e2b-4df3-8d37-5681d70f0e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:21.674225 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1b41f-0e2b-4df3-8d37-5681d70f0e42 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:21.759728 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eda4b0-8d32-4b51-8b04-261c3a114a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:21.761304 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eda4b0-8d32-4b51-8b04-261c3a114a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:21.761800 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eda4b0-8d32-4b51-8b04-261c3a114a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:21.762336 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eda4b0-8d32-4b51-8b04-261c3a114a59 admin admin] PATH_INFO: `/v3/users/17ef6576ad4c44a489fa66eabd2ef793` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:21.764545 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eda4b0-8d32-4b51-8b04-261c3a114a59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17ef6576ad4c44a489fa66eabd2ef793)` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:21.768868 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eda4b0-8d32-4b51-8b04-261c3a114a59 admin admin] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:21.809415 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:21.841198 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-68eda4b0-8d32-4b51-8b04-261c3a114a59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17ef6576ad4c44a489fa66eabd2ef793'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:29:21.841888 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-68eda4b0-8d32-4b51-8b04-261c3a114a59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17ef6576ad4c44a489fa66eabd2ef793'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:29:21.851028 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-68eda4b0-8d32-4b51-8b04-261c3a114a59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17ef6576ad4c44a489fa66eabd2ef793'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:29:21.859888 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-68eda4b0-8d32-4b51-8b04-261c3a114a59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17ef6576ad4c44a489fa66eabd2ef793'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:29:21.877531 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.notifications [None req-68eda4b0-8d32-4b51-8b04-261c3a114a59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17ef6576ad4c44a489fa66eabd2ef793'} {{(pid=80627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:29:21.884279 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1444/2906] 10.222.0.17 () {58 vars in 1223 bytes} [Tue Jul 12 13:29:21 2022] DELETE /identity/v3/users/17ef6576ad4c44a489fa66eabd2ef793 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:29:22.082140 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcae3d-2b8f-403a-9af1-67882a354bae admin admin] Authenticating user token {{(pid=80628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:22.084648 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.fernet_utils [None req-acdcae3d-2b8f-403a-9af1-67882a354bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:22.103815 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcae3d-2b8f-403a-9af1-67882a354bae admin admin] Validating token access rules against request {{(pid=80628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:22.173324 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452475bf-27c2-40ee-9add-c466a0896518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25d818b178534416a984336411a31d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b00723f48e18481b8e6c727fe321edb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:22.174243 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452475bf-27c2-40ee-9add-c466a0896518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:22.174528 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452475bf-27c2-40ee-9add-c466a0896518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:22.174807 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452475bf-27c2-40ee-9add-c466a0896518 admin admin] PATH_INFO: `/v3/projects/c74ea7e65a634078a09a601d3ed36071` {{(pid=80628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:22.176070 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452475bf-27c2-40ee-9add-c466a0896518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c74ea7e65a634078a09a601d3ed36071)` {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:22.178051 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452475bf-27c2-40ee-9add-c466a0896518 admin admin] RBAC: Authorization granted {{(pid=80628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:22.215897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:22.230686 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-452475bf-27c2-40ee-9add-c466a0896518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c74ea7e65a634078a09a601d3ed36071', 'request_id': 'req-452475bf-27c2-40ee-9add-c466a0896518'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:29:22.237795 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-452475bf-27c2-40ee-9add-c466a0896518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c74ea7e65a634078a09a601d3ed36071', 'request_id': 'req-452475bf-27c2-40ee-9add-c466a0896518'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:29:22.246971 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-452475bf-27c2-40ee-9add-c466a0896518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c74ea7e65a634078a09a601d3ed36071', 'request_id': 'req-452475bf-27c2-40ee-9add-c466a0896518'} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:29:22.261604 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-452475bf-27c2-40ee-9add-c466a0896518 admin admin] The token cache is being invalidate because project c74ea7e65a634078a09a601d3ed36071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:29:22.261897 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-452475bf-27c2-40ee-9add-c466a0896518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:29:22.262652 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG keystone.notifications [None req-452475bf-27c2-40ee-9add-c466a0896518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:29:22.264225 dv-cinder-797608-55-smb devstack@keystone.service[80628]: [pid: 80628|app: 0|req: 1463/2907] 10.222.0.17 () {58 vars in 1232 bytes} [Tue Jul 12 13:29:22 2022] DELETE /identity/v3/projects/c74ea7e65a634078a09a601d3ed36071 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:29:31.880413 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:32.258105 dv-cinder-797608-55-smb devstack@keystone.service[80628]: DEBUG dbcounter [-] [80628] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:33.948877 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eda4b0-8d32-4b51-8b04-261c3a114a59 admin admin] Authenticating user token {{(pid=80627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:30:33.950315 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-68eda4b0-8d32-4b51-8b04-261c3a114a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:30:34.021364 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eda4b0-8d32-4b51-8b04-261c3a114a59 admin admin] Validating token access rules against request {{(pid=80627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:30:34.080825 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46618db5-478c-4b0f-aab6-e4fdc4871d72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '698828dd940f46e2b493ba55cd894eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd70432d4e5a4e25a4a6def32ffc6ee2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:30:34.081481 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46618db5-478c-4b0f-aab6-e4fdc4871d72 service placement] REQUEST_METHOD: `GET` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:34.081771 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46618db5-478c-4b0f-aab6-e4fdc4871d72 service placement] SCRIPT_NAME: `/identity` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:34.082056 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46618db5-478c-4b0f-aab6-e4fdc4871d72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:34.083966 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.fernet_utils [None req-46618db5-478c-4b0f-aab6-e4fdc4871d72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:30:34.095147 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46618db5-478c-4b0f-aab6-e4fdc4871d72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:30:34.096726 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46618db5-478c-4b0f-aab6-e4fdc4871d72 service placement] RBAC: Authorization granted {{(pid=80627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:30:34.106668 dv-cinder-797608-55-smb devstack@keystone.service[80627]: [pid: 80627|app: 0|req: 1445/2908] 10.222.0.17 () {60 vars in 1365 bytes} [Tue Jul 12 13:30:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:30:44.102434 dv-cinder-797608-55-smb devstack@keystone.service[80627]: DEBUG dbcounter [-] [80627] Writing DB stats keystone:SELECT=58 {{(pid=80627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}